-- Logs begin at Tue 2022-07-26 03:43:48 UTC, end at Tue 2022-07-26 05:08:27 UTC. -- Jul 26 04:37:50.981653 dv-cinder-850574-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 26 04:37:50.990335 dv-cinder-850574-1-smb devstack@keystone.service[86737]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 26 04:37:50.992390 dv-cinder-850574-1-smb devstack@keystone.service[86737]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 26 04:37:50 2022] *** Jul 26 04:37:50.992390 dv-cinder-850574-1-smb devstack@keystone.service[86737]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 26 04:37:50.992390 dv-cinder-850574-1-smb devstack@keystone.service[86737]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 26 04:37:50.992390 dv-cinder-850574-1-smb devstack@keystone.service[86737]: nodename: dv-cinder-850574-1-smb Jul 26 04:37:50.992390 dv-cinder-850574-1-smb devstack@keystone.service[86737]: machine: x86_64 Jul 26 04:37:50.992390 dv-cinder-850574-1-smb devstack@keystone.service[86737]: clock source: unix Jul 26 04:37:50.992390 dv-cinder-850574-1-smb devstack@keystone.service[86737]: pcre jit disabled Jul 26 04:37:50.992390 dv-cinder-850574-1-smb devstack@keystone.service[86737]: detected number of CPU cores: 4 Jul 26 04:37:50.992390 dv-cinder-850574-1-smb devstack@keystone.service[86737]: current working directory: / Jul 26 04:37:50.992390 dv-cinder-850574-1-smb devstack@keystone.service[86737]: detected binary path: /usr/bin/uwsgi-core Jul 26 04:37:50.992390 dv-cinder-850574-1-smb devstack@keystone.service[86737]: your processes number limit is 47680 Jul 26 04:37:50.992390 dv-cinder-850574-1-smb devstack@keystone.service[86737]: your memory page size is 4096 bytes Jul 26 04:37:50.992390 dv-cinder-850574-1-smb devstack@keystone.service[86737]: detected max file descriptor number: 2048 Jul 26 04:37:50.992390 dv-cinder-850574-1-smb devstack@keystone.service[86737]: lock engine: pthread robust mutexes Jul 26 04:37:50.993307 dv-cinder-850574-1-smb devstack@keystone.service[86737]: thunder lock: enabled Jul 26 04:37:50.993307 dv-cinder-850574-1-smb devstack@keystone.service[86737]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 26 04:37:50.993307 dv-cinder-850574-1-smb devstack@keystone.service[86737]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 26 04:37:51.031222 dv-cinder-850574-1-smb devstack@keystone.service[86737]: Python main interpreter initialized at 0x560dff1e29c0 Jul 26 04:37:51.031222 dv-cinder-850574-1-smb devstack@keystone.service[86737]: python threads support enabled Jul 26 04:37:51.031222 dv-cinder-850574-1-smb devstack@keystone.service[86737]: your server socket listen backlog is limited to 100 connections Jul 26 04:37:51.031222 dv-cinder-850574-1-smb devstack@keystone.service[86737]: your mercy for graceful operations on workers is 90 seconds Jul 26 04:37:51.031589 dv-cinder-850574-1-smb devstack@keystone.service[86737]: mapped 403077 bytes (393 KB) for 2 cores Jul 26 04:37:51.031589 dv-cinder-850574-1-smb devstack@keystone.service[86737]: *** Operational MODE: preforking *** Jul 26 04:37:51.031899 dv-cinder-850574-1-smb devstack@keystone.service[86737]: *** uWSGI is running in multiple interpreter mode *** Jul 26 04:37:51.031899 dv-cinder-850574-1-smb devstack@keystone.service[86737]: spawned uWSGI master process (pid: 86737) Jul 26 04:37:51.032119 dv-cinder-850574-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 26 04:37:51.032634 dv-cinder-850574-1-smb devstack@keystone.service[86737]: spawned uWSGI worker 1 (pid: 86744, cores: 1) Jul 26 04:37:51.032974 dv-cinder-850574-1-smb devstack@keystone.service[86737]: spawned uWSGI worker 2 (pid: 86745, cores: 1) Jul 26 04:37:51.033603 dv-cinder-850574-1-smb devstack@keystone.service[86737]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 26 04:37:56.575542 dv-cinder-850574-1-smb devstack@keystone.service[86744]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 04:37:56.575542 dv-cinder-850574-1-smb devstack@keystone.service[86744]: from cryptography.utils import int_from_bytes Jul 26 04:37:56.576327 dv-cinder-850574-1-smb devstack@keystone.service[86744]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 04:37:56.576327 dv-cinder-850574-1-smb devstack@keystone.service[86744]: from cryptography.utils import int_from_bytes Jul 26 04:37:56.579194 dv-cinder-850574-1-smb devstack@keystone.service[86745]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 04:37:56.579194 dv-cinder-850574-1-smb devstack@keystone.service[86745]: from cryptography.utils import int_from_bytes Jul 26 04:37:56.580424 dv-cinder-850574-1-smb devstack@keystone.service[86745]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 26 04:37:56.580424 dv-cinder-850574-1-smb devstack@keystone.service[86745]: from cryptography.utils import int_from_bytes Jul 26 04:37:56.626363 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 04:37:56.626553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 04:37:56.626800 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] command line args: [] {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 04:37:56.627006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 04:37:56.627219 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ================================================================================ {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 04:37:56.627469 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] admin_token = **** {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.627710 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] config_dir = [] {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.627926 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.628138 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] config_source = [] {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.628281 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] debug = True {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.628483 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.631150 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.631150 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.631150 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.631150 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.631150 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] list_limit = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.631150 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] log_config_append = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.631150 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.631150 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] log_dir = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.632697 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 26 04:37:56.632931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] log_file = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.633136 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 26 04:37:56.633136 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] command line args: [] {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 26 04:37:56.633695 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.633695 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.634118 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 26 04:37:56.634290 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.634530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ================================================================================ {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 26 04:37:56.634700 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.634925 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] admin_token = **** {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.635127 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.635127 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.635515 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] config_dir = [] {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.635515 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.635901 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.636102 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] config_source = [] {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.636334 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.636466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] debug = True {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.636599 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.636723 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.636877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.637004 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.637133 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.637250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.637348 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.637452 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.637522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.637594 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.637666 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.637666 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.637795 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] list_limit = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.637795 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] log_config_append = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.637934 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.638031 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.638117 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] publish_errors = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.638194 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] log_dir = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.638254 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.638322 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] log_file = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.638477 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.638477 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.638805 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.638934 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.638934 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.639171 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.639302 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] standard_threads = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.639302 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.639565 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.639721 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.639721 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.639721 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] use_journal = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.640038 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.640122 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] use_json = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.640122 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] use_stderr = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.640265 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.640399 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] use_syslog = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.640399 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.640399 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.640739 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.640866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.640992 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.641117 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.641117 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.641372 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.641505 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.641649 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.641782 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.641908 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.642056 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.642240 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.642375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.642375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.642375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.642731 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.642855 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.642855 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.643137 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.643276 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.643414 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.643541 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.643541 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.643785 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.643920 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.643920 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.643920 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.644258 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.644408 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.644537 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] publish_errors = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.644665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.644665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.644911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.645037 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.645037 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.645037 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.645405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.645529 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.645675 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.645802 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.645802 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.646098 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.646224 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.646224 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.646476 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.646601 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.646733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] standard_threads = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.646869 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.646869 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.646869 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.647323 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.647450 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.647581 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.647713 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.647846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.647972 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.648176 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] use_journal = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.648176 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] use_json = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.648414 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.648545 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] use_stderr = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.648671 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.648808 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] use_syslog = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.648946 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.648946 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.649183 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 26 04:37:56.649347 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.649347 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.649347 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.649347 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.649824 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.650123 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.650266 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.650400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.650400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.650645 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.650734 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.650734 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.650972 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.651046 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.651046 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.651046 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.651256 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.651547 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.651665 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.651746 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.651902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.652042 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.652125 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.652298 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.652420 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.652587 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.652670 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.652883 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.653005 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.653095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.653169 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.653359 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.653494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.653582 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.653663 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.653819 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.653896 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.654095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.654218 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.654316 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.654395 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.654551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.654673 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.654753 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.654836 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.655043 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.655166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.655255 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.655467 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.655556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.655646 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.655792 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.655914 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.656029 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.656119 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.656356 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.656490 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.656586 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.656661 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.656795 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.656874 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.657084 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.657219 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.657302 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.657422 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.657539 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.657638 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.657779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.657889 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.658019 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.658122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.658218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.658322 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.658418 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.658564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.658676 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.658780 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.658888 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.659036 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.659158 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.659276 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.659365 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.659517 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.659605 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.659770 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.659850 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.660004 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.660095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.660250 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.660339 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.660486 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.660568 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.660711 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.660897 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.660976 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.661049 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.661170 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.661248 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.661374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.661469 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.661606 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.661685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.661849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.661927 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.662130 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.662262 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.662340 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.662462 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.662571 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.662652 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.662829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.662954 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.663080 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.663158 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.663323 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.663401 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.663556 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.663641 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] auth.external = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.663785 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.663869 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.664022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.664099 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.664262 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.664349 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.664542 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] auth.password = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.664662 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.664758 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] auth.token = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.664894 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.665000 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.665090 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.665236 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.665323 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.665482 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.665641 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.665724 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.665921 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.666041 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.666210 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.666288 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.666446 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.666523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.666667 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] credential.caching = True {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.666756 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.666916 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.666997 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.667155 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.667233 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.667417 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.667539 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.667622 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.667698 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.667861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.667940 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.668160 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.668247 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.668415 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.668495 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.668654 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.668743 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.668890 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.669105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.669184 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.669302 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.669424 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.669512 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.669698 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.669849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.669926 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.670043 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.670222 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.670306 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.670441 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.670535 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.670758 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.670851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] federation.caching = True {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.671001 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.671080 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.671238 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.671317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.671475 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.671562 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.671709 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.671787 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.671960 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.672040 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.672199 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.672291 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.672436 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.672515 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.672679 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.672759 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.672917 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.673003 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.673157 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.673236 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.673395 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.673477 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.673636 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] identity.caching = True {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.673726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.673885 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.674055 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.674141 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.674262 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.674383 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.674481 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.674621 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.674701 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.674869 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.674950 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.675101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.675188 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.675339 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.675419 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.675589 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.675668 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.675843 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.675937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.676075 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.676155 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.676306 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.676385 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.676537 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.676709 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] auth.external = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.676792 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.676867 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.677013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.677135 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.677274 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.677398 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.677502 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.677693 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] auth.password = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.677773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.678015 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] auth.token = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.678198 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.678344 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.678431 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.678530 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.678612 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.678714 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.678806 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.678955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.679046 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.679189 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.679288 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.679424 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.679515 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.679667 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.679763 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.679908 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.679998 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] credential.caching = True {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.680158 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.680248 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.680409 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.680488 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.680627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.680725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.680872 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.680974 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.681106 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.681195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.681339 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.681428 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.681583 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.681680 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.681814 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.681903 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.682074 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.682165 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.682308 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.682416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.682548 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.682637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.682785 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.682953 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.683043 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.683257 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.683346 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.683492 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.683581 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.683816 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.683909 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.684067 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.684206 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] federation.caching = True {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.684307 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.684447 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.684528 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.684700 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.684790 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.684952 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.685034 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.685186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.685292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.685429 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.685517 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.685666 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.685755 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.685895 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.user = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.686033 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.686161 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.686251 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.686415 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.686495 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.686644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.686723 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.686889 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.686975 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.687125 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] identity.caching = True {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.687206 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.687376 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.687508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.687653 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.687763 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.687845 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.687919 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.688036 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.688167 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.688268 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.688440 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.688530 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.688721 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.688825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.689002 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.689125 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.689215 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.689291 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.689609 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.695914 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.695914 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.695914 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.695914 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.695914 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.696331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.696331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.696331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.696580 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.696674 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.696674 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.696845 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.696940 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.697076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.697165 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.697165 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.697318 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.697400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.697400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.697616 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.697725 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.697814 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.697896 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.698091 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.698272 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.698383 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.698494 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.698583 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.698664 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.698664 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.698870 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.698951 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.698951 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.699175 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.699282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.699390 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.699496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.699496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.699642 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.699719 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] resource.caching = True {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.699793 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.699872 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.699951 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.700044 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.700044 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.700204 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.700283 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.700362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.700447 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.700546 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.700633 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.700713 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.700791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.700791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.700934 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.701013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.701114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.701197 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] role.caching = True {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.701271 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.701349 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] role.driver = sql {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.701428 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.701502 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.701612 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.701690 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.701763 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.701840 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.701919 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.702037 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.702126 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.702229 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.702315 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.702395 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.702475 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.702554 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.702637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.702717 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.702797 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.702871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.702943 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.703015 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.703098 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.703173 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.703251 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.703332 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.703400 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.703461 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.703533 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.703594 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.703672 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.703672 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.user = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.703798 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.703858 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.703924 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.703990 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.704050 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.704110 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.704173 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.704246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.704329 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.704398 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.704463 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.704529 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.704594 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.704654 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.704721 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.704786 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.705214 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.705288 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.705348 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.705414 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.705475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.705539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.705662 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.705748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.705823 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.706110 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.706196 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.706265 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.706326 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.706387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.706446 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.706597 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.706684 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.706756 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.706830 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.706954 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.707042 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.707189 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] token.caching = True {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.707278 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.707426 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.707515 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.707664 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.707740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.707894 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.707982 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.708128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.708208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.708380 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.708460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.708618 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.708701 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.708854 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.708940 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.709092 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.709172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.709326 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.709413 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.709564 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.709649 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.709798 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.709884 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.710055 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.710149 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.710303 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.710444 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.710552 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.710698 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.710791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.710943 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.711031 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.711179 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.711292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.711421 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.711556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] database.connection = **** {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.711650 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] resource.caching = True {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.711799 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.711887 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.712046 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.712133 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.712284 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.712374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.712522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.712603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.712755 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.712842 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.713033 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.713131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.713286 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.713407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.713489 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.713565 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.713732 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.713884 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.714060 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.714146 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] role.caching = True {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.714243 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] role.driver = sql {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.714325 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.714480 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.714631 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.714721 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.714877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.715040 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.715137 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.715343 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.715441 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.715523 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.715603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.715758 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.715840 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.715992 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.716087 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.716170 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86744) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 04:37:56.716280 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.716528 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.716763 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.717011 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.717257 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.717502 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.717746 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.718206 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.718448 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.718698 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.718946 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.719195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.719441 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.719677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.719932 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.720188 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.720482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.720659 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.720892 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.721123 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.721379 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.721631 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.721877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.722137 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.722374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.722604 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.722839 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] token.caching = True {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.723073 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.723319 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.723554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.723811 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.724056 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.724293 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.724535 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.724777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.725024 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.725260 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.725500 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.725733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.726002 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.726247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.726481 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.726724 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.727016 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.727277 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] database.connection = **** {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.727520 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.727765 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.728001 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.728240 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.728478 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.728714 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.728947 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.729181 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.729424 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.729657 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.729902 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.730196 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.730451 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.730709 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.730956 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.731190 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.731486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.731725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 26 04:37:56.731892 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86745) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 26 04:37:56.746524 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.746762 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.746960 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.755689 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.757155 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.757382 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.757617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.766215 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.785971 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.786249 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.794725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.794996 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.839341 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.840338 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.889786 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.890120 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.890982 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.891223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.955695 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.955969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.956136 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.956229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.956393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.956574 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.956711 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.956838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.957011 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.957156 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.957156 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.957156 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.980291 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.980555 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.980800 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.980941 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.981078 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.981248 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.981388 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.981527 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.981661 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.981793 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.981926 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.982085 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.982085 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.982348 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.993032 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:56.994117 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:57.005935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:57.006203 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:57.006356 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:57.006499 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:57.006588 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:57.006716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:57.006849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:57.006999 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:57.007180 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:57.007309 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:57.007434 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86744) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:57.007570 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:57.007570 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:57.007570 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86745) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 26 04:37:57.024229 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.024451 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 04:37:57.024762 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.024969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 04:37:57.025127 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.025260 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.025387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 04:37:57.025530 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.025699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.025823 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.025961 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 26 04:37:57.026136 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.026303 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.026303 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.026545 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.026690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.035501 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.035806 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.036072 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.036308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.036478 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.036647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.036816 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.037119 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.043276 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.044039 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.048081 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.048362 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.048630 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.048853 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.049004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.049159 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.049293 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.049419 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.049542 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.049694 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.049830 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.049969 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.050124 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.050247 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.050371 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.050498 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.050636 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.050763 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.050888 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.051022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.051281 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.051546 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.073365 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.074623 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.074914 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.075196 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.076101 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.076383 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.079763 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.080405 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.080687 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.081327 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.081609 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.081884 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.087316 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.087599 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.088404 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.088690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.091922 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.092152 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.092442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.092719 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.092992 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.093115 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.093279 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.093401 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.093517 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.093618 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.093821 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.093950 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.094112 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.094379 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.094654 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.094929 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.109617 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.109876 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.110920 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.111196 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.113771 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.115092 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.116956 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.117254 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.118249 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.118547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.121654 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.122978 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.124847 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.126142 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.128043 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.128337 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.128623 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.128907 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.129199 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.129335 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.129463 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.129556 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.129864 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.130170 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.130449 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.130738 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.145539 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.145835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.146128 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.146400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.146883 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.147186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.147454 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.147712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.153402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.154649 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.154988 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.155264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.156157 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.156452 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.158073 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.158330 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.158651 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.158942 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.159223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.159374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.159504 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.159800 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.160085 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.160375 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.170604 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.170883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.171158 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.171444 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.171718 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.171842 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.171943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.172102 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.172227 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.172320 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.172636 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.172916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.173187 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.173465 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.187622 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.189109 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.190576 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.192094 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.193517 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.195042 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.196102 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.197595 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.197719 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.197886 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.198221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.199138 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.199469 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.199781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.204644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.206612 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.206737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.208193 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.209498 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.209786 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.210101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.210386 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.211126 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.211415 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.211818 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.212093 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.218384 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.218668 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.218947 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.220172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.220459 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.220736 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.225716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86744) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.226017 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.226299 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.226570 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.226850 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.227123 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.227400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.227523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86745) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 26 04:37:57.227680 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.227773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.228030 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.228156 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.228293 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.228387 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.228574 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.228700 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.228797 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.228925 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.229103 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.229229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.229311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86744) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.229388 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.229727 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.229993 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.230333 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.230675 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.230939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.231198 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86745) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 26 04:37:57.262327 dv-cinder-850574-1-smb devstack@keystone.service[86744]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560dff1e29c0 pid: 86744 (default app) Jul 26 04:37:57.264295 dv-cinder-850574-1-smb devstack@keystone.service[86745]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560dff1e29c0 pid: 86745 (default app) Jul 26 04:37:57.265705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7b168-5d71-4ea5-90cb-df95be651c94 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:37:57.265937 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7b168-5d71-4ea5-90cb-df95be651c94 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:37:57.266275 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7b168-5d71-4ea5-90cb-df95be651c94 None None] PATH_INFO: `/v3` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:37:57.270586 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 791 bytes} [Tue Jul 26 04:37:57 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:04.878521 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279e93a-ae7a-4176-83ef-372672b0d5ed None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:04.879453 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279e93a-ae7a-4176-83ef-372672b0d5ed None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:04.879453 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279e93a-ae7a-4176-83ef-372672b0d5ed None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:04.886785 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:04 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:04.896004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249232a9-56af-4f3f-bf5b-3fe40dfd847d None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:04.896737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249232a9-56af-4f3f-bf5b-3fe40dfd847d None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:04.896890 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249232a9-56af-4f3f-bf5b-3fe40dfd847d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:04.970668 dv-cinder-850574-1-smb devstack@keystone.service[86744]: INFO dbcounter [None req-249232a9-56af-4f3f-bf5b-3fe40dfd847d None None] Registered counter for database keystone Jul 26 04:38:04.995835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG oslo_db.sqlalchemy.engines [None req-249232a9-56af-4f3f-bf5b-3fe40dfd847d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86744) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:38:05.003190 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writer thread running {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:38:05.190743 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG passlib.handlers.bcrypt [None req-249232a9-56af-4f3f-bf5b-3fe40dfd847d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86744) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 26 04:38:05.191191 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG passlib.handlers.bcrypt [None req-249232a9-56af-4f3f-bf5b-3fe40dfd847d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86744) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 26 04:38:05.249687 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-249232a9-56af-4f3f-bf5b-3fe40dfd847d None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:05.251375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-249232a9-56af-4f3f-bf5b-3fe40dfd847d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:05.382377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 2/3] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 488 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 26 04:38:05.535746 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279e93a-ae7a-4176-83ef-372672b0d5ed None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:05.614546 dv-cinder-850574-1-smb devstack@keystone.service[86745]: INFO dbcounter [None req-3279e93a-ae7a-4176-83ef-372672b0d5ed None None] Registered counter for database keystone Jul 26 04:38:05.635807 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG oslo_db.sqlalchemy.engines [None req-3279e93a-ae7a-4176-83ef-372672b0d5ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86745) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 26 04:38:05.643686 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writer thread running {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 26 04:38:05.764545 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279e93a-ae7a-4176-83ef-372672b0d5ed None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:05.769336 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1906e-5d3a-4e14-8bcf-67f8600e6965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:05.770012 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1906e-5d3a-4e14-8bcf-67f8600e6965 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:05.770316 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1906e-5d3a-4e14-8bcf-67f8600e6965 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:05.770581 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1906e-5d3a-4e14-8bcf-67f8600e6965 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:05.780294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1906e-5d3a-4e14-8bcf-67f8600e6965 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:05.831520 dv-cinder-850574-1-smb devstack@keystone.service[86745]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bcf1906e-5d3a-4e14-8bcf-67f8600e6965 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 26 04:38:05.831781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1906e-5d3a-4e14-8bcf-67f8600e6965 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:05.842574 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1324 bytes} [Tue Jul 26 04:38:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 04:38:05.849729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249232a9-56af-4f3f-bf5b-3fe40dfd847d None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:05.867276 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249232a9-56af-4f3f-bf5b-3fe40dfd847d None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:05.873665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9247c78-b131-4bd5-b32f-5ab6a5111d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:05.874805 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9247c78-b131-4bd5-b32f-5ab6a5111d45 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:05.875086 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9247c78-b131-4bd5-b32f-5ab6a5111d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:05.875352 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9247c78-b131-4bd5-b32f-5ab6a5111d45 admin admin] PATH_INFO: `/v3/projects/01e6e551a86f4df9abc0b95c6772bf0e` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:05.877065 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9247c78-b131-4bd5-b32f-5ab6a5111d45 admin admin] RBAC: Authorizing `identity:get_project(project_id=01e6e551a86f4df9abc0b95c6772bf0e)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:05.926620 dv-cinder-850574-1-smb devstack@keystone.service[86744]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d9247c78-b131-4bd5-b32f-5ab6a5111d45 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 26 04:38:05.927207 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9247c78-b131-4bd5-b32f-5ab6a5111d45 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:05.931618 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 3/5] 10.222.0.39 () {56 vars in 1207 bytes} [Tue Jul 26 04:38:05 2022] GET /identity/v3/projects/01e6e551a86f4df9abc0b95c6772bf0e => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:07.882857 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568ccc5-4ea5-4b9a-b06c-80dcf80bd2d3 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:07.883436 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568ccc5-4ea5-4b9a-b06c-80dcf80bd2d3 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:07.883436 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568ccc5-4ea5-4b9a-b06c-80dcf80bd2d3 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:07.887557 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 3/6] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:07.893123 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75278d61-6a15-460f-933f-0fdf2bf5d5ec None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:07.893547 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75278d61-6a15-460f-933f-0fdf2bf5d5ec None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:07.893640 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75278d61-6a15-460f-933f-0fdf2bf5d5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:07.915629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-75278d61-6a15-460f-933f-0fdf2bf5d5ec None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:07.917248 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-75278d61-6a15-460f-933f-0fdf2bf5d5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:07.926720 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 4/7] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 26 04:38:07.950813 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568ccc5-4ea5-4b9a-b06c-80dcf80bd2d3 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:07.966065 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568ccc5-4ea5-4b9a-b06c-80dcf80bd2d3 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:07.970918 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83495c2-c1d8-45a0-9711-5facd42fc076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:07.971569 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83495c2-c1d8-45a0-9711-5facd42fc076 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:07.971850 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83495c2-c1d8-45a0-9711-5facd42fc076 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:07.972125 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83495c2-c1d8-45a0-9711-5facd42fc076 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:07.981222 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83495c2-c1d8-45a0-9711-5facd42fc076 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:07.983081 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83495c2-c1d8-45a0-9711-5facd42fc076 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:07.993228 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 4/8] 10.222.0.39 () {58 vars in 1324 bytes} [Tue Jul 26 04:38:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 04:38:07.999684 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75278d61-6a15-460f-933f-0fdf2bf5d5ec None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:08.009534 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75278d61-6a15-460f-933f-0fdf2bf5d5ec None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:08.015368 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09a0c8-b79b-46e9-912c-91a5ef3264f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:08.016015 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09a0c8-b79b-46e9-912c-91a5ef3264f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:08.016296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09a0c8-b79b-46e9-912c-91a5ef3264f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:08.016565 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09a0c8-b79b-46e9-912c-91a5ef3264f7 admin admin] PATH_INFO: `/v3/users/fb4866594bcc4f3fa8cc9d8ea5e9f327` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:08.018134 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c09a0c8-b79b-46e9-912c-91a5ef3264f7 admin admin] RBAC: Authorizing `identity:get_user(user_id=fb4866594bcc4f3fa8cc9d8ea5e9f327)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:08.020013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c09a0c8-b79b-46e9-912c-91a5ef3264f7 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:08.021584 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 5/9] 10.222.0.39 () {56 vars in 1198 bytes} [Tue Jul 26 04:38:07 2022] GET /identity/v3/users/fb4866594bcc4f3fa8cc9d8ea5e9f327 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:10.071688 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311fbd4-5de3-4dfe-b588-f16b63d52d43 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:10.072432 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311fbd4-5de3-4dfe-b588-f16b63d52d43 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:10.072432 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2311fbd4-5de3-4dfe-b588-f16b63d52d43 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:10.073593 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:10.079615 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194c4e1-8324-4696-96b3-27c26083d317 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:10.080099 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194c4e1-8324-4696-96b3-27c26083d317 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:10.080193 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194c4e1-8324-4696-96b3-27c26083d317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:10.100884 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-b194c4e1-8324-4696-96b3-27c26083d317 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:10.102227 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-b194c4e1-8324-4696-96b3-27c26083d317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:10.122496 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cc6b5-daec-4e2e-b75a-4412d8568703 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:10.122764 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cc6b5-daec-4e2e-b75a-4412d8568703 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:10.123076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6cc6b5-daec-4e2e-b75a-4412d8568703 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:10.124430 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 6/11] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:38:10.129654 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9b0e4-014a-49fd-b3ed-e0ef4a6c69b8 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:10.129941 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9b0e4-014a-49fd-b3ed-e0ef4a6c69b8 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:10.130246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9b0e4-014a-49fd-b3ed-e0ef4a6c69b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:10.173152 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG passlib.handlers.bcrypt [None req-b7b9b0e4-014a-49fd-b3ed-e0ef4a6c69b8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86745) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 26 04:38:10.173602 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG passlib.handlers.bcrypt [None req-b7b9b0e4-014a-49fd-b3ed-e0ef4a6c69b8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86745) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 26 04:38:10.197085 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 6/12] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:10.219925 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-b7b9b0e4-014a-49fd-b3ed-e0ef4a6c69b8 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:10.220606 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194c4e1-8324-4696-96b3-27c26083d317 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:10.221543 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-b7b9b0e4-014a-49fd-b3ed-e0ef4a6c69b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:10.246020 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:10.329427 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194c4e1-8324-4696-96b3-27c26083d317 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:10.349754 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 7/13] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 04:38:10.371439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9b0e4-014a-49fd-b3ed-e0ef4a6c69b8 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:10.374982 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3cb30-8503-4246-895b-a0675dbd1aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:10.375649 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3cb30-8503-4246-895b-a0675dbd1aa6 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:10.375924 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3cb30-8503-4246-895b-a0675dbd1aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:10.376195 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3cb30-8503-4246-895b-a0675dbd1aa6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:10.388725 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d3cb30-8503-4246-895b-a0675dbd1aa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:10.403557 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-28d3cb30-8503-4246-895b-a0675dbd1aa6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:38:10.403557 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:10.403557 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:10.403557 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:10.403557 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:10.403557 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:10.403557 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:10.403557 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:10.403557 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:10.403557 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:10.403557 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:10.403557 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:10.403557 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:10.403557 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:10.403557 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:10.403557 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:10.404538 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:10.404538 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:10.404538 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:10.404538 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:10.404538 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:10.404538 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:10.404538 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:10.404538 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:10.404538 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:10.404538 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:10.404538 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:10.404538 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:10.404538 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:10.404538 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:10.404538 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:10.404538 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:10.405572 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:10.405572 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:10.405572 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:10.405572 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:10.405572 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:10.405572 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:10.405572 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:10.405572 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:10.405572 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:10.405572 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:10.405572 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:38:10.405572 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:38:10.405572 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 7/14] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:38:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:38:10.411681 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3cb30-8503-4246-895b-a0675dbd1aa6 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:10.485588 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9b0e4-014a-49fd-b3ed-e0ef4a6c69b8 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:10.493209 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:10.520985 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:10.526940 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304a34a-ce2e-4783-bec3-7a0ced1b4b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:10.527844 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304a34a-ce2e-4783-bec3-7a0ced1b4b5e None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:10.528127 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304a34a-ce2e-4783-bec3-7a0ced1b4b5e None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:10.528399 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304a34a-ce2e-4783-bec3-7a0ced1b4b5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:10.548430 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3cb30-8503-4246-895b-a0675dbd1aa6 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:10.586811 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd7329-5650-4eda-849c-909de0d75bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:10.587364 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd7329-5650-4eda-849c-909de0d75bb4 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:10.587646 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd7329-5650-4eda-849c-909de0d75bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:10.587921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd7329-5650-4eda-849c-909de0d75bb4 None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:10.588678 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd7329-5650-4eda-849c-909de0d75bb4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:10.588980 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd7329-5650-4eda-849c-909de0d75bb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:10.590458 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd7329-5650-4eda-849c-909de0d75bb4 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:10.602938 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304a34a-ce2e-4783-bec3-7a0ced1b4b5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:10.603172 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 8/15] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:38:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:10.609002 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd7329-5650-4eda-849c-909de0d75bb4 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:10.609767 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304a34a-ce2e-4783-bec3-7a0ced1b4b5e None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:10.718893 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd7329-5650-4eda-849c-909de0d75bb4 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:10.719322 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 8/16] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:38:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 04:38:10.725610 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304a34a-ce2e-4783-bec3-7a0ced1b4b5e None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:10.730046 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:10.853400 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304a34a-ce2e-4783-bec3-7a0ced1b4b5e None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:10.869167 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a1150-be27-4703-952e-2a5b5fb864a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:10.869837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a1150-be27-4703-952e-2a5b5fb864a6 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:10.870237 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a1150-be27-4703-952e-2a5b5fb864a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:10.870514 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a1150-be27-4703-952e-2a5b5fb864a6 None admin] PATH_INFO: `/v3/users/fb4866594bcc4f3fa8cc9d8ea5e9f327` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:10.871756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a1150-be27-4703-952e-2a5b5fb864a6 None admin] RBAC: Authorizing `identity:get_user(user_id=fb4866594bcc4f3fa8cc9d8ea5e9f327)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:10.873276 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a1150-be27-4703-952e-2a5b5fb864a6 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:10.874977 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 9/17] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:10 2022] GET /identity/v3/users/fb4866594bcc4f3fa8cc9d8ea5e9f327 => generated 247 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:38:10.881952 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a1150-be27-4703-952e-2a5b5fb864a6 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:10.894361 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b11e0-81cd-42cb-b23e-b1fbbefc8210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:10.895227 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b11e0-81cd-42cb-b23e-b1fbbefc8210 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:10.895510 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b11e0-81cd-42cb-b23e-b1fbbefc8210 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:10.895785 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b11e0-81cd-42cb-b23e-b1fbbefc8210 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:10.897829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:10.916165 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b11e0-81cd-42cb-b23e-b1fbbefc8210 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:10.917839 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b11e0-81cd-42cb-b23e-b1fbbefc8210 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:10.937736 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-b77b11e0-81cd-42cb-b23e-b1fbbefc8210 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:38:10.937736 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:10.937736 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:10.937736 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:10.937736 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:10.937736 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:10.937736 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:10.937736 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:10.937736 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:10.937736 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:10.937736 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:10.937736 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:10.937736 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:38:10.937736 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:38:10.937736 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:38:10.938760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:38:10.938760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:10.938760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:10.938760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:10.938760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:10.938760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:10.938760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:10.938760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:10.938760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:10.938760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:10.938760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:10.938760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:10.938760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:10.938760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:10.938760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:10.938760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:10.938760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:10.939559 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:38:10.939559 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:38:10.939559 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:38:10.939559 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:38:10.939559 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 9/18] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:38:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:38:10.945250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b11e0-81cd-42cb-b23e-b1fbbefc8210 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:10.998698 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a1150-be27-4703-952e-2a5b5fb864a6 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:11.008576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:11.048873 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200edeb-5e58-40bb-bad0-87901072c5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:11.049545 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200edeb-5e58-40bb-bad0-87901072c5fa None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:11.049833 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200edeb-5e58-40bb-bad0-87901072c5fa None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:11.050137 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200edeb-5e58-40bb-bad0-87901072c5fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:11.051426 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b200edeb-5e58-40bb-bad0-87901072c5fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:11.052921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b200edeb-5e58-40bb-bad0-87901072c5fa None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:11.054593 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 10/19] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:38:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:11.057728 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b11e0-81cd-42cb-b23e-b1fbbefc8210 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:11.060448 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200edeb-5e58-40bb-bad0-87901072c5fa None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:11.098662 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930286f2-6355-4bdc-938b-ee94d6279662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:11.099301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930286f2-6355-4bdc-938b-ee94d6279662 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:11.099579 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930286f2-6355-4bdc-938b-ee94d6279662 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:11.099859 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930286f2-6355-4bdc-938b-ee94d6279662 None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:11.100578 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930286f2-6355-4bdc-938b-ee94d6279662 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:11.100883 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930286f2-6355-4bdc-938b-ee94d6279662 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:11.102404 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930286f2-6355-4bdc-938b-ee94d6279662 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:11.121134 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 10/20] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:11.150244 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:11.171195 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200edeb-5e58-40bb-bad0-87901072c5fa None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:11.210082 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074e93a-3862-4d42-88a9-ee052115d16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:11.210734 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074e93a-3862-4d42-88a9-ee052115d16e None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:11.211016 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074e93a-3862-4d42-88a9-ee052115d16e None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:11.211291 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074e93a-3862-4d42-88a9-ee052115d16e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:11.212106 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074e93a-3862-4d42-88a9-ee052115d16e None admin] RBAC: Adding query filter params (role.id=2bfdd65b06554a6da967b3939da753c7, scope.domain.id=default, user.id=fb4866594bcc4f3fa8cc9d8ea5e9f327) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:11.212419 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074e93a-3862-4d42-88a9-ee052115d16e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:11.213961 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074e93a-3862-4d42-88a9-ee052115d16e None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:11.221999 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 11/21] 10.222.0.39 () {56 vars in 1322 bytes} [Tue Jul 26 04:38:11 2022] GET /identity/v3/role_assignments?user.id=fb4866594bcc4f3fa8cc9d8ea5e9f327&scope.domain.id=default&role.id=2bfdd65b06554a6da967b3939da753c7 => generated 233 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:13.411328 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b97bc-2dd3-46e6-ad21-fba0ea01939c None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:13.412312 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b97bc-2dd3-46e6-ad21-fba0ea01939c None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:13.412823 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780b97bc-2dd3-46e6-ad21-fba0ea01939c None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:13.414458 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 11/22] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:13.420363 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd8930-a632-4759-a888-18dda79487e8 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:13.421247 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd8930-a632-4759-a888-18dda79487e8 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:13.421743 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd8930-a632-4759-a888-18dda79487e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:13.443460 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-31bd8930-a632-4759-a888-18dda79487e8 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:13.445030 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-31bd8930-a632-4759-a888-18dda79487e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:13.531462 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 12/23] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 04:38:13.571571 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b97bc-2dd3-46e6-ad21-fba0ea01939c None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:13.708050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780b97bc-2dd3-46e6-ad21-fba0ea01939c None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:13.733716 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:13.758733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07602a9-5d55-4563-adb9-8b0157467d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:13.759416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07602a9-5d55-4563-adb9-8b0157467d01 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:13.759697 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07602a9-5d55-4563-adb9-8b0157467d01 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:13.759960 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07602a9-5d55-4563-adb9-8b0157467d01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:13.776145 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07602a9-5d55-4563-adb9-8b0157467d01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:13.782818 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-a07602a9-5d55-4563-adb9-8b0157467d01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:38:13.782818 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:13.782818 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:13.782818 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:13.782818 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:13.782818 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:13.782818 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:13.782818 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:13.782818 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:13.782818 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:13.782818 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:13.782818 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:13.782818 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:13.782818 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:13.782818 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:13.782818 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:13.784229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:13.784229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:13.784229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:13.784229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:13.784229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:13.784229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:13.784229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:13.784229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:13.784229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:13.784229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:13.784229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:13.784229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:13.784229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:13.784229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:13.784229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:13.784229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:13.785061 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:13.785061 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:13.785061 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:13.785061 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:13.785061 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:13.785061 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:13.785061 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:13.785061 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:13.785061 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:13.785061 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:13.785061 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:38:13.785061 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:38:13.785061 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 12/24] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:38:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:38:13.790075 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd8930-a632-4759-a888-18dda79487e8 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:13.866361 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c761b4-b8c2-4030-be14-6e92423ee20f None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:13.866655 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c761b4-b8c2-4030-be14-6e92423ee20f None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:13.866854 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c761b4-b8c2-4030-be14-6e92423ee20f None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:13.868191 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 13/25] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:38:13.872350 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e015a64-f733-4330-a759-dd70c30eeb15 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:13.872936 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e015a64-f733-4330-a759-dd70c30eeb15 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:13.873449 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e015a64-f733-4330-a759-dd70c30eeb15 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:13.874905 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 14/26] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:38:13.876155 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6c59a-1b6d-485f-bf7f-91a6eb760d10 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:13.876630 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6c59a-1b6d-485f-bf7f-91a6eb760d10 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:13.877116 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6c59a-1b6d-485f-bf7f-91a6eb760d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:13.894650 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:13.917614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-47a6c59a-1b6d-485f-bf7f-91a6eb760d10 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:13.922680 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-47a6c59a-1b6d-485f-bf7f-91a6eb760d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:13.949412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd8930-a632-4759-a888-18dda79487e8 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:13.999251 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af9492-2561-4683-b27e-7d02a3b790ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:14.001564 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af9492-2561-4683-b27e-7d02a3b790ef None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:14.002624 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af9492-2561-4683-b27e-7d02a3b790ef None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:14.003150 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af9492-2561-4683-b27e-7d02a3b790ef None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:14.004551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af9492-2561-4683-b27e-7d02a3b790ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:14.006070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af9492-2561-4683-b27e-7d02a3b790ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:14.007778 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af9492-2561-4683-b27e-7d02a3b790ef None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:14.032853 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 13/27] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:38:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:14.034559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6488f4-b330-47cc-97db-7b606aac90fd None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:14.037785 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6488f4-b330-47cc-97db-7b606aac90fd None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:14.039441 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6488f4-b330-47cc-97db-7b606aac90fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:14.088319 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 15/28] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:14.090019 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6c59a-1b6d-485f-bf7f-91a6eb760d10 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:14.090945 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-4f6488f4-b330-47cc-97db-7b606aac90fd None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:14.092858 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-4f6488f4-b330-47cc-97db-7b606aac90fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:14.204041 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 14/29] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:14.205272 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6488f4-b330-47cc-97db-7b606aac90fd None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:14.233143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6c59a-1b6d-485f-bf7f-91a6eb760d10 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:14.297909 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:14.343433 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6488f4-b330-47cc-97db-7b606aac90fd None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:14.353573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:14.383554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5a941-2c7d-4bfa-b228-ebf6fd3697b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:14.384220 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5a941-2c7d-4bfa-b228-ebf6fd3697b1 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:14.384502 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5a941-2c7d-4bfa-b228-ebf6fd3697b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:14.384777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5a941-2c7d-4bfa-b228-ebf6fd3697b1 None admin] PATH_INFO: `/v3/users/fb4866594bcc4f3fa8cc9d8ea5e9f327` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:14.386516 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5a941-2c7d-4bfa-b228-ebf6fd3697b1 None admin] RBAC: Authorizing `identity:get_user(user_id=fb4866594bcc4f3fa8cc9d8ea5e9f327)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:14.388014 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e5a941-2c7d-4bfa-b228-ebf6fd3697b1 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:14.392295 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8bc727-2961-4b22-ab2f-95b6a1919d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:14.393229 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bc727-2961-4b22-ab2f-95b6a1919d4f None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:14.393700 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bc727-2961-4b22-ab2f-95b6a1919d4f None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:14.394210 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 16/30] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:14 2022] GET /identity/v3/users/fb4866594bcc4f3fa8cc9d8ea5e9f327 => generated 247 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:14.394400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bc727-2961-4b22-ab2f-95b6a1919d4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:14.395567 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2650d26-1b47-46e3-bc9c-e9c71023c346 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:14.395855 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2650d26-1b47-46e3-bc9c-e9c71023c346 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:14.396132 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2650d26-1b47-46e3-bc9c-e9c71023c346 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:14.397436 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 17/31] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:14.403570 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2650d26-1b47-46e3-bc9c-e9c71023c346 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:14.410026 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8bc727-2961-4b22-ab2f-95b6a1919d4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:14.412797 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8bc727-2961-4b22-ab2f-95b6a1919d4f None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:14.446928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-dc8bc727-2961-4b22-ab2f-95b6a1919d4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:38:14.446928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:14.446928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:14.446928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:14.446928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:14.446928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:14.446928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:14.446928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:14.446928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:14.446928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:14.446928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:14.446928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:14.446928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:38:14.446928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:38:14.446928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:38:14.448393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:38:14.448393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:14.448393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:14.448393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:14.448393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:14.448393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:14.448393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:14.448393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:14.448393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:14.448393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:14.448393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:14.448393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:14.448393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:14.448393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:14.448393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:14.448393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:14.448393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:14.449195 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:38:14.449195 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:38:14.449195 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:38:14.449195 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:38:14.451480 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 15/32] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:38:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:38:14.454167 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8bc727-2961-4b22-ab2f-95b6a1919d4f None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:14.519299 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2650d26-1b47-46e3-bc9c-e9c71023c346 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:14.556919 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961c88d-926a-4f81-b60f-be14cd3b5b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:14.557321 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961c88d-926a-4f81-b60f-be14cd3b5b26 None admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:14.557568 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961c88d-926a-4f81-b60f-be14cd3b5b26 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:14.557846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d961c88d-926a-4f81-b60f-be14cd3b5b26 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:14.558600 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961c88d-926a-4f81-b60f-be14cd3b5b26 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:14.560371 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d961c88d-926a-4f81-b60f-be14cd3b5b26 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:14.585744 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8bc727-2961-4b22-ab2f-95b6a1919d4f None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:14.604194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:14.623796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a7637-95a5-4e59-9f2b-b173d44a4e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:14.624826 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a7637-95a5-4e59-9f2b-b173d44a4e8d None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:14.625331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a7637-95a5-4e59-9f2b-b173d44a4e8d None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:14.625799 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a7637-95a5-4e59-9f2b-b173d44a4e8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:14.627225 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a7637-95a5-4e59-9f2b-b173d44a4e8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:14.628937 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a7637-95a5-4e59-9f2b-b173d44a4e8d None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:14.630860 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 16/33] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:38:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:14.632286 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabae3f-6b31-4e27-a51e-9ba7830b7599 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:14.632787 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabae3f-6b31-4e27-a51e-9ba7830b7599 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:14.633271 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabae3f-6b31-4e27-a51e-9ba7830b7599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:14.652523 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-ebabae3f-6b31-4e27-a51e-9ba7830b7599 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:14.654329 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-ebabae3f-6b31-4e27-a51e-9ba7830b7599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:14.707376 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 18/34] 10.222.0.39 () {60 vars in 1131 bytes} [Tue Jul 26 04:38:14 2022] POST /identity/v3/roles => generated 219 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:38:14.708463 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961c88d-926a-4f81-b60f-be14cd3b5b26 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:14.726862 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 17/35] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:14.728035 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabae3f-6b31-4e27-a51e-9ba7830b7599 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:14.767929 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:14.837371 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabae3f-6b31-4e27-a51e-9ba7830b7599 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:14.855733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d961c88d-926a-4f81-b60f-be14cd3b5b26 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:14.857265 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:14.877482 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b721d09-473c-4724-a855-517108bc1f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:14.878581 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b721d09-473c-4724-a855-517108bc1f06 None admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:14.879060 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b721d09-473c-4724-a855-517108bc1f06 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:14.879556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b721d09-473c-4724-a855-517108bc1f06 None admin] PATH_INFO: `/v3/domains/default/users/fb4866594bcc4f3fa8cc9d8ea5e9f327/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:14.881822 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b721d09-473c-4724-a855-517108bc1f06 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=fb4866594bcc4f3fa8cc9d8ea5e9f327, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:14.883574 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b721d09-473c-4724-a855-517108bc1f06 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:14.899124 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f854788-2ea9-4db4-8664-cf2169e5a849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:14.899957 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f854788-2ea9-4db4-8664-cf2169e5a849 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:14.900179 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f854788-2ea9-4db4-8664-cf2169e5a849 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:14.900472 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f854788-2ea9-4db4-8664-cf2169e5a849 None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:14.901466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f854788-2ea9-4db4-8664-cf2169e5a849 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:14.901780 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f854788-2ea9-4db4-8664-cf2169e5a849 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:14.903762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f854788-2ea9-4db4-8664-cf2169e5a849 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:14.917460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 19/36] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:14.918577 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f854788-2ea9-4db4-8664-cf2169e5a849 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:15.014735 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 18/37] 10.222.0.39 () {58 vars in 1361 bytes} [Tue Jul 26 04:38:14 2022] PUT /identity/v3/domains/default/users/fb4866594bcc4f3fa8cc9d8ea5e9f327/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:38:15.016402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b721d09-473c-4724-a855-517108bc1f06 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:15.033356 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:15.044815 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f854788-2ea9-4db4-8664-cf2169e5a849 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:15.093564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a7a61-d533-46d7-afb2-e9c195865126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:15.094268 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a7a61-d533-46d7-afb2-e9c195865126 None admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:15.094548 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a7a61-d533-46d7-afb2-e9c195865126 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:15.094823 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a7a61-d533-46d7-afb2-e9c195865126 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:15.095572 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a7a61-d533-46d7-afb2-e9c195865126 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:15.097034 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a7a61-d533-46d7-afb2-e9c195865126 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:15.122213 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 20/38] 10.222.0.39 () {60 vars in 1131 bytes} [Tue Jul 26 04:38:14 2022] POST /identity/v3/roles => generated 225 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:38:15.124690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a8216-d139-4a1d-b2cb-1938df5e66d8 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:15.125294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a8216-d139-4a1d-b2cb-1938df5e66d8 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:15.125743 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a8216-d139-4a1d-b2cb-1938df5e66d8 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:15.132269 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 21/39] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:15.135216 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc290de6-73c3-4d88-a5e1-3b9a2d71cdaa None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:15.135738 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc290de6-73c3-4d88-a5e1-3b9a2d71cdaa None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:15.136185 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc290de6-73c3-4d88-a5e1-3b9a2d71cdaa None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:15.139159 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 22/40] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:15.144881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8462d04-4145-4fd5-8a05-b15c0a312098 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:15.144881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8462d04-4145-4fd5-8a05-b15c0a312098 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:15.144881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8462d04-4145-4fd5-8a05-b15c0a312098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:15.156211 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b721d09-473c-4724-a855-517108bc1f06 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:15.165666 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-f8462d04-4145-4fd5-8a05-b15c0a312098 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:15.167813 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-f8462d04-4145-4fd5-8a05-b15c0a312098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:15.206832 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec012b-1efc-46b8-8631-9e6e70166274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:15.207498 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec012b-1efc-46b8-8631-9e6e70166274 None admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:15.207784 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec012b-1efc-46b8-8631-9e6e70166274 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:15.208061 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec012b-1efc-46b8-8631-9e6e70166274 None admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:15.208866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec012b-1efc-46b8-8631-9e6e70166274 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:15.211060 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec012b-1efc-46b8-8631-9e6e70166274 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:15.262253 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 19/41] 10.222.0.39 () {60 vars in 1141 bytes} [Tue Jul 26 04:38:15 2022] POST /identity/v3/projects => generated 301 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:38:15.268123 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b01dd-7822-46c6-8569-99458e941a47 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:15.268123 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b01dd-7822-46c6-8569-99458e941a47 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:15.268123 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b01dd-7822-46c6-8569-99458e941a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:15.268777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 23/42] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:15.290890 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-949b01dd-7822-46c6-8569-99458e941a47 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:15.292661 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-949b01dd-7822-46c6-8569-99458e941a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:15.313814 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8462d04-4145-4fd5-8a05-b15c0a312098 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:15.326719 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:15.402365 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 20/43] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:15.425716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b01dd-7822-46c6-8569-99458e941a47 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:15.428892 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:15.449686 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8462d04-4145-4fd5-8a05-b15c0a312098 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:15.492434 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aef717-90cf-46ad-86a3-e400f41ba257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:15.493449 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aef717-90cf-46ad-86a3-e400f41ba257 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:15.493731 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aef717-90cf-46ad-86a3-e400f41ba257 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:15.495062 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aef717-90cf-46ad-86a3-e400f41ba257 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:15.496041 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aef717-90cf-46ad-86a3-e400f41ba257 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:15.497407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aef717-90cf-46ad-86a3-e400f41ba257 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:15.499555 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 24/44] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:38:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:38:15.505013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aef717-90cf-46ad-86a3-e400f41ba257 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:15.566407 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b01dd-7822-46c6-8569-99458e941a47 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:15.613187 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a31c92-7040-4425-9b80-dc2b21cfd619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:15.613828 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a31c92-7040-4425-9b80-dc2b21cfd619 None admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:15.614210 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a31c92-7040-4425-9b80-dc2b21cfd619 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:15.614489 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a31c92-7040-4425-9b80-dc2b21cfd619 None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:15.615230 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a31c92-7040-4425-9b80-dc2b21cfd619 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:15.616660 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a31c92-7040-4425-9b80-dc2b21cfd619 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:15.631229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aef717-90cf-46ad-86a3-e400f41ba257 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:15.633406 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 21/45] 10.222.0.39 () {60 vars in 1131 bytes} [Tue Jul 26 04:38:15 2022] POST /identity/v3/roles => generated 223 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:38:15.672680 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f1d48-8427-40ac-8c1c-fce7b6d1a909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:15.673377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f1d48-8427-40ac-8c1c-fce7b6d1a909 None admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:15.673657 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f1d48-8427-40ac-8c1c-fce7b6d1a909 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:15.673926 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f1d48-8427-40ac-8c1c-fce7b6d1a909 None admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:15.674724 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f1d48-8427-40ac-8c1c-fce7b6d1a909 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:15.676273 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f1d48-8427-40ac-8c1c-fce7b6d1a909 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:15.711856 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 25/46] 10.222.0.39 () {60 vars in 1141 bytes} [Tue Jul 26 04:38:15 2022] POST /identity/v3/projects => generated 312 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:38:17.108260 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd4d62-a3ee-486e-aa96-77ae6259bc74 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:17.108802 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd4d62-a3ee-486e-aa96-77ae6259bc74 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:17.108802 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd4d62-a3ee-486e-aa96-77ae6259bc74 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:17.110212 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 22/47] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:17.115933 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100b798-53d2-44bd-a3a1-75a7be2cbfd8 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:17.116373 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100b798-53d2-44bd-a3a1-75a7be2cbfd8 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:17.116520 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100b798-53d2-44bd-a3a1-75a7be2cbfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:17.125269 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:17.137797 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-b100b798-53d2-44bd-a3a1-75a7be2cbfd8 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:17.139073 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-b100b798-53d2-44bd-a3a1-75a7be2cbfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:17.215363 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 26/48] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:17.238150 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd4d62-a3ee-486e-aa96-77ae6259bc74 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:17.259525 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:17.352516 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd4d62-a3ee-486e-aa96-77ae6259bc74 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:17.390131 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b10366-64c1-497b-836b-c535a269bf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:17.390721 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b10366-64c1-497b-836b-c535a269bf0a None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:17.391001 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b10366-64c1-497b-836b-c535a269bf0a None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:17.391271 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b10366-64c1-497b-836b-c535a269bf0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:17.402637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b10366-64c1-497b-836b-c535a269bf0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:17.407626 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-36b10366-64c1-497b-836b-c535a269bf0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:38:17.407626 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:17.407626 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:17.407626 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:17.407626 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:17.407626 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:17.407626 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:17.407626 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:17.407626 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:17.407626 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:17.407626 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:17.407626 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:17.407626 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:17.407626 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:17.407626 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:17.407626 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:17.408536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:17.408536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:17.408536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:17.408536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:17.408536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:17.408536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:17.408536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:17.408536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:17.408536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:17.408536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:17.408536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:17.408536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:17.408536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:17.408536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:17.408536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:17.408536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:17.409426 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:17.409426 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:17.409426 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:17.409426 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:17.409426 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:17.409426 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:17.409426 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:17.409426 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:17.409426 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:17.409426 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:17.409426 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:38:17.409426 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:38:17.409426 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 23/49] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:38:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:38:17.414905 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100b798-53d2-44bd-a3a1-75a7be2cbfd8 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:17.521283 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100b798-53d2-44bd-a3a1-75a7be2cbfd8 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:17.558619 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d66cbb-c014-4fb9-899f-4dcb8e36bca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:17.559230 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d66cbb-c014-4fb9-899f-4dcb8e36bca9 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:17.559515 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d66cbb-c014-4fb9-899f-4dcb8e36bca9 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:17.559786 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d66cbb-c014-4fb9-899f-4dcb8e36bca9 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:17.560512 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d66cbb-c014-4fb9-899f-4dcb8e36bca9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:17.560818 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d66cbb-c014-4fb9-899f-4dcb8e36bca9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:17.562252 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d66cbb-c014-4fb9-899f-4dcb8e36bca9 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:17.563936 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:17.574826 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 27/50] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:38:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:17.580937 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b10366-64c1-497b-836b-c535a269bf0a None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:17.668967 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:17.692999 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b10366-64c1-497b-836b-c535a269bf0a None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:17.728057 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf93f6-134f-4cab-97f3-50998bb64307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:17.728753 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf93f6-134f-4cab-97f3-50998bb64307 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:17.729037 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf93f6-134f-4cab-97f3-50998bb64307 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:17.729309 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf93f6-134f-4cab-97f3-50998bb64307 None admin] PATH_INFO: `/v3/users/fb4866594bcc4f3fa8cc9d8ea5e9f327` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:17.730543 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf93f6-134f-4cab-97f3-50998bb64307 None admin] RBAC: Authorizing `identity:get_user(user_id=fb4866594bcc4f3fa8cc9d8ea5e9f327)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:17.732037 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf93f6-134f-4cab-97f3-50998bb64307 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:17.733659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 24/51] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:17 2022] GET /identity/v3/users/fb4866594bcc4f3fa8cc9d8ea5e9f327 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:17.735667 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b628ead-2e86-4887-a97a-fc32662ec165 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:17.735950 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b628ead-2e86-4887-a97a-fc32662ec165 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:17.736225 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b628ead-2e86-4887-a97a-fc32662ec165 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:17.737552 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 28/52] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:17.739339 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf93f6-134f-4cab-97f3-50998bb64307 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:17.742602 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a010c-9387-4afa-ae5a-50e499b781d8 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:17.742886 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a010c-9387-4afa-ae5a-50e499b781d8 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:17.743163 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83a010c-9387-4afa-ae5a-50e499b781d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:17.761356 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-f83a010c-9387-4afa-ae5a-50e499b781d8 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:17.762600 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-f83a010c-9387-4afa-ae5a-50e499b781d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:17.836236 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 29/53] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 04:38:17.842245 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf93f6-134f-4cab-97f3-50998bb64307 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:17.859084 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a010c-9387-4afa-ae5a-50e499b781d8 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:17.878524 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a85d6c-9e69-411c-8eab-e2ce073dba3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:17.879189 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a85d6c-9e69-411c-8eab-e2ce073dba3f None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:17.879471 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a85d6c-9e69-411c-8eab-e2ce073dba3f None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:17.879745 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a85d6c-9e69-411c-8eab-e2ce073dba3f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:17.880950 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a85d6c-9e69-411c-8eab-e2ce073dba3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:17.882467 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a85d6c-9e69-411c-8eab-e2ce073dba3f None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:17.884083 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 25/54] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:38:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:17.889927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a85d6c-9e69-411c-8eab-e2ce073dba3f None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:17.906293 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:17.959580 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83a010c-9387-4afa-ae5a-50e499b781d8 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:17.988687 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:17.992625 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a85d6c-9e69-411c-8eab-e2ce073dba3f None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:17.998018 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72757f-9043-4463-846b-98131e388500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:17.998679 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72757f-9043-4463-846b-98131e388500 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:17.998962 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72757f-9043-4463-846b-98131e388500 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:17.999235 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72757f-9043-4463-846b-98131e388500 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:18.000414 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72757f-9043-4463-846b-98131e388500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:18.001880 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72757f-9043-4463-846b-98131e388500 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:18.003549 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 30/55] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:38:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:38:18.009485 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72757f-9043-4463-846b-98131e388500 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:18.026558 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46803442-a79a-4982-bc5c-81fe82068bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:18.027186 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46803442-a79a-4982-bc5c-81fe82068bf7 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:18.027464 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46803442-a79a-4982-bc5c-81fe82068bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:18.027732 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46803442-a79a-4982-bc5c-81fe82068bf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:18.028524 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46803442-a79a-4982-bc5c-81fe82068bf7 None admin] RBAC: Adding query filter params (role.id=2bfdd65b06554a6da967b3939da753c7, scope.domain.id=default, user.id=fb4866594bcc4f3fa8cc9d8ea5e9f327) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:18.028829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46803442-a79a-4982-bc5c-81fe82068bf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:18.030314 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46803442-a79a-4982-bc5c-81fe82068bf7 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:18.036161 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 26/56] 10.222.0.39 () {56 vars in 1322 bytes} [Tue Jul 26 04:38:17 2022] GET /identity/v3/role_assignments?user.id=fb4866594bcc4f3fa8cc9d8ea5e9f327&scope.domain.id=default&role.id=2bfdd65b06554a6da967b3939da753c7 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:38:18.120759 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72757f-9043-4463-846b-98131e388500 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:18.159310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb61ad9-274f-451f-941f-5724f667acb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:18.159952 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb61ad9-274f-451f-941f-5724f667acb5 None admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:18.160224 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb61ad9-274f-451f-941f-5724f667acb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:18.160511 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb61ad9-274f-451f-941f-5724f667acb5 None admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:18.161211 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb61ad9-274f-451f-941f-5724f667acb5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:18.162766 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb61ad9-274f-451f-941f-5724f667acb5 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:18.192596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 31/57] 10.222.0.39 () {60 vars in 1140 bytes} [Tue Jul 26 04:38:18 2022] POST /identity/v3/projects => generated 298 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:38:20.174164 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa63034-b77b-4d44-a9c5-3959829831cd None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:20.174719 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa63034-b77b-4d44-a9c5-3959829831cd None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:20.174719 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa63034-b77b-4d44-a9c5-3959829831cd None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:20.176078 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 27/58] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:20.181611 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073a968-7e04-4ac4-b056-a3d81bdad99a None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:20.182049 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073a968-7e04-4ac4-b056-a3d81bdad99a None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:20.182173 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e073a968-7e04-4ac4-b056-a3d81bdad99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:20.201399 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-e073a968-7e04-4ac4-b056-a3d81bdad99a None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:20.202662 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-e073a968-7e04-4ac4-b056-a3d81bdad99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:20.249725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:20.277515 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 32/59] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:20.301869 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa63034-b77b-4d44-a9c5-3959829831cd None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:20.387344 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:20.411547 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa63034-b77b-4d44-a9c5-3959829831cd None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:20.447316 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51ca18-c5fa-4939-b3cf-9d7f266eb633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:20.447970 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51ca18-c5fa-4939-b3cf-9d7f266eb633 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:20.448247 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51ca18-c5fa-4939-b3cf-9d7f266eb633 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:20.448541 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51ca18-c5fa-4939-b3cf-9d7f266eb633 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:20.449716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51ca18-c5fa-4939-b3cf-9d7f266eb633 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:20.451228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51ca18-c5fa-4939-b3cf-9d7f266eb633 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:20.453184 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 28/60] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:38:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:20.459300 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073a968-7e04-4ac4-b056-a3d81bdad99a None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:20.564422 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e073a968-7e04-4ac4-b056-a3d81bdad99a None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:20.600097 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826add64-88e8-4232-a873-868d54837383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:20.600722 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826add64-88e8-4232-a873-868d54837383 None admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:20.601007 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826add64-88e8-4232-a873-868d54837383 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:20.601282 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826add64-88e8-4232-a873-868d54837383 None admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:20.602012 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826add64-88e8-4232-a873-868d54837383 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:20.603506 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826add64-88e8-4232-a873-868d54837383 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:20.631437 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 33/61] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 04:38:20 2022] POST /identity/v3/users => generated 275 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:38:23.729933 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22c283-8b1d-4d8e-85c9-9772ec1236ca None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:23.731011 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22c283-8b1d-4d8e-85c9-9772ec1236ca None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:23.731486 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22c283-8b1d-4d8e-85c9-9772ec1236ca None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:23.733078 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 29/62] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:23.738663 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a22b9-89f3-438a-9cb8-7239869eb163 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:23.739487 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a22b9-89f3-438a-9cb8-7239869eb163 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:23.739976 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a22b9-89f3-438a-9cb8-7239869eb163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:23.766034 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-2e7a22b9-89f3-438a-9cb8-7239869eb163 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:23.766034 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-2e7a22b9-89f3-438a-9cb8-7239869eb163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:23.791965 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:23.850002 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec30fa3-c097-4a8c-9dd8-5d8213975275 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:23.850673 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec30fa3-c097-4a8c-9dd8-5d8213975275 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:23.851141 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec30fa3-c097-4a8c-9dd8-5d8213975275 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:23.852729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 30/63] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:38:23.858374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e0d1c-cf3a-4a7a-9c0e-b7a9c81f5b57 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:23.858892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e0d1c-cf3a-4a7a-9c0e-b7a9c81f5b57 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:23.859358 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e0d1c-cf3a-4a7a-9c0e-b7a9c81f5b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:23.864587 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 34/64] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:23.876872 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985ba0c-49ea-49e0-9687-aaa640520c8f None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:23.877471 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985ba0c-49ea-49e0-9687-aaa640520c8f None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:23.877952 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985ba0c-49ea-49e0-9687-aaa640520c8f None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:23.879505 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 35/65] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:38:23.885438 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674e291-96e4-4d9d-8125-4daab65e11ec None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:23.885957 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674e291-96e4-4d9d-8125-4daab65e11ec None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:23.886076 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-790e0d1c-cf3a-4a7a-9c0e-b7a9c81f5b57 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:23.886567 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674e291-96e4-4d9d-8125-4daab65e11ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:23.887292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-790e0d1c-cf3a-4a7a-9c0e-b7a9c81f5b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:23.911598 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-3674e291-96e4-4d9d-8125-4daab65e11ec None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:23.912812 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-3674e291-96e4-4d9d-8125-4daab65e11ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:23.971493 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 31/66] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 04:38:23.973193 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e0d1c-cf3a-4a7a-9c0e-b7a9c81f5b57 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:23.988935 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 36/67] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 04:38:24.013304 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674e291-96e4-4d9d-8125-4daab65e11ec None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:24.085752 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:24.117471 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e0d1c-cf3a-4a7a-9c0e-b7a9c81f5b57 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:24.142392 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:24.162262 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15958417-4183-4a5b-a903-63704eca2f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:24.163183 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15958417-4183-4a5b-a903-63704eca2f85 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:24.163638 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15958417-4183-4a5b-a903-63704eca2f85 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:24.164057 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15958417-4183-4a5b-a903-63704eca2f85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:24.165682 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674e291-96e4-4d9d-8125-4daab65e11ec None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:24.177546 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15958417-4183-4a5b-a903-63704eca2f85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:24.182400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-15958417-4183-4a5b-a903-63704eca2f85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:38:24.182400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:24.182400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:24.182400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:24.182400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:24.182400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:24.182400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:24.182400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:24.182400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:24.182400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:24.182400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:24.182400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:24.182400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:24.182400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:24.182400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:24.182400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:24.183360 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:24.183360 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:24.183360 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:24.183360 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:24.183360 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:24.183360 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:24.183360 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:24.183360 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:24.183360 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:24.183360 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:24.183360 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:24.183360 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:24.183360 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:24.183360 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:24.183360 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:24.183360 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:24.184148 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:24.184148 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:24.184148 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:24.184148 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:24.184148 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:24.184148 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:24.184148 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:24.184148 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:24.184148 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:24.184148 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:24.184148 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:38:24.184148 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:38:24.192875 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 32/68] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:38:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:38:24.192875 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15958417-4183-4a5b-a903-63704eca2f85 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:24.218693 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232cc5d-7b3e-4a61-a7ab-8f931d0a8f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:24.219376 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232cc5d-7b3e-4a61-a7ab-8f931d0a8f69 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:24.219749 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232cc5d-7b3e-4a61-a7ab-8f931d0a8f69 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:24.220028 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232cc5d-7b3e-4a61-a7ab-8f931d0a8f69 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:24.232134 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232cc5d-7b3e-4a61-a7ab-8f931d0a8f69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:24.237513 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-6232cc5d-7b3e-4a61-a7ab-8f931d0a8f69 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 04:38:24.237513 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:24.237513 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:24.237513 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:24.237513 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:24.237513 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:24.237513 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:24.237513 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:24.237513 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:24.237513 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:24.237513 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:24.237513 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:24.237513 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:24.237513 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:24.237513 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:24.237513 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:24.238677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:24.238677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:24.238677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:24.238677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:24.238677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:24.238677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:24.238677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:24.238677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:24.238677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:24.238677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:24.238677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:24.238677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:24.238677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:24.238677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:24.238677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:24.238677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:24.239508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:24.239508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:24.239508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:24.239508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:24.239508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:24.239508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:24.239508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:24.239508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:24.239508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:24.239508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:24.239508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 04:38:24.239508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:38:24.239508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 37/69] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 04:38:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:38:24.242540 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac95eb-def6-4632-b812-602ad4c6264e None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:24.243116 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac95eb-def6-4632-b812-602ad4c6264e None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:24.243740 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac95eb-def6-4632-b812-602ad4c6264e None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:24.245350 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 38/70] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:24.246327 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac95eb-def6-4632-b812-602ad4c6264e None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:24.324659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15958417-4183-4a5b-a903-63704eca2f85 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:24.363649 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0c903-5e19-49e4-8897-f249277efe57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:24.364307 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0c903-5e19-49e4-8897-f249277efe57 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:24.364589 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0c903-5e19-49e4-8897-f249277efe57 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:24.364862 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0c903-5e19-49e4-8897-f249277efe57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:24.367863 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:24.377531 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac95eb-def6-4632-b812-602ad4c6264e None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:24.379656 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d0c903-5e19-49e4-8897-f249277efe57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:24.384849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-79d0c903-5e19-49e4-8897-f249277efe57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:38:24.384849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:24.384849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:24.384849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:24.384849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:24.384849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:24.384849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:24.384849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:24.384849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:24.384849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:24.384849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:24.384849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:24.384849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:24.384849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:24.384849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:24.384849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:24.385756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:24.385756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:24.385756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:24.385756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:24.385756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:24.385756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:24.385756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:24.385756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:24.385756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:24.385756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:24.385756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:24.385756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:24.385756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:24.385756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:24.385756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:24.385756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:24.386592 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:24.386592 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:24.386592 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:24.386592 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:24.386592 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:24.386592 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:24.386592 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:24.386592 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:24.386592 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:24.386592 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:24.386592 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:38:24.386592 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:38:24.386592 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 33/71] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:38:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:38:24.388319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0c903-5e19-49e4-8897-f249277efe57 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:24.425806 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60f249-96bd-4d64-8038-54bede5b13ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:24.426475 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60f249-96bd-4d64-8038-54bede5b13ef None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:24.426750 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60f249-96bd-4d64-8038-54bede5b13ef None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:24.427021 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60f249-96bd-4d64-8038-54bede5b13ef None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:24.428149 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60f249-96bd-4d64-8038-54bede5b13ef None admin] RBAC: Adding query filter params (name=member) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:24.428149 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60f249-96bd-4d64-8038-54bede5b13ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:24.429548 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60f249-96bd-4d64-8038-54bede5b13ef None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:24.439525 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 39/72] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 04:38:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:24.441102 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74171308-c264-4e40-bed2-b021d063b5db None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:24.442021 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74171308-c264-4e40-bed2-b021d063b5db None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:24.442504 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74171308-c264-4e40-bed2-b021d063b5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:24.465818 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-74171308-c264-4e40-bed2-b021d063b5db None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:24.467104 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-74171308-c264-4e40-bed2-b021d063b5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:24.478196 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:24.494527 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0c903-5e19-49e4-8897-f249277efe57 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:24.532023 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de129a5-49bb-4d85-bf37-f80c2f427904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:24.532646 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de129a5-49bb-4d85-bf37-f80c2f427904 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:24.532929 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de129a5-49bb-4d85-bf37-f80c2f427904 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:24.533190 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de129a5-49bb-4d85-bf37-f80c2f427904 None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:24.533914 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de129a5-49bb-4d85-bf37-f80c2f427904 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:24.534253 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de129a5-49bb-4d85-bf37-f80c2f427904 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:24.535694 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de129a5-49bb-4d85-bf37-f80c2f427904 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:24.538606 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 40/73] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:24.542946 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74171308-c264-4e40-bed2-b021d063b5db None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:24.548774 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 34/74] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:38:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:24.548774 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de129a5-49bb-4d85-bf37-f80c2f427904 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:24.604145 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:24.647232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de129a5-49bb-4d85-bf37-f80c2f427904 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:24.650888 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74171308-c264-4e40-bed2-b021d063b5db None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:24.681239 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab508d3-014f-4ed3-8023-d7043fae9e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:24.681898 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab508d3-014f-4ed3-8023-d7043fae9e9c None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:24.682230 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab508d3-014f-4ed3-8023-d7043fae9e9c None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:24.682488 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab508d3-014f-4ed3-8023-d7043fae9e9c None admin] PATH_INFO: `/v3/users/70a3f2a158524f4eb65391e71dffc61b` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:24.686617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e492d9-dd6f-4ed0-8615-aa7d5d61afe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:24.687264 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e492d9-dd6f-4ed0-8615-aa7d5d61afe8 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:24.687540 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e492d9-dd6f-4ed0-8615-aa7d5d61afe8 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:24.687817 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e492d9-dd6f-4ed0-8615-aa7d5d61afe8 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:24.688544 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e492d9-dd6f-4ed0-8615-aa7d5d61afe8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:24.688854 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e492d9-dd6f-4ed0-8615-aa7d5d61afe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:24.690305 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e492d9-dd6f-4ed0-8615-aa7d5d61afe8 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:24.696584 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab508d3-014f-4ed3-8023-d7043fae9e9c None admin] RBAC: Authorizing `identity:get_user(user_id=70a3f2a158524f4eb65391e71dffc61b)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:24.698188 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab508d3-014f-4ed3-8023-d7043fae9e9c None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:24.699018 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 41/75] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:38:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:24.700428 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b747a46-38a0-4f41-8b04-2b546f1933cc None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:24.700721 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b747a46-38a0-4f41-8b04-2b546f1933cc None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:24.700996 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b747a46-38a0-4f41-8b04-2b546f1933cc None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:24.701141 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 35/76] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:24 2022] GET /identity/v3/users/70a3f2a158524f4eb65391e71dffc61b => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:24.701934 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab508d3-014f-4ed3-8023-d7043fae9e9c None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:24.702685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 42/77] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:24.703318 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b747a46-38a0-4f41-8b04-2b546f1933cc None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:24.712410 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:24.809822 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab508d3-014f-4ed3-8023-d7043fae9e9c None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:24.813083 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b747a46-38a0-4f41-8b04-2b546f1933cc None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:24.828049 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:24.849769 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05723e9f-2feb-45b7-895f-401a42a51056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:24.850175 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b4365-eadb-4151-b001-c8bacc9b9bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:24.850518 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05723e9f-2feb-45b7-895f-401a42a51056 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:24.850802 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05723e9f-2feb-45b7-895f-401a42a51056 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:24.850914 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b4365-eadb-4151-b001-c8bacc9b9bfd None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:24.851079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05723e9f-2feb-45b7-895f-401a42a51056 None admin] PATH_INFO: `/v3/users/70a3f2a158524f4eb65391e71dffc61b` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:24.851168 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b4365-eadb-4151-b001-c8bacc9b9bfd None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:24.851356 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164b4365-eadb-4151-b001-c8bacc9b9bfd None admin] PATH_INFO: `/v3/roles/member` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:24.852401 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05723e9f-2feb-45b7-895f-401a42a51056 None admin] RBAC: Authorizing `identity:get_user(user_id=70a3f2a158524f4eb65391e71dffc61b)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:24.854079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05723e9f-2feb-45b7-895f-401a42a51056 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:24.855777 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 36/78] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:24 2022] GET /identity/v3/users/70a3f2a158524f4eb65391e71dffc61b => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:24.855777 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05723e9f-2feb-45b7-895f-401a42a51056 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:24.862929 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164b4365-eadb-4151-b001-c8bacc9b9bfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:24.868357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-164b4365-eadb-4151-b001-c8bacc9b9bfd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:38:24.868357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:24.868357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:24.868357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:24.868357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:24.868357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:24.868357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:24.868357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:24.868357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:24.868357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:24.868357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:24.868357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:24.868357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:24.868357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:24.868357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:24.868357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:24.869466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:24.869466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:24.869466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:24.869466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:24.869466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:24.869466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:24.869466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:24.869466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:24.869466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:24.869466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:24.869466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:24.869466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:24.869466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:24.869466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:24.869466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:24.869466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:24.870959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:24.870959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:24.870959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:24.870959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:24.870959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:24.870959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:24.870959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:24.870959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:24.870959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:24.870959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:24.870959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:38:24.870959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:38:24.870959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 43/79] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:38:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:38:24.870959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b4365-eadb-4151-b001-c8bacc9b9bfd None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:24.940688 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:24.965311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05723e9f-2feb-45b7-895f-401a42a51056 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:24.979704 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164b4365-eadb-4151-b001-c8bacc9b9bfd None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:25.002655 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460565de-1023-479b-974a-398504f7cf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:25.003324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460565de-1023-479b-974a-398504f7cf53 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:25.003606 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460565de-1023-479b-974a-398504f7cf53 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:25.003880 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460565de-1023-479b-974a-398504f7cf53 None admin] PATH_INFO: `/v3/users/fb4866594bcc4f3fa8cc9d8ea5e9f327` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:25.005107 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460565de-1023-479b-974a-398504f7cf53 None admin] RBAC: Authorizing `identity:get_user(user_id=fb4866594bcc4f3fa8cc9d8ea5e9f327)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:25.006678 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460565de-1023-479b-974a-398504f7cf53 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:25.008360 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 37/80] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:24 2022] GET /identity/v3/users/fb4866594bcc4f3fa8cc9d8ea5e9f327 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:25.013195 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b716ef-e914-4123-8895-ab4add8258e8 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:25.013195 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b716ef-e914-4123-8895-ab4add8258e8 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:25.013195 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b716ef-e914-4123-8895-ab4add8258e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:25.017267 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d8581-fd79-468d-b155-cf01a8cbcbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:25.017903 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d8581-fd79-468d-b155-cf01a8cbcbc9 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:25.018220 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d8581-fd79-468d-b155-cf01a8cbcbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:25.018498 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d8581-fd79-468d-b155-cf01a8cbcbc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:25.029942 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-d8b716ef-e914-4123-8895-ab4add8258e8 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:25.031221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-d8b716ef-e914-4123-8895-ab4add8258e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:25.088500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:25.106878 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d8581-fd79-468d-b155-cf01a8cbcbc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:25.108382 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d8581-fd79-468d-b155-cf01a8cbcbc9 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:25.110859 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 38/81] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:25.111769 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b716ef-e914-4123-8895-ab4add8258e8 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:25.177972 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:25.214874 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b716ef-e914-4123-8895-ab4add8258e8 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:25.215043 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 44/82] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:38:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:25.218845 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d8581-fd79-468d-b155-cf01a8cbcbc9 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:25.249493 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca28e6-17e8-4281-900b-54ce43601b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:25.250158 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca28e6-17e8-4281-900b-54ce43601b51 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:25.250439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca28e6-17e8-4281-900b-54ce43601b51 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:25.250734 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca28e6-17e8-4281-900b-54ce43601b51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:25.300405 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:25.316412 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d8581-fd79-468d-b155-cf01a8cbcbc9 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:25.319327 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca28e6-17e8-4281-900b-54ce43601b51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:25.320839 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca28e6-17e8-4281-900b-54ce43601b51 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:25.351376 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f1a23-085b-45ab-b026-33a63d0082fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:25.351952 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f1a23-085b-45ab-b026-33a63d0082fb None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:25.352226 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f1a23-085b-45ab-b026-33a63d0082fb None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:25.352502 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f1a23-085b-45ab-b026-33a63d0082fb None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:25.353315 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f1a23-085b-45ab-b026-33a63d0082fb None admin] RBAC: Adding query filter params (name=member) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:25.353619 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f1a23-085b-45ab-b026-33a63d0082fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:25.355062 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f1a23-085b-45ab-b026-33a63d0082fb None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:25.363174 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 45/83] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 04:38:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:25.363976 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f1a23-085b-45ab-b026-33a63d0082fb None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:25.391660 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:25.421183 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 39/84] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:38:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:25.422558 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca28e6-17e8-4281-900b-54ce43601b51 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:25.468166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f1a23-085b-45ab-b026-33a63d0082fb None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:25.502006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c52d3-ac48-4b89-8369-651fed65ec30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:25.502667 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c52d3-ac48-4b89-8369-651fed65ec30 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:25.502924 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c52d3-ac48-4b89-8369-651fed65ec30 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:25.503196 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c52d3-ac48-4b89-8369-651fed65ec30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:25.506431 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:25.525102 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca28e6-17e8-4281-900b-54ce43601b51 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:25.557895 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a8cd8-51e1-4b73-b190-3933412023bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:25.558574 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a8cd8-51e1-4b73-b190-3933412023bd None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:25.558851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a8cd8-51e1-4b73-b190-3933412023bd None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:25.559131 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a8cd8-51e1-4b73-b190-3933412023bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:25.560306 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a8cd8-51e1-4b73-b190-3933412023bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:25.561779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a8cd8-51e1-4b73-b190-3933412023bd None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:25.563437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 40/85] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:38:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:25.564200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a8cd8-51e1-4b73-b190-3933412023bd None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:25.570593 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c52d3-ac48-4b89-8369-651fed65ec30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:25.572204 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758c52d3-ac48-4b89-8369-651fed65ec30 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:25.602328 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:25.667342 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a8cd8-51e1-4b73-b190-3933412023bd None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:25.677034 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 46/86] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:38:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:25.682146 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c52d3-ac48-4b89-8369-651fed65ec30 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:25.701739 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0716b3-7981-4982-b161-e5d674531953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:25.702796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0716b3-7981-4982-b161-e5d674531953 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:25.703076 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0716b3-7981-4982-b161-e5d674531953 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:25.703350 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0716b3-7981-4982-b161-e5d674531953 None admin] PATH_INFO: `/v3/projects/bb5564ea35cb4871823a95b50fd471c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:25.704524 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0716b3-7981-4982-b161-e5d674531953 None admin] RBAC: Authorizing `identity:get_project(project_id=bb5564ea35cb4871823a95b50fd471c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:25.706047 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0716b3-7981-4982-b161-e5d674531953 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:25.707762 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 41/87] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:38:25 2022] GET /identity/v3/projects/bb5564ea35cb4871823a95b50fd471c7 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:25.708533 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0716b3-7981-4982-b161-e5d674531953 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:25.728954 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:25.783485 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c52d3-ac48-4b89-8369-651fed65ec30 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:25.810802 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:25.811857 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0716b3-7981-4982-b161-e5d674531953 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:25.819079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed4a75-5af1-46a2-ad04-d8fd562c07f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:25.819735 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed4a75-5af1-46a2-ad04-d8fd562c07f3 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:25.820056 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed4a75-5af1-46a2-ad04-d8fd562c07f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:25.820340 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed4a75-5af1-46a2-ad04-d8fd562c07f3 None admin] PATH_INFO: `/v3/users/70a3f2a158524f4eb65391e71dffc61b` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:25.821510 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed4a75-5af1-46a2-ad04-d8fd562c07f3 None admin] RBAC: Authorizing `identity:get_user(user_id=70a3f2a158524f4eb65391e71dffc61b)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:25.823052 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed4a75-5af1-46a2-ad04-d8fd562c07f3 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:25.824696 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 47/88] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:25 2022] GET /identity/v3/users/70a3f2a158524f4eb65391e71dffc61b => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:25.825447 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed4a75-5af1-46a2-ad04-d8fd562c07f3 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:25.847509 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d631bd-d042-428e-9571-1c2352aefa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:25.848164 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d631bd-d042-428e-9571-1c2352aefa9c None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:25.848447 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d631bd-d042-428e-9571-1c2352aefa9c None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:25.848726 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d631bd-d042-428e-9571-1c2352aefa9c None admin] PATH_INFO: `/v3/projects/bb5564ea35cb4871823a95b50fd471c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:25.849889 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d631bd-d042-428e-9571-1c2352aefa9c None admin] RBAC: Authorizing `identity:get_project(project_id=bb5564ea35cb4871823a95b50fd471c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:25.851408 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d631bd-d042-428e-9571-1c2352aefa9c None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:25.853195 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 42/89] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:38:25 2022] GET /identity/v3/projects/bb5564ea35cb4871823a95b50fd471c7 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:25.853905 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d631bd-d042-428e-9571-1c2352aefa9c None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:25.936951 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed4a75-5af1-46a2-ad04-d8fd562c07f3 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:25.946228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:25.962952 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d631bd-d042-428e-9571-1c2352aefa9c None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:25.973845 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf5ddc-a4fb-4cf3-a884-7e4c7d02b9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:25.974565 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf5ddc-a4fb-4cf3-a884-7e4c7d02b9fb None admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:25.974796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf5ddc-a4fb-4cf3-a884-7e4c7d02b9fb None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:25.975069 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf5ddc-a4fb-4cf3-a884-7e4c7d02b9fb None admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:25.975761 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edf5ddc-a4fb-4cf3-a884-7e4c7d02b9fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:25.977221 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edf5ddc-a4fb-4cf3-a884-7e4c7d02b9fb None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:26.000217 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 48/90] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 04:38:25 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:38:26.000419 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66ca75-4b9c-4944-adee-e42ac6f10203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:26.000419 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66ca75-4b9c-4944-adee-e42ac6f10203 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:26.000627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66ca75-4b9c-4944-adee-e42ac6f10203 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:26.000712 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66ca75-4b9c-4944-adee-e42ac6f10203 None admin] PATH_INFO: `/v3/projects/bb5564ea35cb4871823a95b50fd471c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:26.002024 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66ca75-4b9c-4944-adee-e42ac6f10203 None admin] RBAC: Authorizing `identity:get_project(project_id=bb5564ea35cb4871823a95b50fd471c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:26.003342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf5ddc-a4fb-4cf3-a884-7e4c7d02b9fb None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:26.003571 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66ca75-4b9c-4944-adee-e42ac6f10203 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:26.011024 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 43/91] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:38:25 2022] GET /identity/v3/projects/bb5564ea35cb4871823a95b50fd471c7 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:26.011024 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66ca75-4b9c-4944-adee-e42ac6f10203 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:26.068203 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:26.138680 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf5ddc-a4fb-4cf3-a884-7e4c7d02b9fb None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:26.142909 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66ca75-4b9c-4944-adee-e42ac6f10203 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:26.189819 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cc285-dd9d-4f2b-815e-1728531077ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:26.190509 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cc285-dd9d-4f2b-815e-1728531077ed None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:26.190787 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cc285-dd9d-4f2b-815e-1728531077ed None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:26.191040 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943cc285-dd9d-4f2b-815e-1728531077ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:26.191846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943cc285-dd9d-4f2b-815e-1728531077ed None admin] RBAC: Adding query filter params (role.id=201d465b851546b1a19c322a3356d48d, scope.project.id=bb5564ea35cb4871823a95b50fd471c7, user.id=70a3f2a158524f4eb65391e71dffc61b) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:26.192003 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d856330-ca81-4fb6-8e87-ef50170d7baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:26.192205 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943cc285-dd9d-4f2b-815e-1728531077ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:26.192592 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d856330-ca81-4fb6-8e87-ef50170d7baf None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:26.192880 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d856330-ca81-4fb6-8e87-ef50170d7baf None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:26.193163 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d856330-ca81-4fb6-8e87-ef50170d7baf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:26.193642 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943cc285-dd9d-4f2b-815e-1728531077ed None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:26.203936 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 49/92] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:38:26 2022] GET /identity/v3/role_assignments?user.id=70a3f2a158524f4eb65391e71dffc61b&scope.project.id=bb5564ea35cb4871823a95b50fd471c7&role.id=201d465b851546b1a19c322a3356d48d => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:26.204846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cc285-dd9d-4f2b-815e-1728531077ed None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:26.226787 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:26.299227 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d856330-ca81-4fb6-8e87-ef50170d7baf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:26.300759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d856330-ca81-4fb6-8e87-ef50170d7baf None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:26.341412 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943cc285-dd9d-4f2b-815e-1728531077ed None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:26.363147 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:26.396712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ca238-bbfc-4d33-8e6f-1f42e28cdbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:26.397680 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ca238-bbfc-4d33-8e6f-1f42e28cdbbe None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:26.398206 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ca238-bbfc-4d33-8e6f-1f42e28cdbbe None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:26.399125 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ca238-bbfc-4d33-8e6f-1f42e28cdbbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:26.402958 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ca238-bbfc-4d33-8e6f-1f42e28cdbbe None admin] RBAC: Adding query filter params (role.id=e2b16a5edd7b472487fac12492349bc7, scope.project.id=bb5564ea35cb4871823a95b50fd471c7, user.id=70a3f2a158524f4eb65391e71dffc61b) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:26.402958 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ca238-bbfc-4d33-8e6f-1f42e28cdbbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:26.405012 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ca238-bbfc-4d33-8e6f-1f42e28cdbbe None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:26.416857 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 50/93] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:38:26 2022] GET /identity/v3/role_assignments?user.id=70a3f2a158524f4eb65391e71dffc61b&scope.project.id=bb5564ea35cb4871823a95b50fd471c7&role.id=e2b16a5edd7b472487fac12492349bc7 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:26.418243 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ca238-bbfc-4d33-8e6f-1f42e28cdbbe None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:26.446418 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 44/94] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:38:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:26.457447 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d856330-ca81-4fb6-8e87-ef50170d7baf None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:26.530456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:26.564573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ca238-bbfc-4d33-8e6f-1f42e28cdbbe None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:26.575363 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d856330-ca81-4fb6-8e87-ef50170d7baf None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:26.612258 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41024d3c-0868-4dce-b445-b83e4227e83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:26.612940 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41024d3c-0868-4dce-b445-b83e4227e83b None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:26.613223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41024d3c-0868-4dce-b445-b83e4227e83b None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:26.613523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41024d3c-0868-4dce-b445-b83e4227e83b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:26.614344 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41024d3c-0868-4dce-b445-b83e4227e83b None admin] RBAC: Adding query filter params (role.id=2bfdd65b06554a6da967b3939da753c7, scope.project.id=bb5564ea35cb4871823a95b50fd471c7, user.id=fb4866594bcc4f3fa8cc9d8ea5e9f327) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:26.614660 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41024d3c-0868-4dce-b445-b83e4227e83b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:26.616240 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41024d3c-0868-4dce-b445-b83e4227e83b None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:26.635455 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae0448-7803-4d6a-b172-b45841e885c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:26.636144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 51/95] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:38:26 2022] GET /identity/v3/role_assignments?user.id=fb4866594bcc4f3fa8cc9d8ea5e9f327&scope.project.id=bb5564ea35cb4871823a95b50fd471c7&role.id=2bfdd65b06554a6da967b3939da753c7 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:26.642280 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae0448-7803-4d6a-b172-b45841e885c1 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:26.643098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae0448-7803-4d6a-b172-b45841e885c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:26.643658 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae0448-7803-4d6a-b172-b45841e885c1 None admin] PATH_INFO: `/v3/projects/16c26e5156834ead98ece585c32ba3ab` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:26.645433 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae0448-7803-4d6a-b172-b45841e885c1 None admin] RBAC: Authorizing `identity:get_project(project_id=16c26e5156834ead98ece585c32ba3ab)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:26.647397 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae0448-7803-4d6a-b172-b45841e885c1 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:26.649645 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 45/96] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:38:26 2022] GET /identity/v3/projects/16c26e5156834ead98ece585c32ba3ab => generated 312 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:38:26.656119 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41024d3c-0868-4dce-b445-b83e4227e83b None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:26.727488 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:26.810165 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41024d3c-0868-4dce-b445-b83e4227e83b None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:26.868022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283318b0-4c42-4e9d-89cb-ff50c3075c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:26.868848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283318b0-4c42-4e9d-89cb-ff50c3075c7d None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:26.869007 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283318b0-4c42-4e9d-89cb-ff50c3075c7d None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:26.869282 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283318b0-4c42-4e9d-89cb-ff50c3075c7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:26.870326 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283318b0-4c42-4e9d-89cb-ff50c3075c7d None admin] RBAC: Adding query filter params (role.id=201d465b851546b1a19c322a3356d48d, scope.project.id=16c26e5156834ead98ece585c32ba3ab, user.id=70a3f2a158524f4eb65391e71dffc61b) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:26.870642 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283318b0-4c42-4e9d-89cb-ff50c3075c7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:26.872159 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283318b0-4c42-4e9d-89cb-ff50c3075c7d None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:26.883084 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 52/97] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:38:26 2022] GET /identity/v3/role_assignments?user.id=70a3f2a158524f4eb65391e71dffc61b&scope.project.id=16c26e5156834ead98ece585c32ba3ab&role.id=201d465b851546b1a19c322a3356d48d => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:28.987040 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6160504-794d-46b6-a32d-b0a6985da07d None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:28.987560 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6160504-794d-46b6-a32d-b0a6985da07d None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:28.987560 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6160504-794d-46b6-a32d-b0a6985da07d None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:28.989213 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 46/98] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:28.994968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995321e-9091-4d99-b6fa-d3c9ad70e9ac None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:28.995819 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995321e-9091-4d99-b6fa-d3c9ad70e9ac None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:28.996309 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5995321e-9091-4d99-b6fa-d3c9ad70e9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:29.004794 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f8928-df73-45bd-8056-60ea32b46e72 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:29.005085 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f8928-df73-45bd-8056-60ea32b46e72 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:29.005359 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f8928-df73-45bd-8056-60ea32b46e72 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:29.006746 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 47/99] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:38:29.012263 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979587d-ed78-4bb0-85ab-50c4b1e85185 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:29.012546 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979587d-ed78-4bb0-85ab-50c4b1e85185 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:29.012826 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979587d-ed78-4bb0-85ab-50c4b1e85185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:29.027723 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-5995321e-9091-4d99-b6fa-d3c9ad70e9ac None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:29.029102 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-5995321e-9091-4d99-b6fa-d3c9ad70e9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:29.039435 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-0979587d-ed78-4bb0-85ab-50c4b1e85185 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:29.040818 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-0979587d-ed78-4bb0-85ab-50c4b1e85185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:29.130858 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 48/100] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 04:38:29.153396 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979587d-ed78-4bb0-85ab-50c4b1e85185 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:29.154643 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 53/101] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 04:38:29.191793 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995321e-9091-4d99-b6fa-d3c9ad70e9ac None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:29.209477 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:29.257686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979587d-ed78-4bb0-85ab-50c4b1e85185 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:29.286418 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:29.293776 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37fa5a4-890d-4616-b5b5-0d56baf70881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:29.294475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37fa5a4-890d-4616-b5b5-0d56baf70881 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:29.294752 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37fa5a4-890d-4616-b5b5-0d56baf70881 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:29.295025 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37fa5a4-890d-4616-b5b5-0d56baf70881 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:29.296245 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37fa5a4-890d-4616-b5b5-0d56baf70881 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:29.297753 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37fa5a4-890d-4616-b5b5-0d56baf70881 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:29.304114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 49/102] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:38:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:29.305580 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37fa5a4-890d-4616-b5b5-0d56baf70881 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:29.410886 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37fa5a4-890d-4616-b5b5-0d56baf70881 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:29.425169 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5995321e-9091-4d99-b6fa-d3c9ad70e9ac None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:29.446070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796925bd-97f1-4bdb-a290-ddaec70a2388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:29.447109 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796925bd-97f1-4bdb-a290-ddaec70a2388 None admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:29.447585 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796925bd-97f1-4bdb-a290-ddaec70a2388 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:29.448073 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796925bd-97f1-4bdb-a290-ddaec70a2388 None admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:29.449302 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:29.449699 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796925bd-97f1-4bdb-a290-ddaec70a2388 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:29.451617 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796925bd-97f1-4bdb-a290-ddaec70a2388 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:29.496067 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 50/103] 10.222.0.39 () {60 vars in 1141 bytes} [Tue Jul 26 04:38:29 2022] POST /identity/v3/projects => generated 302 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:38:29.498810 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ff905-8089-47c2-a889-c9ef1ff4fd6d None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:29.500183 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ff905-8089-47c2-a889-c9ef1ff4fd6d None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:29.501347 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ff905-8089-47c2-a889-c9ef1ff4fd6d None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:29.504796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 51/104] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:29.511151 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901523c-3af9-4c79-8ec8-e870412db8cd None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:29.511796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901523c-3af9-4c79-8ec8-e870412db8cd None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:29.512287 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901523c-3af9-4c79-8ec8-e870412db8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:29.523217 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7ab0a-236a-4f0a-8d56-dfca3ec8717a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:29.524321 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7ab0a-236a-4f0a-8d56-dfca3ec8717a None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:29.524900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7ab0a-236a-4f0a-8d56-dfca3ec8717a None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:29.525364 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7ab0a-236a-4f0a-8d56-dfca3ec8717a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:29.547113 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-1901523c-3af9-4c79-8ec8-e870412db8cd None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:29.547590 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7ab0a-236a-4f0a-8d56-dfca3ec8717a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:29.548354 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-1901523c-3af9-4c79-8ec8-e870412db8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:29.553358 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-21c7ab0a-236a-4f0a-8d56-dfca3ec8717a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 04:38:29.553358 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:29.553358 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:29.553358 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:29.553358 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:29.553358 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:29.553358 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:29.553358 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:29.553358 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:29.553358 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:29.553358 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:29.553358 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:29.553358 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:29.553358 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:29.553358 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:29.553358 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:29.554327 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:29.554327 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:29.554327 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:29.554327 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:29.554327 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:29.554327 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:29.554327 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:29.554327 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:29.554327 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:29.554327 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:29.554327 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:29.554327 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:29.554327 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:29.554327 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:29.554327 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:29.554327 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:29.555086 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:29.555086 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:29.555086 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:29.555086 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:29.555086 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:29.555086 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:29.555086 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:29.555086 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:29.555086 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:29.555086 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:29.555086 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 04:38:29.555086 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:38:29.557933 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 54/105] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:38:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:38:29.565410 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7ab0a-236a-4f0a-8d56-dfca3ec8717a None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:29.713116 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 52/106] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:29.715077 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3653708-ae6a-45e8-aeb3-2275f31e6508 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:29.715844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3653708-ae6a-45e8-aeb3-2275f31e6508 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:29.717304 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3653708-ae6a-45e8-aeb3-2275f31e6508 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:29.720146 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 53/107] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:29.731669 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49529b-d18b-4562-b5a6-60fcb87a93c4 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:29.732296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49529b-d18b-4562-b5a6-60fcb87a93c4 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:29.732808 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49529b-d18b-4562-b5a6-60fcb87a93c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:29.762789 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-4a49529b-d18b-4562-b5a6-60fcb87a93c4 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:29.763934 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-4a49529b-d18b-4562-b5a6-60fcb87a93c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:29.778503 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:29.783860 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7ab0a-236a-4f0a-8d56-dfca3ec8717a None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:29.828265 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75293f3-56f4-407f-af43-643731ebd6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:29.829161 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75293f3-56f4-407f-af43-643731ebd6b7 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:29.829592 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75293f3-56f4-407f-af43-643731ebd6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:29.829866 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75293f3-56f4-407f-af43-643731ebd6b7 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:29.830622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75293f3-56f4-407f-af43-643731ebd6b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:29.830923 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75293f3-56f4-407f-af43-643731ebd6b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:29.832323 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75293f3-56f4-407f-af43-643731ebd6b7 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:29.841598 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 55/108] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 04:38:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:29.842275 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75293f3-56f4-407f-af43-643731ebd6b7 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:29.866294 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 54/109] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:29.868332 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e691f10-b510-4a6b-a8be-9491fc60e565 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:29.868669 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e691f10-b510-4a6b-a8be-9491fc60e565 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:29.868959 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e691f10-b510-4a6b-a8be-9491fc60e565 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:29.870566 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 55/110] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:29.871880 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e691f10-b510-4a6b-a8be-9491fc60e565 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:29.913334 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:29.976478 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75293f3-56f4-407f-af43-643731ebd6b7 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:30.016567 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e691f10-b510-4a6b-a8be-9491fc60e565 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:30.021900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4cae5d-8969-4691-a6ba-da96f8df0a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:30.023226 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cae5d-8969-4691-a6ba-da96f8df0a07 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:30.023708 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cae5d-8969-4691-a6ba-da96f8df0a07 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:30.024198 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4cae5d-8969-4691-a6ba-da96f8df0a07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:30.038992 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4cae5d-8969-4691-a6ba-da96f8df0a07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:30.047832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-3d4cae5d-8969-4691-a6ba-da96f8df0a07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:38:30.047832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:30.047832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:30.047832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:30.047832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:30.047832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:30.047832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:30.047832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:30.047832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:30.047832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:30.047832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:30.047832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:30.047832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:30.047832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:30.047832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:30.047832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:30.048699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:30.048699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:30.048699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:30.048699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:30.048699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:30.048699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:30.048699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:30.048699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:30.048699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:30.048699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:30.048699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:30.048699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:30.048699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:30.048699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:30.048699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:30.048699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:30.049459 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:30.049459 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:30.049459 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:30.049459 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:30.049459 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:30.049459 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:30.049459 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:30.049459 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:30.049459 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:30.049459 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:30.049459 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:38:30.049459 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:38:30.051483 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 56/111] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:38:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:38:30.053471 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1afcb-658a-4627-a3e2-155620c8e0fe None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:30.053752 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1afcb-658a-4627-a3e2-155620c8e0fe None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:30.054061 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1afcb-658a-4627-a3e2-155620c8e0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:30.059587 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b3bd7-f7bd-4edd-9cbc-f4e2047c1fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:30.060588 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b3bd7-f7bd-4edd-9cbc-f4e2047c1fb0 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:30.061142 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b3bd7-f7bd-4edd-9cbc-f4e2047c1fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:30.061610 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b3bd7-f7bd-4edd-9cbc-f4e2047c1fb0 None admin] PATH_INFO: `/v3/users/29c9039ffaad443c9479009a4dd33c58` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:30.073508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-31a1afcb-658a-4627-a3e2-155620c8e0fe None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:30.074750 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-31a1afcb-658a-4627-a3e2-155620c8e0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:30.078141 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b3bd7-f7bd-4edd-9cbc-f4e2047c1fb0 None admin] RBAC: Authorizing `identity:get_user(user_id=29c9039ffaad443c9479009a4dd33c58)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:30.079876 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b3bd7-f7bd-4edd-9cbc-f4e2047c1fb0 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:30.081848 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 56/112] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:29 2022] GET /identity/v3/users/29c9039ffaad443c9479009a4dd33c58 => generated 289 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:30.082876 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b3bd7-f7bd-4edd-9cbc-f4e2047c1fb0 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:30.091541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:30.154023 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 57/113] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:30.154888 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1afcb-658a-4627-a3e2-155620c8e0fe None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:30.188854 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:30.198932 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b3bd7-f7bd-4edd-9cbc-f4e2047c1fb0 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:30.238015 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b806b5f-7baa-4294-913b-04f7234235e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:30.238415 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b806b5f-7baa-4294-913b-04f7234235e3 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:30.238816 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b806b5f-7baa-4294-913b-04f7234235e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:30.239239 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b806b5f-7baa-4294-913b-04f7234235e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:30.257026 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b806b5f-7baa-4294-913b-04f7234235e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:30.269139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-3b806b5f-7baa-4294-913b-04f7234235e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:38:30.269139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:30.269139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:30.269139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:30.269139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:30.269139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:30.269139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:30.269139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:30.269139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:30.269139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:30.269139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:30.269139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:30.269139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:30.269139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:30.269139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:30.269139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:30.270065 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:30.270065 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:30.270065 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:30.270065 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:30.270065 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:30.270065 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:30.270065 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:30.270065 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:30.270065 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:30.270065 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:30.270065 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:30.270065 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:30.270065 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:30.270065 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:30.270065 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:30.270065 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:30.270842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:30.270842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:30.270842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:30.270842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:30.270842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:30.270842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:30.270842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:30.270842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:30.270842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:30.270842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:30.270842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:38:30.270842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:38:30.274160 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 57/114] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:38:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:38:30.275973 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b806b5f-7baa-4294-913b-04f7234235e3 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:30.286153 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1afcb-658a-4627-a3e2-155620c8e0fe None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:30.326277 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e824e12d-8771-4577-a868-14d06110b9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:30.327280 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824e12d-8771-4577-a868-14d06110b9c6 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:30.327564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824e12d-8771-4577-a868-14d06110b9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:30.327837 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e824e12d-8771-4577-a868-14d06110b9c6 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:30.328563 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824e12d-8771-4577-a868-14d06110b9c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:30.328866 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824e12d-8771-4577-a868-14d06110b9c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:30.330306 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e824e12d-8771-4577-a868-14d06110b9c6 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:30.341570 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 58/115] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:38:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:30.342911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10382a-0c6b-45c5-81f5-a496ada560d2 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:30.343195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10382a-0c6b-45c5-81f5-a496ada560d2 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:30.343467 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d10382a-0c6b-45c5-81f5-a496ada560d2 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:30.344718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 59/116] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:30.348984 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10382a-0c6b-45c5-81f5-a496ada560d2 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:30.364556 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:30.392759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b806b5f-7baa-4294-913b-04f7234235e3 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:30.429181 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ba136-7088-4ade-8b01-72c982cc0fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:30.429826 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ba136-7088-4ade-8b01-72c982cc0fc3 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:30.430144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ba136-7088-4ade-8b01-72c982cc0fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:30.430425 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ba136-7088-4ade-8b01-72c982cc0fc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:30.453428 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:30.464720 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d10382a-0c6b-45c5-81f5-a496ada560d2 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:30.500590 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ee3ad-e8b2-4da2-86c4-668b725001ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:30.501245 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ee3ad-e8b2-4da2-86c4-668b725001ac None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:30.501526 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ee3ad-e8b2-4da2-86c4-668b725001ac None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:30.501798 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ee3ad-e8b2-4da2-86c4-668b725001ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:30.506204 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888ba136-7088-4ade-8b01-72c982cc0fc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:30.507718 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888ba136-7088-4ade-8b01-72c982cc0fc3 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:30.513924 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ee3ad-e8b2-4da2-86c4-668b725001ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:30.518912 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-104ee3ad-e8b2-4da2-86c4-668b725001ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:38:30.518912 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:30.518912 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:30.518912 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:30.518912 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:30.518912 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:30.518912 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:30.518912 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:30.518912 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:30.518912 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:30.518912 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:30.518912 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:30.518912 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:30.518912 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:30.518912 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:30.518912 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:30.519826 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:30.519826 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:30.519826 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:30.519826 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:30.519826 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:30.519826 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:30.519826 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:30.519826 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:30.519826 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:30.519826 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:30.519826 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:30.519826 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:30.519826 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:30.519826 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:30.519826 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:30.519826 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:30.525919 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:30.525919 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:30.525919 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:30.525919 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:30.525919 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:30.525919 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:30.525919 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:30.525919 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:30.525919 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:30.525919 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:30.525919 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:38:30.525919 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:38:30.525919 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 60/117] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:38:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:38:30.525919 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ee3ad-e8b2-4da2-86c4-668b725001ac None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:30.601636 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:30.624580 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 58/118] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:38:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:30.630854 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ba136-7088-4ade-8b01-72c982cc0fc3 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:30.650063 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ee3ad-e8b2-4da2-86c4-668b725001ac None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:30.687583 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:30.691262 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe5668-2910-4309-acf4-dab8168eeb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:30.691897 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe5668-2910-4309-acf4-dab8168eeb5e None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:30.692173 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe5668-2910-4309-acf4-dab8168eeb5e None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:30.692442 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe5668-2910-4309-acf4-dab8168eeb5e None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:30.693153 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe5668-2910-4309-acf4-dab8168eeb5e None admin] RBAC: Adding query filter params (name=member) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:30.693455 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe5668-2910-4309-acf4-dab8168eeb5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:30.694911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe5668-2910-4309-acf4-dab8168eeb5e None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:30.704261 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 61/119] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 04:38:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:30.705474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb5585-b945-4eb0-ad38-9965fcb13012 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:30.705758 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb5585-b945-4eb0-ad38-9965fcb13012 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:30.710279 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb5585-b945-4eb0-ad38-9965fcb13012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:30.730141 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-98fb5585-b945-4eb0-ad38-9965fcb13012 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:30.731344 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-98fb5585-b945-4eb0-ad38-9965fcb13012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:30.746072 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ba136-7088-4ade-8b01-72c982cc0fc3 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:30.783580 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83bf94-55b8-4e0e-9e3d-d068828a35f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:30.784163 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83bf94-55b8-4e0e-9e3d-d068828a35f3 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:30.784444 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83bf94-55b8-4e0e-9e3d-d068828a35f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:30.784723 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83bf94-55b8-4e0e-9e3d-d068828a35f3 None admin] PATH_INFO: `/v3/users/fb4866594bcc4f3fa8cc9d8ea5e9f327` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:30.785903 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83bf94-55b8-4e0e-9e3d-d068828a35f3 None admin] RBAC: Authorizing `identity:get_user(user_id=fb4866594bcc4f3fa8cc9d8ea5e9f327)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:30.787439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83bf94-55b8-4e0e-9e3d-d068828a35f3 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:30.793540 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 59/120] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:30 2022] GET /identity/v3/users/fb4866594bcc4f3fa8cc9d8ea5e9f327 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:30.793540 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83bf94-55b8-4e0e-9e3d-d068828a35f3 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:30.807332 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 62/121] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:30.815521 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb5585-b945-4eb0-ad38-9965fcb13012 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:30.895451 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:30.902241 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83bf94-55b8-4e0e-9e3d-d068828a35f3 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:30.921372 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:30.939237 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fa010-6a86-492a-9a8a-f37455b1fb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:30.939878 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fa010-6a86-492a-9a8a-f37455b1fb18 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:30.940160 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fa010-6a86-492a-9a8a-f37455b1fb18 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:30.940445 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8fa010-6a86-492a-9a8a-f37455b1fb18 None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:30.941165 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8fa010-6a86-492a-9a8a-f37455b1fb18 None admin] RBAC: Adding query filter params (name=member) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:30.941471 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8fa010-6a86-492a-9a8a-f37455b1fb18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:30.942619 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb5585-b945-4eb0-ad38-9965fcb13012 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:30.942943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8fa010-6a86-492a-9a8a-f37455b1fb18 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:30.956815 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 60/122] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 04:38:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:30.956815 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fa010-6a86-492a-9a8a-f37455b1fb18 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:30.989338 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607c717-c6b5-42d7-9785-7d2a1a1008db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:30.990741 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607c717-c6b5-42d7-9785-7d2a1a1008db None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:30.991028 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607c717-c6b5-42d7-9785-7d2a1a1008db None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:30.991313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607c717-c6b5-42d7-9785-7d2a1a1008db None admin] PATH_INFO: `/v3/projects/bb5564ea35cb4871823a95b50fd471c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:30.992541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607c717-c6b5-42d7-9785-7d2a1a1008db None admin] RBAC: Authorizing `identity:get_project(project_id=bb5564ea35cb4871823a95b50fd471c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:30.994109 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607c717-c6b5-42d7-9785-7d2a1a1008db None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:30.995823 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 63/123] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:38:30 2022] GET /identity/v3/projects/bb5564ea35cb4871823a95b50fd471c7 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:30.996592 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607c717-c6b5-42d7-9785-7d2a1a1008db None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:31.064519 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8fa010-6a86-492a-9a8a-f37455b1fb18 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:31.100855 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3988e73-d874-4dda-a0e0-e30df6e3f738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:31.101504 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3988e73-d874-4dda-a0e0-e30df6e3f738 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:31.101782 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3988e73-d874-4dda-a0e0-e30df6e3f738 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:31.102092 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3988e73-d874-4dda-a0e0-e30df6e3f738 None admin] PATH_INFO: `/v3/users/70a3f2a158524f4eb65391e71dffc61b` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:31.103361 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3988e73-d874-4dda-a0e0-e30df6e3f738 None admin] RBAC: Authorizing `identity:get_user(user_id=70a3f2a158524f4eb65391e71dffc61b)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:31.104852 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3988e73-d874-4dda-a0e0-e30df6e3f738 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:31.106720 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 61/124] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:30 2022] GET /identity/v3/users/70a3f2a158524f4eb65391e71dffc61b => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:31.107105 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607c717-c6b5-42d7-9785-7d2a1a1008db None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:31.111935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3988e73-d874-4dda-a0e0-e30df6e3f738 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:31.148217 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:31.155296 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22dc50-3e8e-4473-bf47-5fc544d8ef3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:31.155961 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22dc50-3e8e-4473-bf47-5fc544d8ef3b None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:31.156268 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22dc50-3e8e-4473-bf47-5fc544d8ef3b None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:31.156545 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22dc50-3e8e-4473-bf47-5fc544d8ef3b None admin] PATH_INFO: `/v3/projects/bb5564ea35cb4871823a95b50fd471c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:31.157725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22dc50-3e8e-4473-bf47-5fc544d8ef3b None admin] RBAC: Authorizing `identity:get_project(project_id=bb5564ea35cb4871823a95b50fd471c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:31.159212 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22dc50-3e8e-4473-bf47-5fc544d8ef3b None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:31.161074 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 64/125] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:38:30 2022] GET /identity/v3/projects/bb5564ea35cb4871823a95b50fd471c7 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:31.166644 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22dc50-3e8e-4473-bf47-5fc544d8ef3b None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:31.178922 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:31.234658 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3988e73-d874-4dda-a0e0-e30df6e3f738 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:31.275308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22dc50-3e8e-4473-bf47-5fc544d8ef3b None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:31.275660 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2564517-542e-432c-8276-2a4e12852675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:31.276319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2564517-542e-432c-8276-2a4e12852675 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:31.276601 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2564517-542e-432c-8276-2a4e12852675 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:31.276874 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2564517-542e-432c-8276-2a4e12852675 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:31.294795 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2564517-542e-432c-8276-2a4e12852675 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:31.300361 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-e2564517-542e-432c-8276-2a4e12852675 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 04:38:31.300361 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:31.300361 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:31.300361 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:31.300361 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:31.300361 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:31.300361 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:31.300361 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:31.300361 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:31.300361 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:31.300361 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:31.300361 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:31.300361 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:31.300361 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:31.300361 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:31.300361 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:31.301231 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:31.301231 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:31.301231 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:31.301231 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:31.301231 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:31.301231 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:31.301231 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:31.301231 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:31.301231 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:31.301231 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:31.301231 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:31.301231 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:31.301231 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:31.301231 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:31.301231 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:31.301231 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:31.302849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:31.302849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:31.302849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:31.302849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:31.302849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:31.302849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:31.302849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:31.302849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:31.302849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:31.302849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:31.302849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 04:38:31.302849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:38:31.302849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 62/126] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 04:38:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:38:31.302849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2564517-542e-432c-8276-2a4e12852675 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:31.321555 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b2416-8e1f-4f35-9b4c-dc5254e2cb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:31.322178 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b2416-8e1f-4f35-9b4c-dc5254e2cb2f None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:31.322465 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b2416-8e1f-4f35-9b4c-dc5254e2cb2f None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:31.322776 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b2416-8e1f-4f35-9b4c-dc5254e2cb2f None admin] PATH_INFO: `/v3/users/70a3f2a158524f4eb65391e71dffc61b` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:31.327449 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b2416-8e1f-4f35-9b4c-dc5254e2cb2f None admin] RBAC: Authorizing `identity:get_user(user_id=70a3f2a158524f4eb65391e71dffc61b)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:31.329103 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b2416-8e1f-4f35-9b4c-dc5254e2cb2f None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:31.330816 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 65/127] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:31 2022] GET /identity/v3/users/70a3f2a158524f4eb65391e71dffc61b => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:31.331590 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b2416-8e1f-4f35-9b4c-dc5254e2cb2f None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:31.401192 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:31.418699 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2564517-542e-432c-8276-2a4e12852675 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:31.430293 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:31.439193 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b2416-8e1f-4f35-9b4c-dc5254e2cb2f None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:31.458423 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986bb95-8fd0-4f9e-850f-a0df01f80535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:31.459062 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986bb95-8fd0-4f9e-850f-a0df01f80535 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:31.459351 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986bb95-8fd0-4f9e-850f-a0df01f80535 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:31.459631 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986bb95-8fd0-4f9e-850f-a0df01f80535 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:31.460435 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986bb95-8fd0-4f9e-850f-a0df01f80535 None admin] RBAC: Adding query filter params (role.id=b4b41ae21c5744628519a58257d04609, scope.project.id=bb5564ea35cb4871823a95b50fd471c7, user.id=29c9039ffaad443c9479009a4dd33c58) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:31.460749 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986bb95-8fd0-4f9e-850f-a0df01f80535 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:31.462338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986bb95-8fd0-4f9e-850f-a0df01f80535 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:31.468348 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 63/128] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:38:31 2022] GET /identity/v3/role_assignments?user.id=29c9039ffaad443c9479009a4dd33c58&scope.project.id=bb5564ea35cb4871823a95b50fd471c7&role.id=b4b41ae21c5744628519a58257d04609 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:31.468966 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986bb95-8fd0-4f9e-850f-a0df01f80535 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:31.490791 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e6c4e-a48b-4c5f-8f87-946a5cf526a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:31.492418 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e6c4e-a48b-4c5f-8f87-946a5cf526a3 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:31.492894 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e6c4e-a48b-4c5f-8f87-946a5cf526a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:31.493422 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e6c4e-a48b-4c5f-8f87-946a5cf526a3 None admin] PATH_INFO: `/v3/projects/16c26e5156834ead98ece585c32ba3ab` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:31.495806 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e6c4e-a48b-4c5f-8f87-946a5cf526a3 None admin] RBAC: Authorizing `identity:get_project(project_id=16c26e5156834ead98ece585c32ba3ab)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:31.498035 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e6c4e-a48b-4c5f-8f87-946a5cf526a3 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:31.506077 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 66/129] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:38:31 2022] GET /identity/v3/projects/16c26e5156834ead98ece585c32ba3ab => generated 312 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:31.506077 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e6c4e-a48b-4c5f-8f87-946a5cf526a3 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:31.606404 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986bb95-8fd0-4f9e-850f-a0df01f80535 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:31.645416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e6c4e-a48b-4c5f-8f87-946a5cf526a3 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:31.664371 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442737df-193a-495d-9187-a8e260a7ee72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:31.665289 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442737df-193a-495d-9187-a8e260a7ee72 None admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:31.665579 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442737df-193a-495d-9187-a8e260a7ee72 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:31.665857 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442737df-193a-495d-9187-a8e260a7ee72 None admin] PATH_INFO: `/v3/projects/bb5564ea35cb4871823a95b50fd471c7/users/fb4866594bcc4f3fa8cc9d8ea5e9f327/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:31.668052 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442737df-193a-495d-9187-a8e260a7ee72 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb5564ea35cb4871823a95b50fd471c7, user_id=fb4866594bcc4f3fa8cc9d8ea5e9f327, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:31.669609 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442737df-193a-495d-9187-a8e260a7ee72 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:31.684923 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff358c-d2af-431e-94ec-f0fb389a0942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:31.685616 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff358c-d2af-431e-94ec-f0fb389a0942 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:31.685899 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff358c-d2af-431e-94ec-f0fb389a0942 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:31.686046 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 64/130] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 04:38:31 2022] PUT /identity/v3/projects/bb5564ea35cb4871823a95b50fd471c7/users/fb4866594bcc4f3fa8cc9d8ea5e9f327/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:38:31.686479 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff358c-d2af-431e-94ec-f0fb389a0942 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:31.687036 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442737df-193a-495d-9187-a8e260a7ee72 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:31.690773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff358c-d2af-431e-94ec-f0fb389a0942 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:31.691121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff358c-d2af-431e-94ec-f0fb389a0942 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:31.692668 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff358c-d2af-431e-94ec-f0fb389a0942 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:31.703912 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:31.721226 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 67/131] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:38:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:31.722194 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff358c-d2af-431e-94ec-f0fb389a0942 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:31.771614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:31.879677 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442737df-193a-495d-9187-a8e260a7ee72 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:31.890741 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff358c-d2af-431e-94ec-f0fb389a0942 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:31.919587 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac4453-5d36-457d-82d6-d11eeaff4821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:31.920247 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac4453-5d36-457d-82d6-d11eeaff4821 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:31.920525 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac4453-5d36-457d-82d6-d11eeaff4821 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:31.920796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac4453-5d36-457d-82d6-d11eeaff4821 None admin] PATH_INFO: `/v3/projects/bb5564ea35cb4871823a95b50fd471c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:31.921963 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac4453-5d36-457d-82d6-d11eeaff4821 None admin] RBAC: Authorizing `identity:get_project(project_id=bb5564ea35cb4871823a95b50fd471c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:31.923478 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac4453-5d36-457d-82d6-d11eeaff4821 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:31.925178 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 65/132] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:38:31 2022] GET /identity/v3/projects/bb5564ea35cb4871823a95b50fd471c7 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:31.925945 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac4453-5d36-457d-82d6-d11eeaff4821 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:31.950286 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9050b-6a79-4030-9d19-0cf1e8e5127e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:31.950998 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9050b-6a79-4030-9d19-0cf1e8e5127e None admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:31.952246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9050b-6a79-4030-9d19-0cf1e8e5127e None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:31.952531 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9050b-6a79-4030-9d19-0cf1e8e5127e None admin] PATH_INFO: `/v3/projects/16c26e5156834ead98ece585c32ba3ab/users/70a3f2a158524f4eb65391e71dffc61b/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:31.954697 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9050b-6a79-4030-9d19-0cf1e8e5127e None admin] RBAC: Authorizing `identity:create_grant(project_id=16c26e5156834ead98ece585c32ba3ab, user_id=70a3f2a158524f4eb65391e71dffc61b, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:31.956296 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9050b-6a79-4030-9d19-0cf1e8e5127e None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:31.977664 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 68/133] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 04:38:31 2022] PUT /identity/v3/projects/16c26e5156834ead98ece585c32ba3ab/users/70a3f2a158524f4eb65391e71dffc61b/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:38:31.979082 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3e668-baef-4578-a21c-0f42654a659a None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:31.979436 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3e668-baef-4578-a21c-0f42654a659a None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:31.979993 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3e668-baef-4578-a21c-0f42654a659a None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:31.981740 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 69/134] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:31.986952 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3e668-baef-4578-a21c-0f42654a659a None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:32.051740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:32.056302 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac4453-5d36-457d-82d6-d11eeaff4821 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:32.066792 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:32.106733 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6be47-4963-40f4-b85c-bf3106c257ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:32.107562 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6be47-4963-40f4-b85c-bf3106c257ba None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:32.108049 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6be47-4963-40f4-b85c-bf3106c257ba None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:32.108414 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6be47-4963-40f4-b85c-bf3106c257ba None admin] PATH_INFO: `/v3/users/70a3f2a158524f4eb65391e71dffc61b` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:32.110140 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf6be47-4963-40f4-b85c-bf3106c257ba None admin] RBAC: Authorizing `identity:get_user(user_id=70a3f2a158524f4eb65391e71dffc61b)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:32.112344 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf6be47-4963-40f4-b85c-bf3106c257ba None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:32.114324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 66/135] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:31 2022] GET /identity/v3/users/70a3f2a158524f4eb65391e71dffc61b => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:32.115800 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b12726-dbfc-48f8-ac96-09d1307e2006 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:32.116198 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b12726-dbfc-48f8-ac96-09d1307e2006 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:32.116561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b12726-dbfc-48f8-ac96-09d1307e2006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:32.137374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3e668-baef-4578-a21c-0f42654a659a None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:32.139435 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-f5b12726-dbfc-48f8-ac96-09d1307e2006 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:32.140788 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-f5b12726-dbfc-48f8-ac96-09d1307e2006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:32.206780 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a9273-4f2c-4675-afb9-372f503a5efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:32.207651 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a9273-4f2c-4675-afb9-372f503a5efa None admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:32.208115 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a9273-4f2c-4675-afb9-372f503a5efa None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:32.208485 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a9273-4f2c-4675-afb9-372f503a5efa None admin] PATH_INFO: `/v3/projects/bb5564ea35cb4871823a95b50fd471c7/users/70a3f2a158524f4eb65391e71dffc61b/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:32.213699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a9273-4f2c-4675-afb9-372f503a5efa None admin] RBAC: Authorizing `identity:create_grant(project_id=bb5564ea35cb4871823a95b50fd471c7, user_id=70a3f2a158524f4eb65391e71dffc61b, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:32.215745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a9273-4f2c-4675-afb9-372f503a5efa None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:32.243373 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 70/136] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 04:38:31 2022] PUT /identity/v3/projects/bb5564ea35cb4871823a95b50fd471c7/users/70a3f2a158524f4eb65391e71dffc61b/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:38:32.245124 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a9273-4f2c-4675-afb9-372f503a5efa None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:32.272874 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 67/137] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:32.302794 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b12726-dbfc-48f8-ac96-09d1307e2006 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:32.364463 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a9273-4f2c-4675-afb9-372f503a5efa None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:32.386642 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:32.414526 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a07ce-3a3b-4f9f-b064-83369a8f365c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:32.415344 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a07ce-3a3b-4f9f-b064-83369a8f365c None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:32.415805 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a07ce-3a3b-4f9f-b064-83369a8f365c None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:32.416178 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a07ce-3a3b-4f9f-b064-83369a8f365c None admin] PATH_INFO: `/v3/projects/bb5564ea35cb4871823a95b50fd471c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:32.419233 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:32.420703 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a07ce-3a3b-4f9f-b064-83369a8f365c None admin] RBAC: Authorizing `identity:get_project(project_id=bb5564ea35cb4871823a95b50fd471c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:32.422358 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a07ce-3a3b-4f9f-b064-83369a8f365c None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:32.424363 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b12726-dbfc-48f8-ac96-09d1307e2006 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:32.426279 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 71/138] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:38:32 2022] GET /identity/v3/projects/bb5564ea35cb4871823a95b50fd471c7 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:32.430682 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a07ce-3a3b-4f9f-b064-83369a8f365c None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:32.465770 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa54fc-4bb4-4f12-bce5-90fdacc03292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:32.466892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa54fc-4bb4-4f12-bce5-90fdacc03292 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:32.467484 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa54fc-4bb4-4f12-bce5-90fdacc03292 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:32.467980 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa54fc-4bb4-4f12-bce5-90fdacc03292 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:32.469461 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa54fc-4bb4-4f12-bce5-90fdacc03292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:32.471438 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fa54fc-4bb4-4f12-bce5-90fdacc03292 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:32.473770 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 68/139] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:38:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:32.479833 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa54fc-4bb4-4f12-bce5-90fdacc03292 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:32.598873 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa54fc-4bb4-4f12-bce5-90fdacc03292 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:32.602905 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a07ce-3a3b-4f9f-b064-83369a8f365c None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:32.638009 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62783c-981b-41d8-b05c-a31e28a3b7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:32.639160 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62783c-981b-41d8-b05c-a31e28a3b7e7 None admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:32.639731 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62783c-981b-41d8-b05c-a31e28a3b7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:32.640205 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62783c-981b-41d8-b05c-a31e28a3b7e7 None admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:32.641096 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62783c-981b-41d8-b05c-a31e28a3b7e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:32.643020 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62783c-981b-41d8-b05c-a31e28a3b7e7 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:32.660026 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0383d-52a8-4803-8b33-d71ac2fc92e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:32.660687 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0383d-52a8-4803-8b33-d71ac2fc92e9 None admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:32.660975 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0383d-52a8-4803-8b33-d71ac2fc92e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:32.661354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0383d-52a8-4803-8b33-d71ac2fc92e9 None admin] PATH_INFO: `/v3/projects/bb5564ea35cb4871823a95b50fd471c7/users/70a3f2a158524f4eb65391e71dffc61b/roles/e2b16a5edd7b472487fac12492349bc7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:32.669703 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0383d-52a8-4803-8b33-d71ac2fc92e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb5564ea35cb4871823a95b50fd471c7, user_id=70a3f2a158524f4eb65391e71dffc61b, role_id=e2b16a5edd7b472487fac12492349bc7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:32.671793 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0383d-52a8-4803-8b33-d71ac2fc92e9 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:32.691737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 69/140] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 04:38:32 2022] POST /identity/v3/users => generated 283 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:38:32.695087 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 72/141] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 04:38:32 2022] PUT /identity/v3/projects/bb5564ea35cb4871823a95b50fd471c7/users/70a3f2a158524f4eb65391e71dffc61b/roles/e2b16a5edd7b472487fac12492349bc7 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:38:33.646268 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663b6db-6455-4184-ab4b-4c0630a761e7 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:33.647291 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663b6db-6455-4184-ab4b-4c0630a761e7 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:33.647776 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663b6db-6455-4184-ab4b-4c0630a761e7 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:33.649570 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 70/142] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:33.655019 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e3d56-8191-4550-ad26-59e4a0733651 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:33.655878 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e3d56-8191-4550-ad26-59e4a0733651 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:33.656358 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e3d56-8191-4550-ad26-59e4a0733651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:33.683824 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-b57e3d56-8191-4550-ad26-59e4a0733651 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:33.685726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-b57e3d56-8191-4550-ad26-59e4a0733651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:33.742594 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:33.784063 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 73/143] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:33.820263 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663b6db-6455-4184-ab4b-4c0630a761e7 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:33.847739 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:33.941572 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663b6db-6455-4184-ab4b-4c0630a761e7 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:33.990573 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a172750-eaba-4ba3-bbc3-d5b1c1f67aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:33.991240 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a172750-eaba-4ba3-bbc3-d5b1c1f67aaf None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:33.991524 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a172750-eaba-4ba3-bbc3-d5b1c1f67aaf None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:33.991799 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a172750-eaba-4ba3-bbc3-d5b1c1f67aaf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:34.010435 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a172750-eaba-4ba3-bbc3-d5b1c1f67aaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:34.015614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-3a172750-eaba-4ba3-bbc3-d5b1c1f67aaf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 04:38:34.015614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:34.015614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:34.015614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:34.015614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:34.015614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:34.015614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:34.015614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:34.015614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:34.015614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:34.015614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:34.015614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:34.015614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:34.015614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:34.015614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:34.015614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:34.016507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:34.016507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:34.016507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:34.016507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:34.016507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:34.016507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:34.016507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:34.016507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:34.016507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:34.016507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:34.016507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:34.016507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:34.016507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:34.016507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:34.016507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:34.016507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:34.017277 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:34.017277 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:34.017277 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:34.017277 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:34.017277 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:34.017277 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:34.017277 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:34.017277 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:34.017277 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:34.017277 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:34.017277 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 04:38:34.017277 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:38:34.017277 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 71/144] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:38:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:38:34.024244 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e3d56-8191-4550-ad26-59e4a0733651 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:34.148050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e3d56-8191-4550-ad26-59e4a0733651 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:34.188164 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f31a43-7446-4801-8198-62cfa3cc9ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:34.188806 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f31a43-7446-4801-8198-62cfa3cc9ad2 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:34.189103 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f31a43-7446-4801-8198-62cfa3cc9ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:34.189382 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f31a43-7446-4801-8198-62cfa3cc9ad2 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:34.190143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f31a43-7446-4801-8198-62cfa3cc9ad2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:34.190447 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f31a43-7446-4801-8198-62cfa3cc9ad2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:34.191999 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f31a43-7446-4801-8198-62cfa3cc9ad2 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:34.202689 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 74/145] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 04:38:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:34.211146 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a172750-eaba-4ba3-bbc3-d5b1c1f67aaf None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:34.309357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:34.330218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a172750-eaba-4ba3-bbc3-d5b1c1f67aaf None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:34.375029 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d99eb9-85d8-46db-8c86-523502a0e8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:34.375786 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d99eb9-85d8-46db-8c86-523502a0e8be None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:34.376129 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d99eb9-85d8-46db-8c86-523502a0e8be None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:34.376467 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d99eb9-85d8-46db-8c86-523502a0e8be None admin] PATH_INFO: `/v3/users/29c9039ffaad443c9479009a4dd33c58` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:34.377742 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d99eb9-85d8-46db-8c86-523502a0e8be None admin] RBAC: Authorizing `identity:get_user(user_id=29c9039ffaad443c9479009a4dd33c58)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:34.379327 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d99eb9-85d8-46db-8c86-523502a0e8be None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:34.381059 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 72/146] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:34 2022] GET /identity/v3/users/29c9039ffaad443c9479009a4dd33c58 => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:34.386935 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f31a43-7446-4801-8198-62cfa3cc9ad2 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:34.441269 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:34.517161 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f31a43-7446-4801-8198-62cfa3cc9ad2 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:34.559268 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc4e25-6502-4232-9d6d-4ffa8564578b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:34.560029 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc4e25-6502-4232-9d6d-4ffa8564578b None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:34.560374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc4e25-6502-4232-9d6d-4ffa8564578b None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:34.560721 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc4e25-6502-4232-9d6d-4ffa8564578b None admin] PATH_INFO: `/v3/projects/bb5564ea35cb4871823a95b50fd471c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:34.562230 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc4e25-6502-4232-9d6d-4ffa8564578b None admin] RBAC: Authorizing `identity:get_project(project_id=bb5564ea35cb4871823a95b50fd471c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:34.563758 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc4e25-6502-4232-9d6d-4ffa8564578b None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:34.565539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 75/147] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:38:34 2022] GET /identity/v3/projects/bb5564ea35cb4871823a95b50fd471c7 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:34.571709 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d99eb9-85d8-46db-8c86-523502a0e8be None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:34.698722 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d99eb9-85d8-46db-8c86-523502a0e8be None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:34.751335 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e751e88-26b7-4c00-8bb8-7d8eade8df49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:34.752037 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e751e88-26b7-4c00-8bb8-7d8eade8df49 None admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:34.752320 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e751e88-26b7-4c00-8bb8-7d8eade8df49 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:34.752595 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e751e88-26b7-4c00-8bb8-7d8eade8df49 None admin] PATH_INFO: `/v3/projects/bb5564ea35cb4871823a95b50fd471c7/users/29c9039ffaad443c9479009a4dd33c58/roles/b4b41ae21c5744628519a58257d04609` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:34.754632 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e751e88-26b7-4c00-8bb8-7d8eade8df49 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb5564ea35cb4871823a95b50fd471c7, user_id=29c9039ffaad443c9479009a4dd33c58, role_id=b4b41ae21c5744628519a58257d04609)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:34.756135 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e751e88-26b7-4c00-8bb8-7d8eade8df49 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:34.786511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 73/148] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 04:38:34 2022] PUT /identity/v3/projects/bb5564ea35cb4871823a95b50fd471c7/users/29c9039ffaad443c9479009a4dd33c58/roles/b4b41ae21c5744628519a58257d04609 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:38:35.260042 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93d6ed-4af4-41da-8769-44317ff61e8f None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:35.260595 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93d6ed-4af4-41da-8769-44317ff61e8f None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:35.260595 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93d6ed-4af4-41da-8769-44317ff61e8f None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:35.262140 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 76/149] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:35.288675 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdade2f-5586-4adb-8f3e-3d52ff7d199e None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:35.288990 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdade2f-5586-4adb-8f3e-3d52ff7d199e None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:35.289257 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdade2f-5586-4adb-8f3e-3d52ff7d199e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:35.315084 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-dfdade2f-5586-4adb-8f3e-3d52ff7d199e None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:35.316323 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-dfdade2f-5586-4adb-8f3e-3d52ff7d199e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:35.319579 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:35.395883 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d7f24-14fa-43ca-8d9b-cba59aab0070 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:35.396239 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d7f24-14fa-43ca-8d9b-cba59aab0070 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:35.396485 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d7f24-14fa-43ca-8d9b-cba59aab0070 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:35.398032 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 77/150] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:38:35.408528 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 74/151] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:35.410335 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62c311-f8b7-4d65-985c-8a531011b9bd None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:35.410612 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62c311-f8b7-4d65-985c-8a531011b9bd None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:35.410888 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc62c311-f8b7-4d65-985c-8a531011b9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:35.432353 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-fc62c311-f8b7-4d65-985c-8a531011b9bd None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:35.433558 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-fc62c311-f8b7-4d65-985c-8a531011b9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:35.450153 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdade2f-5586-4adb-8f3e-3d52ff7d199e None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:35.572230 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 78/152] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:35.622959 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdade2f-5586-4adb-8f3e-3d52ff7d199e None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:35.631449 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62c311-f8b7-4d65-985c-8a531011b9bd None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:35.696344 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:35.710719 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6c3d4-71a6-4a75-a191-c174ae1187ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:35.711543 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6c3d4-71a6-4a75-a191-c174ae1187ba None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:35.711771 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6c3d4-71a6-4a75-a191-c174ae1187ba None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:35.712042 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6c3d4-71a6-4a75-a191-c174ae1187ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:35.732677 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:35.741366 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed6c3d4-71a6-4a75-a191-c174ae1187ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:35.746551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-3ed6c3d4-71a6-4a75-a191-c174ae1187ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:38:35.746551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:35.746551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:35.746551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:35.746551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:35.746551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:35.746551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:35.746551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:35.746551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:35.746551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:35.746551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:35.746551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:35.746551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:35.746551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:35.746551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:35.746551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:35.747448 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:35.747448 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:35.747448 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:35.747448 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:35.747448 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:35.747448 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:35.747448 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:35.747448 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:35.747448 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:35.747448 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:35.747448 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:35.747448 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:35.747448 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:35.747448 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:35.747448 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:35.747448 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:35.748194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:35.748194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:35.748194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:35.748194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:35.748194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:35.748194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:35.748194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:35.748194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:35.748194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:35.748194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:35.748194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:38:35.748194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:38:35.749746 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 75/153] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:38:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:38:35.754547 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6c3d4-71a6-4a75-a191-c174ae1187ba None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:35.865158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc62c311-f8b7-4d65-985c-8a531011b9bd None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:35.955444 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488a274-da17-428f-bb41-69014baeaebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:35.956135 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488a274-da17-428f-bb41-69014baeaebc None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:35.956419 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488a274-da17-428f-bb41-69014baeaebc None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:35.956696 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488a274-da17-428f-bb41-69014baeaebc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:35.977950 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488a274-da17-428f-bb41-69014baeaebc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:35.987200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-d488a274-da17-428f-bb41-69014baeaebc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:38:35.987200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:35.987200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:35.987200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:35.987200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:35.987200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:35.987200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:35.987200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:35.987200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:35.987200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:35.987200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:35.987200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:35.987200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:35.987200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:35.987200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:35.987200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:35.988541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:35.988541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:35.988541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:35.988541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:35.988541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:35.988541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:35.988541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:35.988541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:35.988541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:35.988541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:35.988541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:35.988541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:35.988541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:35.988541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:35.988541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:35.988541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:35.989683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:35.989683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:35.989683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:35.989683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:35.989683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:35.989683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:35.989683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:35.989683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:35.989683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:35.989683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:35.989683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:38:35.989683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:38:35.989683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 79/154] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:38:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:38:35.997938 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488a274-da17-428f-bb41-69014baeaebc None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:36.021102 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed6c3d4-71a6-4a75-a191-c174ae1187ba None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:36.090097 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbad5a2-0146-498a-8e76-ef8a638dd146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:36.090743 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbad5a2-0146-498a-8e76-ef8a638dd146 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:36.091039 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbad5a2-0146-498a-8e76-ef8a638dd146 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:36.091318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbad5a2-0146-498a-8e76-ef8a638dd146 None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:36.092055 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbad5a2-0146-498a-8e76-ef8a638dd146 None admin] RBAC: Adding query filter params (name=member) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:36.092362 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbad5a2-0146-498a-8e76-ef8a638dd146 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:36.093781 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbad5a2-0146-498a-8e76-ef8a638dd146 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:36.108384 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 76/155] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 04:38:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:38:36.109763 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e01a3-034e-4a60-8eee-ebc1f4719616 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:36.110077 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e01a3-034e-4a60-8eee-ebc1f4719616 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:36.110356 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e01a3-034e-4a60-8eee-ebc1f4719616 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:36.111594 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 77/156] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:36.117218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e01a3-034e-4a60-8eee-ebc1f4719616 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:36.194548 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:36.203352 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488a274-da17-428f-bb41-69014baeaebc None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:36.252786 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:36.270722 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0185fe-ea26-4eca-a34d-e469c76018ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:36.271410 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0185fe-ea26-4eca-a34d-e469c76018ee None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:36.271653 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0185fe-ea26-4eca-a34d-e469c76018ee None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:36.271929 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0185fe-ea26-4eca-a34d-e469c76018ee None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:36.272664 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0185fe-ea26-4eca-a34d-e469c76018ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:36.272971 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0185fe-ea26-4eca-a34d-e469c76018ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:36.274791 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0185fe-ea26-4eca-a34d-e469c76018ee None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:36.288893 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 80/157] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:38:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:36.290656 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2dc97-740a-41f2-813c-c8092ca2949d None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:36.290656 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2dc97-740a-41f2-813c-c8092ca2949d None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:36.290880 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc2dc97-740a-41f2-813c-c8092ca2949d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:36.335089 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-5bc2dc97-740a-41f2-813c-c8092ca2949d None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:36.336405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-5bc2dc97-740a-41f2-813c-c8092ca2949d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:36.343644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e01a3-034e-4a60-8eee-ebc1f4719616 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:36.407268 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0da62d-c99c-4d02-abd9-31302c7b9225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:36.407848 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0da62d-c99c-4d02-abd9-31302c7b9225 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:36.408123 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0da62d-c99c-4d02-abd9-31302c7b9225 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:36.408393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0da62d-c99c-4d02-abd9-31302c7b9225 None admin] PATH_INFO: `/v3/users/70a3f2a158524f4eb65391e71dffc61b` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:36.411394 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0da62d-c99c-4d02-abd9-31302c7b9225 None admin] RBAC: Authorizing `identity:get_user(user_id=70a3f2a158524f4eb65391e71dffc61b)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:36.413002 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0da62d-c99c-4d02-abd9-31302c7b9225 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:36.414941 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 78/158] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:36 2022] GET /identity/v3/users/70a3f2a158524f4eb65391e71dffc61b => generated 275 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:38:36.415767 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0da62d-c99c-4d02-abd9-31302c7b9225 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:36.516526 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 81/159] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:36.517525 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2dc97-740a-41f2-813c-c8092ca2949d None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:36.599880 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0da62d-c99c-4d02-abd9-31302c7b9225 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:36.665654 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:36.680998 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b67fc-5cd0-4ba7-8dba-d64f63fffa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:36.681678 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b67fc-5cd0-4ba7-8dba-d64f63fffa21 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:36.681960 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b67fc-5cd0-4ba7-8dba-d64f63fffa21 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:36.682257 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b67fc-5cd0-4ba7-8dba-d64f63fffa21 None admin] PATH_INFO: `/v3/users/fb4866594bcc4f3fa8cc9d8ea5e9f327` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:36.687623 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b67fc-5cd0-4ba7-8dba-d64f63fffa21 None admin] RBAC: Authorizing `identity:get_user(user_id=fb4866594bcc4f3fa8cc9d8ea5e9f327)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:36.689180 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b67fc-5cd0-4ba7-8dba-d64f63fffa21 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:36.690690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:36.692124 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 79/160] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:36 2022] GET /identity/v3/users/fb4866594bcc4f3fa8cc9d8ea5e9f327 => generated 247 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:36.697125 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e733e1d-23ed-4bcb-97d6-6d1499ac3059 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:36.698133 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e733e1d-23ed-4bcb-97d6-6d1499ac3059 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:36.698413 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e733e1d-23ed-4bcb-97d6-6d1499ac3059 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:36.700045 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 80/161] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:36.700672 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e733e1d-23ed-4bcb-97d6-6d1499ac3059 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:36.711958 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc2dc97-740a-41f2-813c-c8092ca2949d None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:36.766760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e700e3-8310-4cdc-9767-174a7d6e9a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:36.767443 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e700e3-8310-4cdc-9767-174a7d6e9a15 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:36.767723 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e700e3-8310-4cdc-9767-174a7d6e9a15 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:36.767992 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e700e3-8310-4cdc-9767-174a7d6e9a15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:36.911281 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e700e3-8310-4cdc-9767-174a7d6e9a15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:36.912837 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e700e3-8310-4cdc-9767-174a7d6e9a15 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:36.970007 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e733e1d-23ed-4bcb-97d6-6d1499ac3059 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:37.013102 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef543064-a511-470f-8650-247ea8446883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:37.013768 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef543064-a511-470f-8650-247ea8446883 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:37.014062 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef543064-a511-470f-8650-247ea8446883 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:37.014334 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef543064-a511-470f-8650-247ea8446883 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:37.043879 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef543064-a511-470f-8650-247ea8446883 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:37.056918 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-ef543064-a511-470f-8650-247ea8446883 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:38:37.056918 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:37.056918 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:37.056918 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:37.056918 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:37.056918 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:37.056918 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:37.056918 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:37.056918 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:37.056918 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:37.056918 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:37.056918 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:37.056918 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:37.056918 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:37.056918 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:37.056918 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:37.057843 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:37.057843 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:37.057843 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:37.057843 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:37.057843 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:37.057843 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:37.057843 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:37.057843 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:37.057843 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:37.057843 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:37.057843 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:37.057843 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:37.057843 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:37.057843 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:37.057843 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:37.057843 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:37.058671 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:37.058671 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:37.058671 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:37.058671 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:37.058671 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:37.058671 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:37.058671 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:37.058671 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:37.058671 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:37.058671 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:37.058671 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:38:37.058671 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:38:37.060697 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 81/162] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:38:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:38:37.063666 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef543064-a511-470f-8650-247ea8446883 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:37.128984 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:37.161023 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 82/163] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:38:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:37.162325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a663b8d-be8f-4a03-b7cb-8f71bd202af7 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:37.162605 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a663b8d-be8f-4a03-b7cb-8f71bd202af7 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:37.162874 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a663b8d-be8f-4a03-b7cb-8f71bd202af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:37.201639 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:37.208312 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-4a663b8d-be8f-4a03-b7cb-8f71bd202af7 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:37.209509 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-4a663b8d-be8f-4a03-b7cb-8f71bd202af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:37.320303 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef543064-a511-470f-8650-247ea8446883 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:37.378947 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89b461-21da-4b84-99b6-717a3345ef84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:37.379987 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89b461-21da-4b84-99b6-717a3345ef84 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:37.380477 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89b461-21da-4b84-99b6-717a3345ef84 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:37.380943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc89b461-21da-4b84-99b6-717a3345ef84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:37.424073 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 83/164] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:37.424759 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a663b8d-be8f-4a03-b7cb-8f71bd202af7 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:37.498137 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89b461-21da-4b84-99b6-717a3345ef84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:37.500440 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc89b461-21da-4b84-99b6-717a3345ef84 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:37.579383 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:37.609795 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a663b8d-be8f-4a03-b7cb-8f71bd202af7 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:37.628622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:37.632912 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 82/165] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:38:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:37.634108 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89b461-21da-4b84-99b6-717a3345ef84 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:37.648194 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b4a77-deca-427b-9617-1442100c5af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:37.649488 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b4a77-deca-427b-9617-1442100c5af3 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:37.650022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b4a77-deca-427b-9617-1442100c5af3 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:37.650534 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b4a77-deca-427b-9617-1442100c5af3 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:37.651549 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b4a77-deca-427b-9617-1442100c5af3 None admin] RBAC: Adding query filter params (name=member) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:37.652068 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b4a77-deca-427b-9617-1442100c5af3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:37.653836 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b4a77-deca-427b-9617-1442100c5af3 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:37.663888 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 84/166] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 04:38:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:37.665512 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a24d2b-c467-474d-a6e1-eecdfde8d0bd None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:37.666022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a24d2b-c467-474d-a6e1-eecdfde8d0bd None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:37.666492 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a24d2b-c467-474d-a6e1-eecdfde8d0bd None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:37.667916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 85/167] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:37.672739 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a24d2b-c467-474d-a6e1-eecdfde8d0bd None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:37.740211 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc89b461-21da-4b84-99b6-717a3345ef84 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:37.775774 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96dffd3-29b0-43a2-a51a-70f8c10e628c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:37.776430 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dffd3-29b0-43a2-a51a-70f8c10e628c None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:37.776712 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dffd3-29b0-43a2-a51a-70f8c10e628c None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:37.777036 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dffd3-29b0-43a2-a51a-70f8c10e628c None admin] PATH_INFO: `/v3/projects/16c26e5156834ead98ece585c32ba3ab` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:37.778199 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96dffd3-29b0-43a2-a51a-70f8c10e628c None admin] RBAC: Authorizing `identity:get_project(project_id=16c26e5156834ead98ece585c32ba3ab)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:37.779956 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96dffd3-29b0-43a2-a51a-70f8c10e628c None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:37.786475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 83/168] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:38:37 2022] GET /identity/v3/projects/16c26e5156834ead98ece585c32ba3ab => generated 312 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:37.786475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34291a3b-8b2d-4d5f-be64-2686241a4624 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:37.786475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34291a3b-8b2d-4d5f-be64-2686241a4624 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:37.786475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34291a3b-8b2d-4d5f-be64-2686241a4624 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:37.786475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 84/169] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:37.786475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34291a3b-8b2d-4d5f-be64-2686241a4624 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:37.788130 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a24d2b-c467-474d-a6e1-eecdfde8d0bd None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:37.817320 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:37.829067 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd0c1b-38be-4fff-8220-472e938b6570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:37.831229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd0c1b-38be-4fff-8220-472e938b6570 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:37.831717 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd0c1b-38be-4fff-8220-472e938b6570 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:37.832211 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd0c1b-38be-4fff-8220-472e938b6570 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:37.843798 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fd0c1b-38be-4fff-8220-472e938b6570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:37.850153 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-67fd0c1b-38be-4fff-8220-472e938b6570 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 04:38:37.850153 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:37.850153 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:37.850153 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:37.850153 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:37.850153 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:37.850153 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:37.850153 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:37.850153 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:37.850153 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:37.850153 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:37.850153 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:37.850153 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:37.850153 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:37.850153 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:37.850153 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:37.851121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:37.851121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:37.851121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:37.851121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:37.851121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:37.851121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:37.851121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:37.851121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:37.851121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:37.851121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:37.851121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:37.851121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:37.851121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:37.851121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:37.851121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:37.851121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:37.851952 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:37.851952 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:37.851952 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:37.851952 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:37.851952 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:37.851952 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:37.851952 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:37.851952 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:37.851952 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:37.851952 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:37.851952 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 04:38:37.851952 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:38:37.854939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 86/170] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 04:38:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:38:37.856015 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd0c1b-38be-4fff-8220-472e938b6570 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:37.899471 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34291a3b-8b2d-4d5f-be64-2686241a4624 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:37.902561 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:37.936683 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845cadca-1742-40ca-bd18-c0cd8aa091d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:37.937336 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845cadca-1742-40ca-bd18-c0cd8aa091d3 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:37.937615 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845cadca-1742-40ca-bd18-c0cd8aa091d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:37.937883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845cadca-1742-40ca-bd18-c0cd8aa091d3 None admin] PATH_INFO: `/v3/projects/bb5564ea35cb4871823a95b50fd471c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:37.939066 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845cadca-1742-40ca-bd18-c0cd8aa091d3 None admin] RBAC: Authorizing `identity:get_project(project_id=bb5564ea35cb4871823a95b50fd471c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:37.940525 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845cadca-1742-40ca-bd18-c0cd8aa091d3 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:37.942685 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 85/171] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:38:37 2022] GET /identity/v3/projects/bb5564ea35cb4871823a95b50fd471c7 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:37.944212 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248faafb-d629-4f7f-98fc-5a530d95a12f None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:37.944500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248faafb-d629-4f7f-98fc-5a530d95a12f None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:37.944775 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248faafb-d629-4f7f-98fc-5a530d95a12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:37.963943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-248faafb-d629-4f7f-98fc-5a530d95a12f None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:37.965139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-248faafb-d629-4f7f-98fc-5a530d95a12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:37.970959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd0c1b-38be-4fff-8220-472e938b6570 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:38.009219 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aede84-b139-4242-b807-ae1f085e84b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:38.009884 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aede84-b139-4242-b807-ae1f085e84b5 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:38.010196 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aede84-b139-4242-b807-ae1f085e84b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:38.010469 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aede84-b139-4242-b807-ae1f085e84b5 None admin] PATH_INFO: `/v3/users/70a3f2a158524f4eb65391e71dffc61b` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:38.012033 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aede84-b139-4242-b807-ae1f085e84b5 None admin] RBAC: Authorizing `identity:get_user(user_id=70a3f2a158524f4eb65391e71dffc61b)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:38.013869 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aede84-b139-4242-b807-ae1f085e84b5 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:38.015541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 87/172] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:37 2022] GET /identity/v3/users/70a3f2a158524f4eb65391e71dffc61b => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:38.016325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aede84-b139-4242-b807-ae1f085e84b5 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:38.043019 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 86/173] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:38.044288 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2db7f-6907-40a5-ab6c-8a941c08bd13 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:38.044600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2db7f-6907-40a5-ab6c-8a941c08bd13 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:38.044849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2db7f-6907-40a5-ab6c-8a941c08bd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:38.062802 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-1fb2db7f-6907-40a5-ab6c-8a941c08bd13 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:38.063982 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-1fb2db7f-6907-40a5-ab6c-8a941c08bd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:38.082424 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:38.129887 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aede84-b139-4242-b807-ae1f085e84b5 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:38.135703 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 87/174] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:38.136833 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2db7f-6907-40a5-ab6c-8a941c08bd13 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:38.149516 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:38.178446 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0540f9-6bcd-4783-a4cc-ba2db2a8c114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:38.179078 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0540f9-6bcd-4783-a4cc-ba2db2a8c114 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:38.179356 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0540f9-6bcd-4783-a4cc-ba2db2a8c114 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:38.179625 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0540f9-6bcd-4783-a4cc-ba2db2a8c114 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:38.180442 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0540f9-6bcd-4783-a4cc-ba2db2a8c114 None admin] RBAC: Adding query filter params (role.id=201d465b851546b1a19c322a3356d48d, scope.project.id=16c26e5156834ead98ece585c32ba3ab, user.id=70a3f2a158524f4eb65391e71dffc61b) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:38.180749 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0540f9-6bcd-4783-a4cc-ba2db2a8c114 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:38.182216 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0540f9-6bcd-4783-a4cc-ba2db2a8c114 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:38.188885 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 88/175] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:38:38 2022] GET /identity/v3/role_assignments?user.id=70a3f2a158524f4eb65391e71dffc61b&scope.project.id=16c26e5156834ead98ece585c32ba3ab&role.id=201d465b851546b1a19c322a3356d48d => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:38.189870 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49191909-f6ad-498e-9d22-84ede2ad2b61 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:38.190179 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49191909-f6ad-498e-9d22-84ede2ad2b61 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:38.190453 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49191909-f6ad-498e-9d22-84ede2ad2b61 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:38.191842 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 89/176] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:38.196643 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49191909-f6ad-498e-9d22-84ede2ad2b61 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:38.270472 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2db7f-6907-40a5-ab6c-8a941c08bd13 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:38.308518 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a5f1b-7d4a-4ac8-8e91-1382a969dd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:38.309212 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a5f1b-7d4a-4ac8-8e91-1382a969dd03 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:38.309493 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a5f1b-7d4a-4ac8-8e91-1382a969dd03 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:38.309759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a5f1b-7d4a-4ac8-8e91-1382a969dd03 None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:38.310576 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a5f1b-7d4a-4ac8-8e91-1382a969dd03 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:38.310880 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a5f1b-7d4a-4ac8-8e91-1382a969dd03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:38.312587 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a5f1b-7d4a-4ac8-8e91-1382a969dd03 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:38.322009 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 88/177] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:38:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:38.322707 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a5f1b-7d4a-4ac8-8e91-1382a969dd03 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:38.332708 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49191909-f6ad-498e-9d22-84ede2ad2b61 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:38.345130 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:38.379231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71f8ed-dd1c-42a7-9bad-81be1f8d2aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:38.379861 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71f8ed-dd1c-42a7-9bad-81be1f8d2aa0 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:38.380140 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71f8ed-dd1c-42a7-9bad-81be1f8d2aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:38.381124 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71f8ed-dd1c-42a7-9bad-81be1f8d2aa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:38.381226 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71f8ed-dd1c-42a7-9bad-81be1f8d2aa0 None admin] RBAC: Adding query filter params (role.id=2bfdd65b06554a6da967b3939da753c7, scope.project.id=bb5564ea35cb4871823a95b50fd471c7, user.id=fb4866594bcc4f3fa8cc9d8ea5e9f327) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:38.381509 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71f8ed-dd1c-42a7-9bad-81be1f8d2aa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:38.383135 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71f8ed-dd1c-42a7-9bad-81be1f8d2aa0 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:38.389263 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 90/178] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:38:38 2022] GET /identity/v3/role_assignments?user.id=fb4866594bcc4f3fa8cc9d8ea5e9f327&scope.project.id=bb5564ea35cb4871823a95b50fd471c7&role.id=2bfdd65b06554a6da967b3939da753c7 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:38.390745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71f8ed-dd1c-42a7-9bad-81be1f8d2aa0 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:38.434467 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:38.460645 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a5f1b-7d4a-4ac8-8e91-1382a969dd03 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:38.507971 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8464370-4959-4681-8a7a-01b9f49dccca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:38.508834 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8464370-4959-4681-8a7a-01b9f49dccca None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:38.509073 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8464370-4959-4681-8a7a-01b9f49dccca None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:38.509427 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8464370-4959-4681-8a7a-01b9f49dccca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:38.532011 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71f8ed-dd1c-42a7-9bad-81be1f8d2aa0 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:38.578365 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69cc5d-8c5e-4c1f-9349-d76e6d4baf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:38.579169 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69cc5d-8c5e-4c1f-9349-d76e6d4baf1e None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:38.579790 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69cc5d-8c5e-4c1f-9349-d76e6d4baf1e None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:38.579905 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69cc5d-8c5e-4c1f-9349-d76e6d4baf1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:38.591680 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69cc5d-8c5e-4c1f-9349-d76e6d4baf1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:38.594792 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8464370-4959-4681-8a7a-01b9f49dccca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:38.596315 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8464370-4959-4681-8a7a-01b9f49dccca None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:38.597856 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-3c69cc5d-8c5e-4c1f-9349-d76e6d4baf1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:38:38.597856 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:38.597856 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:38.597856 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:38.597856 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:38.597856 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:38.597856 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:38.597856 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:38.597856 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:38.597856 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:38.597856 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:38.597856 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:38.597856 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:38.597856 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:38.597856 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:38.597856 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:38.598810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:38.598810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:38.598810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:38.598810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:38.598810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:38.598810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:38.598810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:38.598810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:38.598810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:38.598810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:38.598810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:38.598810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:38.598810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:38.598810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:38.598810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:38.598810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:38.599622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:38.599622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:38.599622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:38.599622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:38.599622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:38.599622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:38.599622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:38.599622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:38.599622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:38.599622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:38.599622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:38:38.599622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:38:38.599622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 91/179] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:38:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:38:38.600532 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69cc5d-8c5e-4c1f-9349-d76e6d4baf1e None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:38.617257 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:38.700813 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:38.704318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 89/180] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:38:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:38.705726 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb816e4-5b6f-4f6e-a9a7-a7e4d7e8cf47 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:38.706025 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb816e4-5b6f-4f6e-a9a7-a7e4d7e8cf47 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:38.706326 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb816e4-5b6f-4f6e-a9a7-a7e4d7e8cf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:38.709123 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69cc5d-8c5e-4c1f-9349-d76e6d4baf1e None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:38.723585 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-6cb816e4-5b6f-4f6e-a9a7-a7e4d7e8cf47 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:38.724781 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-6cb816e4-5b6f-4f6e-a9a7-a7e4d7e8cf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:38.744908 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08825057-1d40-4d7e-ac3c-0ee80d13875f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:38.745553 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08825057-1d40-4d7e-ac3c-0ee80d13875f None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:38.746010 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08825057-1d40-4d7e-ac3c-0ee80d13875f None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:38.746273 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08825057-1d40-4d7e-ac3c-0ee80d13875f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:38.747416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08825057-1d40-4d7e-ac3c-0ee80d13875f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:38.748882 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08825057-1d40-4d7e-ac3c-0ee80d13875f None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:38.750507 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 92/181] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:38:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:38.751602 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8663f-c80e-4cb5-a787-097e29c453a0 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:38.751875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8663f-c80e-4cb5-a787-097e29c453a0 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:38.752141 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8663f-c80e-4cb5-a787-097e29c453a0 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:38.753321 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 93/182] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:38.754000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8663f-c80e-4cb5-a787-097e29c453a0 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:38.795912 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 90/183] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:38.796842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb816e4-5b6f-4f6e-a9a7-a7e4d7e8cf47 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:38.843456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:38.863499 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8663f-c80e-4cb5-a787-097e29c453a0 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:38.896024 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb816e4-5b6f-4f6e-a9a7-a7e4d7e8cf47 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:38.898637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0680b0-d8e7-4062-a48d-485476e780e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:38.899314 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0680b0-d8e7-4062-a48d-485476e780e2 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:38.899596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0680b0-d8e7-4062-a48d-485476e780e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:38.899863 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0680b0-d8e7-4062-a48d-485476e780e2 None admin] PATH_INFO: `/v3/users/70a3f2a158524f4eb65391e71dffc61b` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:38.901016 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0680b0-d8e7-4062-a48d-485476e780e2 None admin] RBAC: Authorizing `identity:get_user(user_id=70a3f2a158524f4eb65391e71dffc61b)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:38.902517 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0680b0-d8e7-4062-a48d-485476e780e2 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:38.904138 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 94/184] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:38 2022] GET /identity/v3/users/70a3f2a158524f4eb65391e71dffc61b => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:38.904882 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0680b0-d8e7-4062-a48d-485476e780e2 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:38.933046 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a173e3c-d4b3-4360-a6ca-2d6771850bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:38.933662 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a173e3c-d4b3-4360-a6ca-2d6771850bc8 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:38.933951 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a173e3c-d4b3-4360-a6ca-2d6771850bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:38.934232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a173e3c-d4b3-4360-a6ca-2d6771850bc8 None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:38.934951 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a173e3c-d4b3-4360-a6ca-2d6771850bc8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:38.935168 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:38.935280 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a173e3c-d4b3-4360-a6ca-2d6771850bc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:38.936781 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a173e3c-d4b3-4360-a6ca-2d6771850bc8 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:38.944660 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 91/185] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:38:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:38.945489 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a173e3c-d4b3-4360-a6ca-2d6771850bc8 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:39.010448 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0680b0-d8e7-4062-a48d-485476e780e2 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:39.045598 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f0520b-db23-421e-aea8-8bacd54d9c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:39.046276 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0520b-db23-421e-aea8-8bacd54d9c92 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:39.046551 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0520b-db23-421e-aea8-8bacd54d9c92 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:39.046820 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f0520b-db23-421e-aea8-8bacd54d9c92 None admin] PATH_INFO: `/v3/projects/bb5564ea35cb4871823a95b50fd471c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:39.047975 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f0520b-db23-421e-aea8-8bacd54d9c92 None admin] RBAC: Authorizing `identity:get_project(project_id=bb5564ea35cb4871823a95b50fd471c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:39.048704 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a173e3c-d4b3-4360-a6ca-2d6771850bc8 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:39.049427 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f0520b-db23-421e-aea8-8bacd54d9c92 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:39.051125 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 95/186] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:38:38 2022] GET /identity/v3/projects/bb5564ea35cb4871823a95b50fd471c7 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:39.055245 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb2fbb-2281-41dc-92de-a34b4cc5ab4b None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:39.055532 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb2fbb-2281-41dc-92de-a34b4cc5ab4b None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:39.056215 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb2fbb-2281-41dc-92de-a34b4cc5ab4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:39.058074 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:39.074710 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-94bb2fbb-2281-41dc-92de-a34b4cc5ab4b None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:39.075910 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-94bb2fbb-2281-41dc-92de-a34b4cc5ab4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:39.084520 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7632c-a038-4ecc-8af4-666064c8180a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:39.085145 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7632c-a038-4ecc-8af4-666064c8180a None admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:39.085420 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7632c-a038-4ecc-8af4-666064c8180a None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:39.085688 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7632c-a038-4ecc-8af4-666064c8180a None admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:39.086402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b7632c-a038-4ecc-8af4-666064c8180a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:39.087857 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b7632c-a038-4ecc-8af4-666064c8180a None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:39.108219 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 92/187] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 04:38:38 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:38:39.109061 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7632c-a038-4ecc-8af4-666064c8180a None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:39.164645 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 96/188] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:39.179674 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb2fbb-2281-41dc-92de-a34b4cc5ab4b None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:39.216125 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:39.227860 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7632c-a038-4ecc-8af4-666064c8180a None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:39.271911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383c2c2-86fd-4e83-9059-8e04d54ef4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:39.272594 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383c2c2-86fd-4e83-9059-8e04d54ef4f0 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:39.272873 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383c2c2-86fd-4e83-9059-8e04d54ef4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:39.273161 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383c2c2-86fd-4e83-9059-8e04d54ef4f0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:39.286457 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383c2c2-86fd-4e83-9059-8e04d54ef4f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:39.291955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-3383c2c2-86fd-4e83-9059-8e04d54ef4f0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 04:38:39.291955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:39.291955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:39.291955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:39.291955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:39.291955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:39.291955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:39.291955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:39.291955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:39.291955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:39.291955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:39.291955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:39.291955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:39.291955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:39.291955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:39.291955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:39.292883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:39.292883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:39.292883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:39.292883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:39.292883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:39.292883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:39.292883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:39.292883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:39.292883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:39.292883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:39.292883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:39.292883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:39.292883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:39.292883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:39.292883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:39.292883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:39.293851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:39.293851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:39.293851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:39.293851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:39.293851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:39.293851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:39.293851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:39.293851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:39.293851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:39.293851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:39.293851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 04:38:39.293851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:38:39.293851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 93/189] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 04:38:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:38:39.294945 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383c2c2-86fd-4e83-9059-8e04d54ef4f0 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:39.304612 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb2fbb-2281-41dc-92de-a34b4cc5ab4b None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:39.324898 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:39.346378 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2fe1f-6bf7-4386-a38d-7859b12619f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:39.347021 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2fe1f-6bf7-4386-a38d-7859b12619f8 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:39.347299 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2fe1f-6bf7-4386-a38d-7859b12619f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:39.347567 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2fe1f-6bf7-4386-a38d-7859b12619f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:39.437580 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383c2c2-86fd-4e83-9059-8e04d54ef4f0 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:39.445642 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2fe1f-6bf7-4386-a38d-7859b12619f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:39.451670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2fe1f-6bf7-4386-a38d-7859b12619f8 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:39.478468 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb965de-9e18-407c-a9fd-b33785622542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:39.479283 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb965de-9e18-407c-a9fd-b33785622542 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:39.479660 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb965de-9e18-407c-a9fd-b33785622542 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:39.480026 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb965de-9e18-407c-a9fd-b33785622542 None admin] PATH_INFO: `/v3/users/8642547c7ad141c781260b96841e6fa3` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:39.497376 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb965de-9e18-407c-a9fd-b33785622542 None admin] RBAC: Authorizing `identity:get_user(user_id=8642547c7ad141c781260b96841e6fa3)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:39.499088 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb965de-9e18-407c-a9fd-b33785622542 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:39.501266 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:39.501415 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 94/190] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:39 2022] GET /identity/v3/users/8642547c7ad141c781260b96841e6fa3 => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:39.502572 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb965de-9e18-407c-a9fd-b33785622542 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:39.602438 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:39.609575 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 97/191] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:38:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:39.610864 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2fe1f-6bf7-4386-a38d-7859b12619f8 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:39.625911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb965de-9e18-407c-a9fd-b33785622542 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:39.664124 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633d0dd-7ab8-45ad-9778-458d869b8068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:39.664769 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633d0dd-7ab8-45ad-9778-458d869b8068 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:39.665050 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633d0dd-7ab8-45ad-9778-458d869b8068 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:39.665320 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633d0dd-7ab8-45ad-9778-458d869b8068 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:39.666189 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633d0dd-7ab8-45ad-9778-458d869b8068 None admin] RBAC: Adding query filter params (role.id=201d465b851546b1a19c322a3356d48d, scope.project.id=bb5564ea35cb4871823a95b50fd471c7, user.id=70a3f2a158524f4eb65391e71dffc61b) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:39.666888 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633d0dd-7ab8-45ad-9778-458d869b8068 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:39.667985 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633d0dd-7ab8-45ad-9778-458d869b8068 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:39.674622 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 95/192] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:38:39 2022] GET /identity/v3/role_assignments?user.id=70a3f2a158524f4eb65391e71dffc61b&scope.project.id=bb5564ea35cb4871823a95b50fd471c7&role.id=201d465b851546b1a19c322a3356d48d => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:39.675270 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633d0dd-7ab8-45ad-9778-458d869b8068 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:39.746011 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2fe1f-6bf7-4386-a38d-7859b12619f8 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:39.790393 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:39.806189 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c88f6f-e8ed-4ee2-b582-55225f44650d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:39.806875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c88f6f-e8ed-4ee2-b582-55225f44650d None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:39.807157 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c88f6f-e8ed-4ee2-b582-55225f44650d None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:39.807428 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c88f6f-e8ed-4ee2-b582-55225f44650d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:39.832753 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c88f6f-e8ed-4ee2-b582-55225f44650d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:39.838911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-81c88f6f-e8ed-4ee2-b582-55225f44650d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 04:38:39.838911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:39.838911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:39.838911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:39.838911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:39.838911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:39.838911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:39.838911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:39.838911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:39.838911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:39.838911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:39.838911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:39.838911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:39.838911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:39.838911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:39.838911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:39.839875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:39.839875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:39.839875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:39.839875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:39.839875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:39.839875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:39.839875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:39.839875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:39.839875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:39.839875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:39.839875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:39.839875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:39.839875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:39.839875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:39.839875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:39.839875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:39.840673 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:39.840673 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:39.840673 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:39.840673 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:39.840673 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:39.840673 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:39.840673 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:39.840673 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:39.840673 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:39.840673 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:39.840673 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 04:38:39.840673 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:38:39.840673 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 98/193] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:38:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:38:39.842038 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c88f6f-e8ed-4ee2-b582-55225f44650d None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:39.883890 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633d0dd-7ab8-45ad-9778-458d869b8068 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:39.938514 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f1ca7-751d-4c7a-b898-6645a7d5f5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:39.939429 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f1ca7-751d-4c7a-b898-6645a7d5f5b2 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:39.939720 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f1ca7-751d-4c7a-b898-6645a7d5f5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:39.939991 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f1ca7-751d-4c7a-b898-6645a7d5f5b2 None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:39.940729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f1ca7-751d-4c7a-b898-6645a7d5f5b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:39.941279 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f1ca7-751d-4c7a-b898-6645a7d5f5b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:39.943314 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f1ca7-751d-4c7a-b898-6645a7d5f5b2 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:39.955522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 96/194] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:38:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:39.960134 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f1ca7-751d-4c7a-b898-6645a7d5f5b2 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:39.978171 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:39.995110 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c88f6f-e8ed-4ee2-b582-55225f44650d None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:40.046187 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1e257-85d8-40fe-8085-4d50c1a98c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:40.047170 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1e257-85d8-40fe-8085-4d50c1a98c99 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:40.047643 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1e257-85d8-40fe-8085-4d50c1a98c99 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:40.048104 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1e257-85d8-40fe-8085-4d50c1a98c99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:40.094207 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f1ca7-751d-4c7a-b898-6645a7d5f5b2 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:40.124408 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:40.133933 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f295a-bf77-476b-b96b-adcce04bfe57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:40.134833 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f295a-bf77-476b-b96b-adcce04bfe57 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:40.135189 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f295a-bf77-476b-b96b-adcce04bfe57 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:40.135528 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0f295a-bf77-476b-b96b-adcce04bfe57 None admin] PATH_INFO: `/v3/projects/bb5564ea35cb4871823a95b50fd471c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:40.139074 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f295a-bf77-476b-b96b-adcce04bfe57 None admin] RBAC: Authorizing `identity:get_project(project_id=bb5564ea35cb4871823a95b50fd471c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:40.139395 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1e257-85d8-40fe-8085-4d50c1a98c99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:40.140716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0f295a-bf77-476b-b96b-adcce04bfe57 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:40.141250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1e257-85d8-40fe-8085-4d50c1a98c99 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:40.142690 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 97/195] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:38:39 2022] GET /identity/v3/projects/bb5564ea35cb4871823a95b50fd471c7 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:40.143534 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f295a-bf77-476b-b96b-adcce04bfe57 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:40.235017 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:40.266278 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0f295a-bf77-476b-b96b-adcce04bfe57 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:40.273196 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 99/196] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:38:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:40.273196 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1e257-85d8-40fe-8085-4d50c1a98c99 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:40.312635 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee25500-b8c2-4ef3-a733-4a871bdd4c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:40.313337 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee25500-b8c2-4ef3-a733-4a871bdd4c25 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:40.313777 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee25500-b8c2-4ef3-a733-4a871bdd4c25 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:40.314193 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee25500-b8c2-4ef3-a733-4a871bdd4c25 None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:40.315078 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee25500-b8c2-4ef3-a733-4a871bdd4c25 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:40.315499 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee25500-b8c2-4ef3-a733-4a871bdd4c25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:40.317016 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee25500-b8c2-4ef3-a733-4a871bdd4c25 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:40.327053 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 98/197] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 04:38:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:40.332537 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee25500-b8c2-4ef3-a733-4a871bdd4c25 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:40.386417 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:40.400528 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1e257-85d8-40fe-8085-4d50c1a98c99 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:40.439898 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb8a01-b51e-46fe-a11a-06b62089e881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:40.440766 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb8a01-b51e-46fe-a11a-06b62089e881 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:40.441142 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb8a01-b51e-46fe-a11a-06b62089e881 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:40.441531 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb8a01-b51e-46fe-a11a-06b62089e881 None admin] PATH_INFO: `/v3/users/8642547c7ad141c781260b96841e6fa3` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:40.442880 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb8a01-b51e-46fe-a11a-06b62089e881 None admin] RBAC: Authorizing `identity:get_user(user_id=8642547c7ad141c781260b96841e6fa3)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:40.443045 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee25500-b8c2-4ef3-a733-4a871bdd4c25 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:40.444632 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb8a01-b51e-46fe-a11a-06b62089e881 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:40.446720 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 100/198] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:40 2022] GET /identity/v3/users/8642547c7ad141c781260b96841e6fa3 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:40.447647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb8a01-b51e-46fe-a11a-06b62089e881 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:40.492350 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b474c-c234-4095-bf12-8ded41d2fa6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:40.492978 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b474c-c234-4095-bf12-8ded41d2fa6f None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:40.493257 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b474c-c234-4095-bf12-8ded41d2fa6f None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:40.493531 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b474c-c234-4095-bf12-8ded41d2fa6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:40.494790 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b474c-c234-4095-bf12-8ded41d2fa6f None admin] RBAC: Adding query filter params (role.id=e2b16a5edd7b472487fac12492349bc7, scope.project.id=bb5564ea35cb4871823a95b50fd471c7, user.id=70a3f2a158524f4eb65391e71dffc61b) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:40.495101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b474c-c234-4095-bf12-8ded41d2fa6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:40.496962 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b474c-c234-4095-bf12-8ded41d2fa6f None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:40.505263 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 99/199] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:38:40 2022] GET /identity/v3/role_assignments?user.id=70a3f2a158524f4eb65391e71dffc61b&scope.project.id=bb5564ea35cb4871823a95b50fd471c7&role.id=e2b16a5edd7b472487fac12492349bc7 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:40.505946 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b474c-c234-4095-bf12-8ded41d2fa6f None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:40.509366 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:40.576841 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb8a01-b51e-46fe-a11a-06b62089e881 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:40.631338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b474c-c234-4095-bf12-8ded41d2fa6f None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:40.662405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc98b6-0a11-42de-b285-79d19a9a3650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:40.663605 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc98b6-0a11-42de-b285-79d19a9a3650 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:40.664351 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc98b6-0a11-42de-b285-79d19a9a3650 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:40.664876 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc98b6-0a11-42de-b285-79d19a9a3650 None admin] PATH_INFO: `/v3/projects/e8127522c84e4d4e989b25defd999d24` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:40.671210 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc98b6-0a11-42de-b285-79d19a9a3650 None admin] RBAC: Authorizing `identity:get_project(project_id=e8127522c84e4d4e989b25defd999d24)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:40.673137 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc98b6-0a11-42de-b285-79d19a9a3650 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:40.675587 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 101/200] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:38:40 2022] GET /identity/v3/projects/e8127522c84e4d4e989b25defd999d24 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:40.676658 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc98b6-0a11-42de-b285-79d19a9a3650 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:40.682633 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7180045-79b2-47dd-a069-e1dec86caa73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:40.683326 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7180045-79b2-47dd-a069-e1dec86caa73 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:40.683588 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7180045-79b2-47dd-a069-e1dec86caa73 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:40.683855 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7180045-79b2-47dd-a069-e1dec86caa73 None admin] PATH_INFO: `/v3/users/29c9039ffaad443c9479009a4dd33c58` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:40.688664 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7180045-79b2-47dd-a069-e1dec86caa73 None admin] RBAC: Authorizing `identity:get_user(user_id=29c9039ffaad443c9479009a4dd33c58)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:40.688664 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7180045-79b2-47dd-a069-e1dec86caa73 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:40.688664 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 100/201] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:40 2022] GET /identity/v3/users/29c9039ffaad443c9479009a4dd33c58 => generated 289 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:40.689437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7180045-79b2-47dd-a069-e1dec86caa73 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:40.747695 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:40.772963 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:40.812735 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7180045-79b2-47dd-a069-e1dec86caa73 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:40.846302 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc98b6-0a11-42de-b285-79d19a9a3650 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:40.856675 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e6034-a418-4416-8ca8-1ff552465791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:40.857312 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e6034-a418-4416-8ca8-1ff552465791 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:40.857589 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e6034-a418-4416-8ca8-1ff552465791 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:40.857860 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e6034-a418-4416-8ca8-1ff552465791 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:40.858755 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e6034-a418-4416-8ca8-1ff552465791 None admin] RBAC: Adding query filter params (role.id=2bfdd65b06554a6da967b3939da753c7, scope.project.id=e8127522c84e4d4e989b25defd999d24, user.id=8642547c7ad141c781260b96841e6fa3) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:40.859062 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e6034-a418-4416-8ca8-1ff552465791 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:40.860935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e6034-a418-4416-8ca8-1ff552465791 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:40.868802 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 101/202] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:38:40 2022] GET /identity/v3/role_assignments?user.id=8642547c7ad141c781260b96841e6fa3&scope.project.id=e8127522c84e4d4e989b25defd999d24&role.id=2bfdd65b06554a6da967b3939da753c7 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:40.873157 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e6034-a418-4416-8ca8-1ff552465791 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:40.888778 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7c3fb-97e6-4021-be34-99911b314bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:40.889960 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7c3fb-97e6-4021-be34-99911b314bec None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:40.890465 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7c3fb-97e6-4021-be34-99911b314bec None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:40.890950 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7c3fb-97e6-4021-be34-99911b314bec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:40.975240 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf7c3fb-97e6-4021-be34-99911b314bec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:40.977341 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf7c3fb-97e6-4021-be34-99911b314bec None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:41.010701 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:41.036915 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e6034-a418-4416-8ca8-1ff552465791 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:41.096172 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490488a4-3850-4a1e-b95f-8288ce867931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:41.096924 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490488a4-3850-4a1e-b95f-8288ce867931 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:41.097168 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490488a4-3850-4a1e-b95f-8288ce867931 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:41.097326 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490488a4-3850-4a1e-b95f-8288ce867931 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:41.104759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:41.110262 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 102/203] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:38:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:41.118005 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7c3fb-97e6-4021-be34-99911b314bec None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:41.214212 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490488a4-3850-4a1e-b95f-8288ce867931 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:41.216424 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490488a4-3850-4a1e-b95f-8288ce867931 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:41.294936 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7c3fb-97e6-4021-be34-99911b314bec None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:41.355887 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:41.374432 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc573f0-4401-4a18-8ece-d036e1388bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:41.375094 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc573f0-4401-4a18-8ece-d036e1388bf2 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:41.375369 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc573f0-4401-4a18-8ece-d036e1388bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:41.375638 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc573f0-4401-4a18-8ece-d036e1388bf2 None admin] PATH_INFO: `/v3/projects/e8127522c84e4d4e989b25defd999d24` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:41.376851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc573f0-4401-4a18-8ece-d036e1388bf2 None admin] RBAC: Authorizing `identity:get_project(project_id=e8127522c84e4d4e989b25defd999d24)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:41.378347 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc573f0-4401-4a18-8ece-d036e1388bf2 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:41.381202 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 103/204] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:38:41 2022] GET /identity/v3/projects/e8127522c84e4d4e989b25defd999d24 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:41.387194 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc573f0-4401-4a18-8ece-d036e1388bf2 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:41.409277 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 102/205] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:38:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:41.415073 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490488a4-3850-4a1e-b95f-8288ce867931 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:41.482452 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:41.549256 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc573f0-4401-4a18-8ece-d036e1388bf2 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:41.570724 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490488a4-3850-4a1e-b95f-8288ce867931 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:41.588441 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd02798-8ede-4904-9cd2-4ca4eb7c7330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:41.589362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd02798-8ede-4904-9cd2-4ca4eb7c7330 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:41.589791 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd02798-8ede-4904-9cd2-4ca4eb7c7330 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:41.590220 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd02798-8ede-4904-9cd2-4ca4eb7c7330 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:41.591157 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd02798-8ede-4904-9cd2-4ca4eb7c7330 None admin] RBAC: Adding query filter params (role.id=e2b16a5edd7b472487fac12492349bc7, scope.project.id=e8127522c84e4d4e989b25defd999d24, user.id=8642547c7ad141c781260b96841e6fa3) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:41.591603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd02798-8ede-4904-9cd2-4ca4eb7c7330 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:41.593199 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd02798-8ede-4904-9cd2-4ca4eb7c7330 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:41.606592 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 104/206] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:38:41 2022] GET /identity/v3/role_assignments?user.id=8642547c7ad141c781260b96841e6fa3&scope.project.id=e8127522c84e4d4e989b25defd999d24&role.id=e2b16a5edd7b472487fac12492349bc7 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:41.608329 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a26a9d-5ec0-4289-9e3d-b164834a5e54 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:41.608755 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a26a9d-5ec0-4289-9e3d-b164834a5e54 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:41.609163 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a26a9d-5ec0-4289-9e3d-b164834a5e54 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:41.610907 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 105/207] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:41.616780 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfcf7a-2d19-44a4-bc67-b962c1b6ee06 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:41.617459 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfcf7a-2d19-44a4-bc67-b962c1b6ee06 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:41.617868 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfcf7a-2d19-44a4-bc67-b962c1b6ee06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:41.622582 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f642da-1962-4e7c-becd-6bec81d8462b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:41.623317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f642da-1962-4e7c-becd-6bec81d8462b None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:41.623608 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f642da-1962-4e7c-becd-6bec81d8462b None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:41.623883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f642da-1962-4e7c-becd-6bec81d8462b None admin] PATH_INFO: `/v3/projects/bb5564ea35cb4871823a95b50fd471c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:41.625092 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f642da-1962-4e7c-becd-6bec81d8462b None admin] RBAC: Authorizing `identity:get_project(project_id=bb5564ea35cb4871823a95b50fd471c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:41.628062 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f642da-1962-4e7c-becd-6bec81d8462b None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:41.629814 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 103/208] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:38:41 2022] GET /identity/v3/projects/bb5564ea35cb4871823a95b50fd471c7 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:38:41.639122 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f642da-1962-4e7c-becd-6bec81d8462b None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:41.640737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-bedfcf7a-2d19-44a4-bc67-b962c1b6ee06 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:41.642090 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-bedfcf7a-2d19-44a4-bc67-b962c1b6ee06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:41.704294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:41.728532 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 106/209] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:41.768679 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfcf7a-2d19-44a4-bc67-b962c1b6ee06 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:41.846621 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f642da-1962-4e7c-becd-6bec81d8462b None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:41.849494 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:41.890267 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af8005-e2dd-4f9e-a4c6-dfe808f4a878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:41.890890 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af8005-e2dd-4f9e-a4c6-dfe808f4a878 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:41.891101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af8005-e2dd-4f9e-a4c6-dfe808f4a878 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:41.891370 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af8005-e2dd-4f9e-a4c6-dfe808f4a878 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:41.892220 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af8005-e2dd-4f9e-a4c6-dfe808f4a878 None admin] RBAC: Adding query filter params (role.id=b4b41ae21c5744628519a58257d04609, scope.project.id=bb5564ea35cb4871823a95b50fd471c7, user.id=29c9039ffaad443c9479009a4dd33c58) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:41.892492 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af8005-e2dd-4f9e-a4c6-dfe808f4a878 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:41.893969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af8005-e2dd-4f9e-a4c6-dfe808f4a878 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:41.900421 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 104/210] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:38:41 2022] GET /identity/v3/role_assignments?user.id=29c9039ffaad443c9479009a4dd33c58&scope.project.id=bb5564ea35cb4871823a95b50fd471c7&role.id=b4b41ae21c5744628519a58257d04609 => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:41.901872 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2bb3c-92eb-49f1-8d11-8d0be47e96e7 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:41.902013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2bb3c-92eb-49f1-8d11-8d0be47e96e7 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:41.902286 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb2bb3c-92eb-49f1-8d11-8d0be47e96e7 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:41.903556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 105/211] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:41.909466 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df0fe2-0450-4e1c-ac01-33160caf72b5 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:41.909910 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df0fe2-0450-4e1c-ac01-33160caf72b5 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:41.910039 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df0fe2-0450-4e1c-ac01-33160caf72b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:41.912357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfcf7a-2d19-44a4-bc67-b962c1b6ee06 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:41.930320 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-d9df0fe2-0450-4e1c-ac01-33160caf72b5 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:41.931568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-d9df0fe2-0450-4e1c-ac01-33160caf72b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:41.950714 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12398948-af17-43d5-843e-e958f0eb565e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:41.952111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12398948-af17-43d5-843e-e958f0eb565e None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:41.952584 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12398948-af17-43d5-843e-e958f0eb565e None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:41.953045 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12398948-af17-43d5-843e-e958f0eb565e None admin] PATH_INFO: `/v3/roles/member` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:41.965070 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12398948-af17-43d5-843e-e958f0eb565e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:41.970547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-12398948-af17-43d5-843e-e958f0eb565e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:38:41.970547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:41.970547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:41.970547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:41.970547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:41.970547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:41.970547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:41.970547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:41.970547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:41.970547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:41.970547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:41.970547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:41.970547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:41.970547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:41.970547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:41.970547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:41.971472 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:41.971472 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:41.971472 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:41.971472 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:41.971472 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:41.971472 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:41.971472 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:41.971472 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:41.971472 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:41.971472 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:41.971472 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:41.971472 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:41.971472 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:41.971472 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:41.971472 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:41.971472 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:41.972265 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:41.972265 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:41.972265 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:41.972265 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:41.972265 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:41.972265 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:41.972265 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:41.972265 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:41.972265 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:41.972265 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:41.972265 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:38:41.972265 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:38:41.974791 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 107/212] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:38:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:38:41.983036 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12398948-af17-43d5-843e-e958f0eb565e None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:42.011984 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 106/213] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:42.042007 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df0fe2-0450-4e1c-ac01-33160caf72b5 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:42.070009 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:42.172887 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:42.174388 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12398948-af17-43d5-843e-e958f0eb565e None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:42.187987 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df0fe2-0450-4e1c-ac01-33160caf72b5 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:42.231613 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a053f-8949-4828-9eff-acc8bd01c8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:42.232287 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a053f-8949-4828-9eff-acc8bd01c8f4 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:42.232665 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a053f-8949-4828-9eff-acc8bd01c8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:42.232943 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a053f-8949-4828-9eff-acc8bd01c8f4 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:42.233673 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a053f-8949-4828-9eff-acc8bd01c8f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:42.233999 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a053f-8949-4828-9eff-acc8bd01c8f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:42.235459 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a053f-8949-4828-9eff-acc8bd01c8f4 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:42.239393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16b55f-1694-445d-bb35-80ed99a9c4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:42.240325 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16b55f-1694-445d-bb35-80ed99a9c4e2 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:42.240792 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16b55f-1694-445d-bb35-80ed99a9c4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:42.241249 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee16b55f-1694-445d-bb35-80ed99a9c4e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:42.244740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16b55f-1694-445d-bb35-80ed99a9c4e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:42.245920 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 108/214] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 04:38:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:42.246801 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee16b55f-1694-445d-bb35-80ed99a9c4e2 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:42.248920 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 107/215] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:38:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:38:42.254660 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a053f-8949-4828-9eff-acc8bd01c8f4 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:42.256209 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16b55f-1694-445d-bb35-80ed99a9c4e2 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:42.396829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee16b55f-1694-445d-bb35-80ed99a9c4e2 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:42.404543 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a053f-8949-4828-9eff-acc8bd01c8f4 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:42.421034 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:42.445880 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d83fd8-d921-419d-8931-ff87e50774a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:42.446574 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d83fd8-d921-419d-8931-ff87e50774a4 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:42.446855 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d83fd8-d921-419d-8931-ff87e50774a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:42.447126 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d83fd8-d921-419d-8931-ff87e50774a4 None admin] PATH_INFO: `/v3/users/1f49c9200b90405ca61539dd500d3e3d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:42.447940 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8e5f6-18ce-4fd6-8fba-34680881a083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:42.448594 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8e5f6-18ce-4fd6-8fba-34680881a083 None admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:42.448872 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8e5f6-18ce-4fd6-8fba-34680881a083 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:42.449148 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8e5f6-18ce-4fd6-8fba-34680881a083 None admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:42.449864 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8e5f6-18ce-4fd6-8fba-34680881a083 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:42.451882 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8e5f6-18ce-4fd6-8fba-34680881a083 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:42.465610 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d83fd8-d921-419d-8931-ff87e50774a4 None admin] RBAC: Authorizing `identity:get_user(user_id=1f49c9200b90405ca61539dd500d3e3d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:42.467496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d83fd8-d921-419d-8931-ff87e50774a4 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:42.469392 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 108/216] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:42 2022] GET /identity/v3/users/1f49c9200b90405ca61539dd500d3e3d => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:42.475368 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d83fd8-d921-419d-8931-ff87e50774a4 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:42.481775 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 109/217] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 04:38:42 2022] POST /identity/v3/users => generated 297 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:38:42.515042 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:42.599954 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d83fd8-d921-419d-8931-ff87e50774a4 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:42.637451 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459abbb3-a371-4487-af45-8d1b915f4acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:42.638164 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459abbb3-a371-4487-af45-8d1b915f4acb None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:42.638442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459abbb3-a371-4487-af45-8d1b915f4acb None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:42.638711 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459abbb3-a371-4487-af45-8d1b915f4acb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:42.721473 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459abbb3-a371-4487-af45-8d1b915f4acb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:42.722937 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459abbb3-a371-4487-af45-8d1b915f4acb None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:42.748535 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:42.831172 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 109/218] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:38:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 04:38:42.836880 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8e5f6-18ce-4fd6-8fba-34680881a083 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:42.951598 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8e5f6-18ce-4fd6-8fba-34680881a083 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:42.988911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9ac91-52c8-4e88-8d04-07c9c16104c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:42.989861 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9ac91-52c8-4e88-8d04-07c9c16104c1 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:42.990345 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9ac91-52c8-4e88-8d04-07c9c16104c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:42.990802 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9ac91-52c8-4e88-8d04-07c9c16104c1 None admin] PATH_INFO: `/v3/projects/e8127522c84e4d4e989b25defd999d24` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:42.992259 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9ac91-52c8-4e88-8d04-07c9c16104c1 None admin] RBAC: Authorizing `identity:get_project(project_id=e8127522c84e4d4e989b25defd999d24)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:42.993902 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9ac91-52c8-4e88-8d04-07c9c16104c1 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:42.995824 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 110/219] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:38:42 2022] GET /identity/v3/projects/e8127522c84e4d4e989b25defd999d24 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:43.001890 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459abbb3-a371-4487-af45-8d1b915f4acb None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:43.109850 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459abbb3-a371-4487-af45-8d1b915f4acb None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:43.134475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:43.147982 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1e297-12c4-46e8-adeb-0f4eee1f6941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:43.148720 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1e297-12c4-46e8-adeb-0f4eee1f6941 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:43.148997 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1e297-12c4-46e8-adeb-0f4eee1f6941 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:43.149269 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1e297-12c4-46e8-adeb-0f4eee1f6941 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:43.150098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a1e297-12c4-46e8-adeb-0f4eee1f6941 None admin] RBAC: Adding query filter params (role.id=201d465b851546b1a19c322a3356d48d, scope.project.id=e8127522c84e4d4e989b25defd999d24, user.id=1f49c9200b90405ca61539dd500d3e3d) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:43.150408 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a1e297-12c4-46e8-adeb-0f4eee1f6941 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:43.151893 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a1e297-12c4-46e8-adeb-0f4eee1f6941 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:43.160831 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 110/220] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:38:43 2022] GET /identity/v3/role_assignments?user.id=1f49c9200b90405ca61539dd500d3e3d&scope.project.id=e8127522c84e4d4e989b25defd999d24&role.id=201d465b851546b1a19c322a3356d48d => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:43.278892 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0df1bc-e202-4c54-a0f9-66f3f18c5cfd None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:43.279552 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0df1bc-e202-4c54-a0f9-66f3f18c5cfd None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:43.280032 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0df1bc-e202-4c54-a0f9-66f3f18c5cfd None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:43.281683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 111/221] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:43.288881 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d47d0b-237f-4f49-bf4e-75409393a2d4 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:43.289379 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d47d0b-237f-4f49-bf4e-75409393a2d4 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:43.289481 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d47d0b-237f-4f49-bf4e-75409393a2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:43.319786 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-44d47d0b-237f-4f49-bf4e-75409393a2d4 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:43.321114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-44d47d0b-237f-4f49-bf4e-75409393a2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:43.419980 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 111/222] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:43.454342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0df1bc-e202-4c54-a0f9-66f3f18c5cfd None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:43.497011 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:43.568539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0df1bc-e202-4c54-a0f9-66f3f18c5cfd None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:43.604008 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbf3d2-3b56-4d5f-9fe3-4bbaeca28d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:43.604660 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbf3d2-3b56-4d5f-9fe3-4bbaeca28d06 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:43.604934 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbf3d2-3b56-4d5f-9fe3-4bbaeca28d06 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:43.605199 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cbf3d2-3b56-4d5f-9fe3-4bbaeca28d06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:43.616790 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cbf3d2-3b56-4d5f-9fe3-4bbaeca28d06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:43.621799 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-66cbf3d2-3b56-4d5f-9fe3-4bbaeca28d06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:38:43.621799 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:43.621799 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:43.621799 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:43.621799 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:43.621799 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:43.621799 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:43.621799 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:43.621799 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:43.621799 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:43.621799 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:43.621799 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:43.621799 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:43.621799 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:43.621799 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:43.621799 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:43.622733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:43.622733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:43.622733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:43.622733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:43.622733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:43.622733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:43.622733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:43.622733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:43.622733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:43.622733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:43.622733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:43.622733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:43.622733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:43.622733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:43.622733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:43.622733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:43.623529 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:43.623529 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:43.623529 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:43.623529 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:43.623529 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:43.623529 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:43.623529 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:43.623529 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:43.623529 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:43.623529 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:43.623529 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:38:43.623529 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:38:43.623529 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 112/223] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:38:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:38:43.629081 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d47d0b-237f-4f49-bf4e-75409393a2d4 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:43.728340 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d47d0b-237f-4f49-bf4e-75409393a2d4 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:43.745092 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:43.776073 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa5e50-99ae-4202-93df-413dc9be9456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:43.776711 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa5e50-99ae-4202-93df-413dc9be9456 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:43.776988 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa5e50-99ae-4202-93df-413dc9be9456 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:43.777257 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa5e50-99ae-4202-93df-413dc9be9456 None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:43.778003 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa5e50-99ae-4202-93df-413dc9be9456 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:43.778311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa5e50-99ae-4202-93df-413dc9be9456 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:43.779713 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa5e50-99ae-4202-93df-413dc9be9456 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:43.790892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 112/224] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:38:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:43.796697 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbf3d2-3b56-4d5f-9fe3-4bbaeca28d06 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:43.924010 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:43.930871 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cbf3d2-3b56-4d5f-9fe3-4bbaeca28d06 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:43.975597 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c5db6-b397-49a5-85df-22afa1e2eb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:43.976291 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c5db6-b397-49a5-85df-22afa1e2eb65 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:43.976566 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c5db6-b397-49a5-85df-22afa1e2eb65 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:43.976835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c5db6-b397-49a5-85df-22afa1e2eb65 None admin] PATH_INFO: `/v3/users/8642547c7ad141c781260b96841e6fa3` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:43.978027 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c5db6-b397-49a5-85df-22afa1e2eb65 None admin] RBAC: Authorizing `identity:get_user(user_id=8642547c7ad141c781260b96841e6fa3)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:43.979496 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c5db6-b397-49a5-85df-22afa1e2eb65 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:43.981478 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 113/225] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:43 2022] GET /identity/v3/users/8642547c7ad141c781260b96841e6fa3 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:43.987013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa5e50-99ae-4202-93df-413dc9be9456 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:44.134858 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa5e50-99ae-4202-93df-413dc9be9456 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:44.182750 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab2494-6f1c-4a94-935d-7b1c7b5b0a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:44.183667 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab2494-6f1c-4a94-935d-7b1c7b5b0a8b None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:44.184126 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab2494-6f1c-4a94-935d-7b1c7b5b0a8b None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:44.184565 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab2494-6f1c-4a94-935d-7b1c7b5b0a8b None admin] PATH_INFO: `/v3/projects/e8127522c84e4d4e989b25defd999d24` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:44.186025 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab2494-6f1c-4a94-935d-7b1c7b5b0a8b None admin] RBAC: Authorizing `identity:get_project(project_id=e8127522c84e4d4e989b25defd999d24)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:44.187706 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab2494-6f1c-4a94-935d-7b1c7b5b0a8b None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:44.189597 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 113/226] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:38:43 2022] GET /identity/v3/projects/e8127522c84e4d4e989b25defd999d24 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:44.195824 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c5db6-b397-49a5-85df-22afa1e2eb65 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:44.207751 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947212d0-2690-460e-a8e8-0a9076555542 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:44.208288 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947212d0-2690-460e-a8e8-0a9076555542 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:44.208694 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947212d0-2690-460e-a8e8-0a9076555542 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:44.210291 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 114/227] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:38:44.219325 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286883bc-19e3-4a6f-8dc0-2987350bd4c0 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:44.219861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286883bc-19e3-4a6f-8dc0-2987350bd4c0 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:44.220269 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286883bc-19e3-4a6f-8dc0-2987350bd4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:44.255587 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-286883bc-19e3-4a6f-8dc0-2987350bd4c0 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:44.260400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-286883bc-19e3-4a6f-8dc0-2987350bd4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:44.354382 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:44.357950 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c5db6-b397-49a5-85df-22afa1e2eb65 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:44.403805 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 115/228] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 04:38:44.414188 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986069e-9bb1-48e6-98b0-307a329ef10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:44.414876 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986069e-9bb1-48e6-98b0-307a329ef10b None admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:44.415148 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986069e-9bb1-48e6-98b0-307a329ef10b None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:44.415420 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986069e-9bb1-48e6-98b0-307a329ef10b None admin] PATH_INFO: `/v3/projects/e8127522c84e4d4e989b25defd999d24/users/8642547c7ad141c781260b96841e6fa3/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:44.417428 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986069e-9bb1-48e6-98b0-307a329ef10b None admin] RBAC: Authorizing `identity:create_grant(project_id=e8127522c84e4d4e989b25defd999d24, user_id=8642547c7ad141c781260b96841e6fa3, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:44.418926 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986069e-9bb1-48e6-98b0-307a329ef10b None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:44.435990 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 114/229] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 04:38:44 2022] PUT /identity/v3/projects/e8127522c84e4d4e989b25defd999d24/users/8642547c7ad141c781260b96841e6fa3/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:38:44.440639 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286883bc-19e3-4a6f-8dc0-2987350bd4c0 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:44.584487 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286883bc-19e3-4a6f-8dc0-2987350bd4c0 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:44.632609 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00eb8db-aaf1-4d0d-9e1c-c1bb5ae27021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:44.633282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00eb8db-aaf1-4d0d-9e1c-c1bb5ae27021 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:44.633557 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00eb8db-aaf1-4d0d-9e1c-c1bb5ae27021 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:44.633827 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00eb8db-aaf1-4d0d-9e1c-c1bb5ae27021 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:44.645428 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00eb8db-aaf1-4d0d-9e1c-c1bb5ae27021 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:44.650584 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-e00eb8db-aaf1-4d0d-9e1c-c1bb5ae27021 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 04:38:44.650584 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:44.650584 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:44.650584 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:44.650584 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:44.650584 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:44.650584 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:44.650584 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:44.650584 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:44.650584 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:44.650584 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:44.650584 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:44.650584 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:44.650584 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:44.650584 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:44.650584 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:44.651496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:44.651496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:44.651496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:44.651496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:44.651496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:44.651496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:44.651496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:44.651496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:44.651496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:44.651496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:44.651496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:44.651496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:44.651496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:44.651496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:44.651496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:44.651496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:44.652293 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:44.652293 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:44.652293 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:44.652293 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:44.652293 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:44.652293 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:44.652293 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:44.652293 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:44.652293 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:44.652293 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:44.652293 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 04:38:44.652293 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:38:44.652293 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 116/230] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 04:38:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:38:44.657725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986069e-9bb1-48e6-98b0-307a329ef10b None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:44.709535 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:44.826305 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986069e-9bb1-48e6-98b0-307a329ef10b None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:44.871842 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52416bb4-c927-4ac2-825f-718afc3d1350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:44.872733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52416bb4-c927-4ac2-825f-718afc3d1350 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:44.873156 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52416bb4-c927-4ac2-825f-718afc3d1350 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:44.873668 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52416bb4-c927-4ac2-825f-718afc3d1350 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:44.874569 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52416bb4-c927-4ac2-825f-718afc3d1350 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:44.875011 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52416bb4-c927-4ac2-825f-718afc3d1350 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:44.876539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52416bb4-c927-4ac2-825f-718afc3d1350 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:44.886486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 115/231] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:38:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:44.892317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00eb8db-aaf1-4d0d-9e1c-c1bb5ae27021 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:44.939342 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:44.978374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931352c-845a-472d-9927-66946d45cdac None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:44.979406 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931352c-845a-472d-9927-66946d45cdac None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:44.979882 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931352c-845a-472d-9927-66946d45cdac None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:44.981825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 116/232] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:38:44.987777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0c04c-dfbc-4f02-b00b-20801eb1d960 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:44.988329 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0c04c-dfbc-4f02-b00b-20801eb1d960 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:44.988801 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0c04c-dfbc-4f02-b00b-20801eb1d960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:45.013525 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-c0b0c04c-dfbc-4f02-b00b-20801eb1d960 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:45.014999 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-c0b0c04c-dfbc-4f02-b00b-20801eb1d960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:45.046805 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00eb8db-aaf1-4d0d-9e1c-c1bb5ae27021 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:45.107040 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad10f3-084c-40bc-9edf-5c4d6ff4e0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:45.107746 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad10f3-084c-40bc-9edf-5c4d6ff4e0a5 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:45.108026 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad10f3-084c-40bc-9edf-5c4d6ff4e0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:45.108292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad10f3-084c-40bc-9edf-5c4d6ff4e0a5 None admin] PATH_INFO: `/v3/users/8642547c7ad141c781260b96841e6fa3` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:45.109932 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad10f3-084c-40bc-9edf-5c4d6ff4e0a5 None admin] RBAC: Authorizing `identity:get_user(user_id=8642547c7ad141c781260b96841e6fa3)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:45.111437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad10f3-084c-40bc-9edf-5c4d6ff4e0a5 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:45.118707 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 117/233] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:44 2022] GET /identity/v3/users/8642547c7ad141c781260b96841e6fa3 => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:45.121391 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 117/234] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 04:38:45.122272 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad10f3-084c-40bc-9edf-5c4d6ff4e0a5 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:45.156587 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0c04c-dfbc-4f02-b00b-20801eb1d960 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:45.178425 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:45.256821 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad10f3-084c-40bc-9edf-5c4d6ff4e0a5 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:45.259212 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:45.303412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b5d47-8e34-4d3f-a26e-8ac815a85328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:45.304075 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b5d47-8e34-4d3f-a26e-8ac815a85328 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:45.304418 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b5d47-8e34-4d3f-a26e-8ac815a85328 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:45.304688 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b5d47-8e34-4d3f-a26e-8ac815a85328 None admin] PATH_INFO: `/v3/projects/e8127522c84e4d4e989b25defd999d24` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:45.305861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b5d47-8e34-4d3f-a26e-8ac815a85328 None admin] RBAC: Authorizing `identity:get_project(project_id=e8127522c84e4d4e989b25defd999d24)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:45.307678 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b5d47-8e34-4d3f-a26e-8ac815a85328 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:45.318377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 118/235] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:38:45 2022] GET /identity/v3/projects/e8127522c84e4d4e989b25defd999d24 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:45.319471 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b5d47-8e34-4d3f-a26e-8ac815a85328 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:45.339639 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0c04c-dfbc-4f02-b00b-20801eb1d960 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:45.376067 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8ce5f-b4f2-47fe-bf40-5fd52f6f2ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:45.376724 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8ce5f-b4f2-47fe-bf40-5fd52f6f2ac0 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:45.376997 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8ce5f-b4f2-47fe-bf40-5fd52f6f2ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:45.377262 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8ce5f-b4f2-47fe-bf40-5fd52f6f2ac0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:45.388740 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc8ce5f-b4f2-47fe-bf40-5fd52f6f2ac0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:45.394144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-1bc8ce5f-b4f2-47fe-bf40-5fd52f6f2ac0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 04:38:45.394144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:45.394144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:45.394144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:45.394144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:45.394144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:45.394144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:45.394144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:45.394144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:45.394144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:45.394144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:45.394144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:45.394144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:45.394144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:45.394144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:45.394144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:45.395022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:45.395022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:45.395022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:45.395022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:45.395022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:45.395022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:45.395022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:45.395022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:45.395022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:45.395022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:45.395022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:45.395022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:45.395022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:45.395022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:45.395022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:45.395022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:45.395816 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:45.395816 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:45.395816 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:45.395816 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:45.395816 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:45.395816 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:45.395816 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:45.395816 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:45.395816 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:45.395816 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:45.395816 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 04:38:45.395816 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:38:45.395816 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 118/236] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:38:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:38:45.404847 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8ce5f-b4f2-47fe-bf40-5fd52f6f2ac0 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:45.423432 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b5d47-8e34-4d3f-a26e-8ac815a85328 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:45.459881 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973a2a1-784d-474d-bb5c-38ed526587db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:45.460777 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973a2a1-784d-474d-bb5c-38ed526587db None admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:45.461059 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973a2a1-784d-474d-bb5c-38ed526587db None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:45.461330 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973a2a1-784d-474d-bb5c-38ed526587db None admin] PATH_INFO: `/v3/projects/e8127522c84e4d4e989b25defd999d24/users/8642547c7ad141c781260b96841e6fa3/roles/e2b16a5edd7b472487fac12492349bc7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:45.463651 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973a2a1-784d-474d-bb5c-38ed526587db None admin] RBAC: Authorizing `identity:create_grant(project_id=e8127522c84e4d4e989b25defd999d24, user_id=8642547c7ad141c781260b96841e6fa3, role_id=e2b16a5edd7b472487fac12492349bc7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:45.465220 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7973a2a1-784d-474d-bb5c-38ed526587db None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:45.482516 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 119/237] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 04:38:45 2022] PUT /identity/v3/projects/e8127522c84e4d4e989b25defd999d24/users/8642547c7ad141c781260b96841e6fa3/roles/e2b16a5edd7b472487fac12492349bc7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:38:45.490468 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:45.492482 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f923f25-0926-40f0-9e5b-14b0c518f5e2 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:45.492809 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f923f25-0926-40f0-9e5b-14b0c518f5e2 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:45.493144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f923f25-0926-40f0-9e5b-14b0c518f5e2 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:45.494749 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 120/238] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:45 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:45.500664 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dc8c1-a95a-440a-9f55-edc199426023 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:45.500947 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dc8c1-a95a-440a-9f55-edc199426023 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:45.501201 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dc8c1-a95a-440a-9f55-edc199426023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:45.520232 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8ce5f-b4f2-47fe-bf40-5fd52f6f2ac0 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:45.546035 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-cb5dc8c1-a95a-440a-9f55-edc199426023 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:45.546035 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-cb5dc8c1-a95a-440a-9f55-edc199426023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:45.567434 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9bb7b-46fa-4e0c-b0ff-7fea0df85d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:45.568212 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9bb7b-46fa-4e0c-b0ff-7fea0df85d1a None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:45.568496 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9bb7b-46fa-4e0c-b0ff-7fea0df85d1a None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:45.568817 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9bb7b-46fa-4e0c-b0ff-7fea0df85d1a None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:45.569607 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9bb7b-46fa-4e0c-b0ff-7fea0df85d1a None admin] RBAC: Adding query filter params (name=reader) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:45.570104 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9bb7b-46fa-4e0c-b0ff-7fea0df85d1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:45.574008 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9bb7b-46fa-4e0c-b0ff-7fea0df85d1a None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:45.582762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 119/239] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 04:38:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:45.595126 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9bb7b-46fa-4e0c-b0ff-7fea0df85d1a None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:45.600425 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:45.670112 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 121/240] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 04:38:45.671442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fb22d-3171-4d30-a90f-5cefe2021011 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:45.671725 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fb22d-3171-4d30-a90f-5cefe2021011 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:45.672001 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fb22d-3171-4d30-a90f-5cefe2021011 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:45.673298 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 122/241] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:45.678770 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03833f2c-95df-452a-b1e5-3ac1632cd7e4 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:45.679056 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03833f2c-95df-452a-b1e5-3ac1632cd7e4 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:45.679488 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03833f2c-95df-452a-b1e5-3ac1632cd7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:45.697881 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-03833f2c-95df-452a-b1e5-3ac1632cd7e4 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:45.699119 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-03833f2c-95df-452a-b1e5-3ac1632cd7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:45.712720 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9bb7b-46fa-4e0c-b0ff-7fea0df85d1a None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:45.753953 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42d431-0f9e-4587-8d0e-65200db6a19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:45.754666 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42d431-0f9e-4587-8d0e-65200db6a19b None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:45.754946 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42d431-0f9e-4587-8d0e-65200db6a19b None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:45.755221 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42d431-0f9e-4587-8d0e-65200db6a19b None admin] PATH_INFO: `/v3/users/55831e1dbb6b4684a683405009972462` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:45.770340 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 123/242] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:45.771129 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:45.771276 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03833f2c-95df-452a-b1e5-3ac1632cd7e4 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:45.774294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42d431-0f9e-4587-8d0e-65200db6a19b None admin] RBAC: Authorizing `identity:get_user(user_id=55831e1dbb6b4684a683405009972462)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:45.775886 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42d431-0f9e-4587-8d0e-65200db6a19b None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:45.777780 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 120/243] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:45 2022] GET /identity/v3/users/55831e1dbb6b4684a683405009972462 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:38:45.785936 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42d431-0f9e-4587-8d0e-65200db6a19b None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:45.883281 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:45.892503 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03833f2c-95df-452a-b1e5-3ac1632cd7e4 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:45.901492 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42d431-0f9e-4587-8d0e-65200db6a19b None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:45.930178 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9699e-32c2-4392-8cea-a1194145d36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:45.931004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9699e-32c2-4392-8cea-a1194145d36c None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:45.931348 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9699e-32c2-4392-8cea-a1194145d36c None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:45.931686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9699e-32c2-4392-8cea-a1194145d36c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:45.932998 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9699e-32c2-4392-8cea-a1194145d36c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:45.934693 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9699e-32c2-4392-8cea-a1194145d36c None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:45.936981 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 124/244] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:38:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:45.938025 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9699e-32c2-4392-8cea-a1194145d36c None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:45.938433 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980b34a-36cb-47ea-b167-6eb0aeccef1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:45.939124 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980b34a-36cb-47ea-b167-6eb0aeccef1c None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:45.939407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980b34a-36cb-47ea-b167-6eb0aeccef1c None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:45.939683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2980b34a-36cb-47ea-b167-6eb0aeccef1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:46.007531 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:46.015593 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980b34a-36cb-47ea-b167-6eb0aeccef1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:46.017587 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2980b34a-36cb-47ea-b167-6eb0aeccef1c None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:46.049256 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9699e-32c2-4392-8cea-a1194145d36c None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:46.098226 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03db8c-07bb-4703-a6a5-ec7372c29bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:46.099270 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03db8c-07bb-4703-a6a5-ec7372c29bfb None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:46.099907 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03db8c-07bb-4703-a6a5-ec7372c29bfb None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:46.100574 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03db8c-07bb-4703-a6a5-ec7372c29bfb None admin] PATH_INFO: `/v3/roles/member` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:46.117006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03db8c-07bb-4703-a6a5-ec7372c29bfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:46.124479 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-0e03db8c-07bb-4703-a6a5-ec7372c29bfb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:38:46.124479 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:46.124479 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:46.124479 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:46.124479 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:46.124479 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:46.124479 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:46.124479 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:46.124479 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:46.124479 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:46.124479 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:46.124479 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:46.124479 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:46.124479 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:46.124479 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:46.124479 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:46.125578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:46.125578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:46.125578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:46.125578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:46.125578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:46.125578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:46.125578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:46.125578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:46.125578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:46.125578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:46.125578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:46.125578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:46.125578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:46.125578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:46.125578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:46.125578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:46.126624 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:46.126624 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:46.126624 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:46.126624 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:46.126624 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:46.126624 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:46.126624 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:46.126624 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:46.126624 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:46.126624 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:46.126624 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:38:46.126624 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:38:46.134419 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 125/245] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:38:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:38:46.135105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03db8c-07bb-4703-a6a5-ec7372c29bfb None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:46.142076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 121/246] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:38:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:46.143275 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980b34a-36cb-47ea-b167-6eb0aeccef1c None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:46.161692 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:46.256531 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03db8c-07bb-4703-a6a5-ec7372c29bfb None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:46.267869 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:46.279730 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2980b34a-36cb-47ea-b167-6eb0aeccef1c None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:46.306602 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed7124-ef52-473d-b8e2-ecc509d6af64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:46.308048 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed7124-ef52-473d-b8e2-ecc509d6af64 None admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:46.308803 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed7124-ef52-473d-b8e2-ecc509d6af64 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:46.309296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed7124-ef52-473d-b8e2-ecc509d6af64 None admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:46.310502 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed7124-ef52-473d-b8e2-ecc509d6af64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:46.312888 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed7124-ef52-473d-b8e2-ecc509d6af64 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:46.321909 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312abe05-b473-4d1a-b885-26aa6dd0d1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:46.322799 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312abe05-b473-4d1a-b885-26aa6dd0d1b1 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:46.323402 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312abe05-b473-4d1a-b885-26aa6dd0d1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:46.323842 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312abe05-b473-4d1a-b885-26aa6dd0d1b1 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:46.325144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312abe05-b473-4d1a-b885-26aa6dd0d1b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:46.326396 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312abe05-b473-4d1a-b885-26aa6dd0d1b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:46.328476 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312abe05-b473-4d1a-b885-26aa6dd0d1b1 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:46.341146 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 126/247] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 04:38:46 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:38:46.342402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed7124-ef52-473d-b8e2-ecc509d6af64 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:46.343341 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 122/248] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 04:38:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:46.344593 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312abe05-b473-4d1a-b885-26aa6dd0d1b1 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:46.459727 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:46.466640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312abe05-b473-4d1a-b885-26aa6dd0d1b1 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:46.497631 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed7124-ef52-473d-b8e2-ecc509d6af64 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:46.504002 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca896ce3-5f9f-4d88-8e24-fff58a0d7dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:46.504881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca896ce3-5f9f-4d88-8e24-fff58a0d7dea None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:46.505304 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca896ce3-5f9f-4d88-8e24-fff58a0d7dea None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:46.505719 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca896ce3-5f9f-4d88-8e24-fff58a0d7dea None admin] PATH_INFO: `/v3/users/1f49c9200b90405ca61539dd500d3e3d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:46.507268 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca896ce3-5f9f-4d88-8e24-fff58a0d7dea None admin] RBAC: Authorizing `identity:get_user(user_id=1f49c9200b90405ca61539dd500d3e3d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:46.508967 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca896ce3-5f9f-4d88-8e24-fff58a0d7dea None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:46.511206 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 123/249] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:46 2022] GET /identity/v3/users/1f49c9200b90405ca61539dd500d3e3d => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:46.517172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca896ce3-5f9f-4d88-8e24-fff58a0d7dea None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:46.544837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368be19-6ffd-46d4-91e2-08bb01e8e65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:46.545511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368be19-6ffd-46d4-91e2-08bb01e8e65a None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:46.545794 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368be19-6ffd-46d4-91e2-08bb01e8e65a None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:46.546149 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368be19-6ffd-46d4-91e2-08bb01e8e65a None admin] PATH_INFO: `/v3/projects/e8127522c84e4d4e989b25defd999d24` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:46.549450 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368be19-6ffd-46d4-91e2-08bb01e8e65a None admin] RBAC: Authorizing `identity:get_project(project_id=e8127522c84e4d4e989b25defd999d24)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:46.554295 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368be19-6ffd-46d4-91e2-08bb01e8e65a None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:46.558776 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 127/250] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:38:46 2022] GET /identity/v3/projects/e8127522c84e4d4e989b25defd999d24 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:46.562070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368be19-6ffd-46d4-91e2-08bb01e8e65a None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:46.576438 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:46.677556 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca896ce3-5f9f-4d88-8e24-fff58a0d7dea None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:46.704939 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368be19-6ffd-46d4-91e2-08bb01e8e65a None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:46.725713 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ba053-bee2-46b9-b6ec-fe815962698e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:46.726820 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ba053-bee2-46b9-b6ec-fe815962698e None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:46.727837 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ba053-bee2-46b9-b6ec-fe815962698e None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:46.728314 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ba053-bee2-46b9-b6ec-fe815962698e None admin] PATH_INFO: `/v3/projects/e8127522c84e4d4e989b25defd999d24` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:46.730262 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ba053-bee2-46b9-b6ec-fe815962698e None admin] RBAC: Authorizing `identity:get_project(project_id=e8127522c84e4d4e989b25defd999d24)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:46.732628 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ba053-bee2-46b9-b6ec-fe815962698e None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:46.735185 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 124/251] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:38:46 2022] GET /identity/v3/projects/e8127522c84e4d4e989b25defd999d24 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:46.742894 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ba053-bee2-46b9-b6ec-fe815962698e None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:46.746605 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d05d0-5152-4020-8739-9b30130631a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:46.747302 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d05d0-5152-4020-8739-9b30130631a2 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:46.747588 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d05d0-5152-4020-8739-9b30130631a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:46.748577 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d05d0-5152-4020-8739-9b30130631a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:46.749522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d05d0-5152-4020-8739-9b30130631a2 None admin] RBAC: Adding query filter params (role.id=b4b41ae21c5744628519a58257d04609, scope.project.id=e8127522c84e4d4e989b25defd999d24, user.id=55831e1dbb6b4684a683405009972462) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:46.749844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d05d0-5152-4020-8739-9b30130631a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:46.751356 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d05d0-5152-4020-8739-9b30130631a2 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:46.758367 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 128/252] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:38:46 2022] GET /identity/v3/role_assignments?user.id=55831e1dbb6b4684a683405009972462&scope.project.id=e8127522c84e4d4e989b25defd999d24&role.id=b4b41ae21c5744628519a58257d04609 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:46.856250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:46.865463 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ba053-bee2-46b9-b6ec-fe815962698e None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:46.904226 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1488a97-04c7-4ba4-9e51-b33494235dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:46.904921 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1488a97-04c7-4ba4-9e51-b33494235dc0 None admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:46.905202 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1488a97-04c7-4ba4-9e51-b33494235dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:46.905474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1488a97-04c7-4ba4-9e51-b33494235dc0 None admin] PATH_INFO: `/v3/projects/e8127522c84e4d4e989b25defd999d24/users/1f49c9200b90405ca61539dd500d3e3d/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:46.907556 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1488a97-04c7-4ba4-9e51-b33494235dc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8127522c84e4d4e989b25defd999d24, user_id=1f49c9200b90405ca61539dd500d3e3d, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:46.909114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1488a97-04c7-4ba4-9e51-b33494235dc0 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:46.926668 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 125/253] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 04:38:46 2022] PUT /identity/v3/projects/e8127522c84e4d4e989b25defd999d24/users/1f49c9200b90405ca61539dd500d3e3d/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:38:47.042151 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b253a-f9e9-4aca-83f5-5f03e02b65bb None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:47.042495 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b253a-f9e9-4aca-83f5-5f03e02b65bb None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:47.043021 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b253a-f9e9-4aca-83f5-5f03e02b65bb None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:47.045040 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 129/254] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:47.050187 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e1d2d-1866-40cf-b9e9-730940a3549a None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:47.050662 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e1d2d-1866-40cf-b9e9-730940a3549a None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:47.050756 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09e1d2d-1866-40cf-b9e9-730940a3549a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:47.074153 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-a09e1d2d-1866-40cf-b9e9-730940a3549a None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:47.078983 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-a09e1d2d-1866-40cf-b9e9-730940a3549a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:47.160028 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 126/255] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:47.182820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b253a-f9e9-4aca-83f5-5f03e02b65bb None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:47.195713 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:47.291712 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b253a-f9e9-4aca-83f5-5f03e02b65bb None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:47.328772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e5108-8839-4af7-af7b-e40df6553429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:47.329482 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e5108-8839-4af7-af7b-e40df6553429 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:47.329758 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e5108-8839-4af7-af7b-e40df6553429 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:47.330095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e5108-8839-4af7-af7b-e40df6553429 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:47.342953 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e5108-8839-4af7-af7b-e40df6553429 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:47.349232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-989e5108-8839-4af7-af7b-e40df6553429 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:38:47.349232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:47.349232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:47.349232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:47.349232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:47.349232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:47.349232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:47.349232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:47.349232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:47.349232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:47.349232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:47.349232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:47.349232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:47.349232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:47.349232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:47.349232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:47.350176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:47.350176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:47.350176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:47.350176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:47.350176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:47.350176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:47.350176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:47.350176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:47.350176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:47.350176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:47.350176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:47.350176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:47.350176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:47.350176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:47.350176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:47.350176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:47.351500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:47.351500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:47.351500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:47.351500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:47.351500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:47.351500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:47.351500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:47.351500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:47.351500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:47.351500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:47.351500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:38:47.351500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:38:47.351500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 130/256] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:38:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:38:47.356745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e1d2d-1866-40cf-b9e9-730940a3549a None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:47.526808 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:47.539248 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09e1d2d-1866-40cf-b9e9-730940a3549a None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:47.584816 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9350c-add0-47f8-a103-8e03cc51a89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:47.585604 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9350c-add0-47f8-a103-8e03cc51a89c None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:47.585888 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9350c-add0-47f8-a103-8e03cc51a89c None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:47.586194 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9350c-add0-47f8-a103-8e03cc51a89c None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:47.586912 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc9350c-add0-47f8-a103-8e03cc51a89c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:47.587222 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc9350c-add0-47f8-a103-8e03cc51a89c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:47.588627 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc9350c-add0-47f8-a103-8e03cc51a89c None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:47.597556 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 127/257] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:38:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:47.605353 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e5108-8839-4af7-af7b-e40df6553429 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:47.705787 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:47.748893 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e5108-8839-4af7-af7b-e40df6553429 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:47.787501 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bdd0af-23ce-4745-be06-6402a536c681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:47.788074 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdd0af-23ce-4745-be06-6402a536c681 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:47.788471 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdd0af-23ce-4745-be06-6402a536c681 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:47.788754 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bdd0af-23ce-4745-be06-6402a536c681 None admin] PATH_INFO: `/v3/users/8642547c7ad141c781260b96841e6fa3` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:47.790010 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bdd0af-23ce-4745-be06-6402a536c681 None admin] RBAC: Authorizing `identity:get_user(user_id=8642547c7ad141c781260b96841e6fa3)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:47.791569 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bdd0af-23ce-4745-be06-6402a536c681 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:47.793229 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 131/258] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:47 2022] GET /identity/v3/users/8642547c7ad141c781260b96841e6fa3 => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:47.800181 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9350c-add0-47f8-a103-8e03cc51a89c None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:47.901575 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e00f91-db1b-4b29-8106-3ee0caf7441a None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:47.901906 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e00f91-db1b-4b29-8106-3ee0caf7441a None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:47.902152 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e00f91-db1b-4b29-8106-3ee0caf7441a None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:47.903536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 132/259] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:47.912523 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e5e2c-3562-49fc-a28d-08885cb464a1 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:47.912523 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e5e2c-3562-49fc-a28d-08885cb464a1 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:47.912523 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e5e2c-3562-49fc-a28d-08885cb464a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:47.936499 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-408e5e2c-3562-49fc-a28d-08885cb464a1 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:47.938450 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-408e5e2c-3562-49fc-a28d-08885cb464a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:47.987934 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9350c-add0-47f8-a103-8e03cc51a89c None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:48.052796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 133/260] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 04:38:48.072303 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d58156-ee9a-418f-9a3b-7d9c5fdd3bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:48.072946 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d58156-ee9a-418f-9a3b-7d9c5fdd3bb1 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:48.073228 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d58156-ee9a-418f-9a3b-7d9c5fdd3bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:48.073501 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d58156-ee9a-418f-9a3b-7d9c5fdd3bb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:48.094016 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:48.104936 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e5e2c-3562-49fc-a28d-08885cb464a1 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:48.215690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d58156-ee9a-418f-9a3b-7d9c5fdd3bb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:48.217554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d58156-ee9a-418f-9a3b-7d9c5fdd3bb1 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:48.235425 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:48.288316 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e5e2c-3562-49fc-a28d-08885cb464a1 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:48.334735 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f95f6-608d-4b81-81ea-f2108576ab26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:48.335812 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f95f6-608d-4b81-81ea-f2108576ab26 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:48.336293 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f95f6-608d-4b81-81ea-f2108576ab26 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:48.336850 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056f95f6-608d-4b81-81ea-f2108576ab26 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:48.362132 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056f95f6-608d-4b81-81ea-f2108576ab26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:48.368294 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-056f95f6-608d-4b81-81ea-f2108576ab26 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 04:38:48.368294 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:48.368294 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:48.368294 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:48.368294 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:48.368294 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:48.368294 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:48.368294 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:48.368294 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:48.368294 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:48.368294 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:48.368294 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:48.368294 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:48.368294 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:48.368294 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:48.368294 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:48.369182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:48.369182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:48.369182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:48.369182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:48.369182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:48.369182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:48.369182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:48.369182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:48.369182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:48.369182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:48.369182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:48.369182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:48.369182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:48.369182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:48.369182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:48.369182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:48.370016 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:48.370016 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:48.370016 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:48.370016 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:48.370016 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:48.370016 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:48.370016 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:48.370016 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:48.370016 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:48.370016 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:48.370016 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 04:38:48.370016 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:38:48.377316 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 134/261] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 04:38:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:38:48.387549 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f95f6-608d-4b81-81ea-f2108576ab26 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:48.478855 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 128/262] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:38:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 674 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:48.480111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d58156-ee9a-418f-9a3b-7d9c5fdd3bb1 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:48.549400 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:48.618678 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056f95f6-608d-4b81-81ea-f2108576ab26 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:48.662356 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:48.664122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d58156-ee9a-418f-9a3b-7d9c5fdd3bb1 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:48.691978 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2c49d-b628-4fdc-831c-6bf2bd7f1cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:48.692620 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2c49d-b628-4fdc-831c-6bf2bd7f1cf0 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:48.692899 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2c49d-b628-4fdc-831c-6bf2bd7f1cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:48.693671 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2c49d-b628-4fdc-831c-6bf2bd7f1cf0 None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:48.694660 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2c49d-b628-4fdc-831c-6bf2bd7f1cf0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:48.694974 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2c49d-b628-4fdc-831c-6bf2bd7f1cf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:48.696400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2c49d-b628-4fdc-831c-6bf2bd7f1cf0 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:48.711969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 135/263] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:38:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:48.717609 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2c49d-b628-4fdc-831c-6bf2bd7f1cf0 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:48.752365 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d217a-d332-4a1a-853d-f57d91017a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:48.753038 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d217a-d332-4a1a-853d-f57d91017a7b None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:48.753315 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d217a-d332-4a1a-853d-f57d91017a7b None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:48.753584 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d217a-d332-4a1a-853d-f57d91017a7b None admin] PATH_INFO: `/v3/projects/e8127522c84e4d4e989b25defd999d24` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:48.755017 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d217a-d332-4a1a-853d-f57d91017a7b None admin] RBAC: Authorizing `identity:get_project(project_id=e8127522c84e4d4e989b25defd999d24)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:48.756502 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d217a-d332-4a1a-853d-f57d91017a7b None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:48.758325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 129/264] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:38:48 2022] GET /identity/v3/projects/e8127522c84e4d4e989b25defd999d24 => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:38:48.767044 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d217a-d332-4a1a-853d-f57d91017a7b None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:48.927147 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d217a-d332-4a1a-853d-f57d91017a7b None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:48.941733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:48.980602 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8218cb-ac01-4cca-b4d0-683ba16fbca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:48.981238 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8218cb-ac01-4cca-b4d0-683ba16fbca2 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:48.981517 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8218cb-ac01-4cca-b4d0-683ba16fbca2 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:48.981790 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8218cb-ac01-4cca-b4d0-683ba16fbca2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:48.982614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8218cb-ac01-4cca-b4d0-683ba16fbca2 None admin] RBAC: Adding query filter params (role.id=2bfdd65b06554a6da967b3939da753c7, scope.project.id=e8127522c84e4d4e989b25defd999d24, user.id=8642547c7ad141c781260b96841e6fa3) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:48.982924 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8218cb-ac01-4cca-b4d0-683ba16fbca2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:48.984399 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8218cb-ac01-4cca-b4d0-683ba16fbca2 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:48.987916 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2c49d-b628-4fdc-831c-6bf2bd7f1cf0 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:48.998455 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 130/265] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:38:48 2022] GET /identity/v3/role_assignments?user.id=8642547c7ad141c781260b96841e6fa3&scope.project.id=e8127522c84e4d4e989b25defd999d24&role.id=2bfdd65b06554a6da967b3939da753c7 => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:49.063981 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e826d-7e77-44a3-b574-0b419150b710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:49.064642 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e826d-7e77-44a3-b574-0b419150b710 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:49.064912 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e826d-7e77-44a3-b574-0b419150b710 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:49.065180 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e826d-7e77-44a3-b574-0b419150b710 None admin] PATH_INFO: `/v3/users/8642547c7ad141c781260b96841e6fa3` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:49.066375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e826d-7e77-44a3-b574-0b419150b710 None admin] RBAC: Authorizing `identity:get_user(user_id=8642547c7ad141c781260b96841e6fa3)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:49.067861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e826d-7e77-44a3-b574-0b419150b710 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:49.069833 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 136/266] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:48 2022] GET /identity/v3/users/8642547c7ad141c781260b96841e6fa3 => generated 283 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:38:49.075732 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8218cb-ac01-4cca-b4d0-683ba16fbca2 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:49.206332 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8218cb-ac01-4cca-b4d0-683ba16fbca2 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:49.249482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3650c2-502e-4869-8e16-37e3e1f53881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:49.250157 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3650c2-502e-4869-8e16-37e3e1f53881 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:49.250439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3650c2-502e-4869-8e16-37e3e1f53881 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:49.250710 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3650c2-502e-4869-8e16-37e3e1f53881 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:49.318377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:49.360144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3650c2-502e-4869-8e16-37e3e1f53881 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:49.361661 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3650c2-502e-4869-8e16-37e3e1f53881 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:49.483014 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 131/267] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:38:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:49.488725 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e826d-7e77-44a3-b574-0b419150b710 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:49.566231 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:49.605360 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7301a6-d982-4c6c-a3d6-d9495ea517d9 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:49.605682 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7301a6-d982-4c6c-a3d6-d9495ea517d9 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:49.605918 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7301a6-d982-4c6c-a3d6-d9495ea517d9 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:49.607576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 132/268] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:38:49.613807 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ea002-f485-441f-99e2-1b1e56023bd1 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:49.614125 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ea002-f485-441f-99e2-1b1e56023bd1 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:49.614405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ea002-f485-441f-99e2-1b1e56023bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:49.635427 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-ec6ea002-f485-441f-99e2-1b1e56023bd1 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:49.635618 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e826d-7e77-44a3-b574-0b419150b710 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:49.636634 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-ec6ea002-f485-441f-99e2-1b1e56023bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:49.696200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd7b97-211e-4213-8d4a-e114a4f3beff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:49.696864 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd7b97-211e-4213-8d4a-e114a4f3beff None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:49.697154 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd7b97-211e-4213-8d4a-e114a4f3beff None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:49.697436 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd7b97-211e-4213-8d4a-e114a4f3beff None admin] PATH_INFO: `/v3/projects/e8127522c84e4d4e989b25defd999d24` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:49.699192 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd7b97-211e-4213-8d4a-e114a4f3beff None admin] RBAC: Authorizing `identity:get_project(project_id=e8127522c84e4d4e989b25defd999d24)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:49.701065 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd7b97-211e-4213-8d4a-e114a4f3beff None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:49.702799 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 137/269] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:38:49 2022] GET /identity/v3/projects/e8127522c84e4d4e989b25defd999d24 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:49.715654 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd7b97-211e-4213-8d4a-e114a4f3beff None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:49.753688 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 133/270] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 04:38:49.755170 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9207e52-7013-4cff-befb-04f19106300c None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:49.755514 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9207e52-7013-4cff-befb-04f19106300c None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:49.755794 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9207e52-7013-4cff-befb-04f19106300c None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:49.757071 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 134/271] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:49.762422 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996f62f-2754-4f17-a6a3-177a64ee7fec None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:49.762706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996f62f-2754-4f17-a6a3-177a64ee7fec None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:49.763923 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0996f62f-2754-4f17-a6a3-177a64ee7fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:49.778039 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:49.785277 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-0996f62f-2754-4f17-a6a3-177a64ee7fec None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:49.786579 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-0996f62f-2754-4f17-a6a3-177a64ee7fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:49.842643 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd7b97-211e-4213-8d4a-e114a4f3beff None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:49.874659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:49.875773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 135/272] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:49.876727 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996f62f-2754-4f17-a6a3-177a64ee7fec None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:49.899353 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ef77e-2c8b-4751-a5c7-93c982fe0a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:49.900076 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ef77e-2c8b-4751-a5c7-93c982fe0a2d None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:49.900429 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ef77e-2c8b-4751-a5c7-93c982fe0a2d None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:49.900770 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ef77e-2c8b-4751-a5c7-93c982fe0a2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:49.901877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ef77e-2c8b-4751-a5c7-93c982fe0a2d None admin] RBAC: Adding query filter params (role.id=e2b16a5edd7b472487fac12492349bc7, scope.project.id=e8127522c84e4d4e989b25defd999d24, user.id=8642547c7ad141c781260b96841e6fa3) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:49.902228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ef77e-2c8b-4751-a5c7-93c982fe0a2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:49.903704 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ef77e-2c8b-4751-a5c7-93c982fe0a2d None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:49.909808 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 138/273] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:38:49 2022] GET /identity/v3/role_assignments?user.id=8642547c7ad141c781260b96841e6fa3&scope.project.id=e8127522c84e4d4e989b25defd999d24&role.id=e2b16a5edd7b472487fac12492349bc7 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:38:49.911348 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576516ea-9ea3-4ed1-ba03-ef1c5739f99a None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:49.911703 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576516ea-9ea3-4ed1-ba03-ef1c5739f99a None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:49.912050 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576516ea-9ea3-4ed1-ba03-ef1c5739f99a None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:49.917506 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 139/274] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:49.917506 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576516ea-9ea3-4ed1-ba03-ef1c5739f99a None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:50.027292 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0996f62f-2754-4f17-a6a3-177a64ee7fec None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:50.044090 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576516ea-9ea3-4ed1-ba03-ef1c5739f99a None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:50.065903 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934d593-66e4-4e1d-85c1-a780bfced84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:50.066792 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934d593-66e4-4e1d-85c1-a780bfced84c None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:50.067166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934d593-66e4-4e1d-85c1-a780bfced84c None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:50.067583 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934d593-66e4-4e1d-85c1-a780bfced84c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:50.070760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:50.083068 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c934d593-66e4-4e1d-85c1-a780bfced84c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:50.087236 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a41c9-e586-4ea5-8cf5-88a83fabfccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:50.088183 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a41c9-e586-4ea5-8cf5-88a83fabfccc None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:50.088466 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a41c9-e586-4ea5-8cf5-88a83fabfccc None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:50.088578 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-c934d593-66e4-4e1d-85c1-a780bfced84c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 04:38:50.088578 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:50.088578 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:50.088578 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:50.088578 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:50.088578 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:50.088578 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:50.088578 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:50.088578 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:50.088578 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:50.088578 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:50.088578 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:50.088578 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:50.088578 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:50.088578 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:50.088578 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:50.089401 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:50.089401 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:50.089401 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:50.089401 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:50.089401 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:50.089401 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:50.089401 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:50.089401 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:50.089401 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:50.089401 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:50.089401 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:50.089401 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:50.089401 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:50.089401 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:50.089401 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:50.089401 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:50.090300 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:50.090300 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:50.090300 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:50.090300 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:50.090300 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:50.090300 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:50.090300 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:50.090300 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:50.090300 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:50.090300 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:50.090300 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 04:38:50.090300 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:38:50.090904 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a41c9-e586-4ea5-8cf5-88a83fabfccc None admin] PATH_INFO: `/v3/roles/member` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:50.090972 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 136/275] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:38:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:38:50.092358 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862260f3-a99d-493f-886b-47b672cdaed7 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:50.092358 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862260f3-a99d-493f-886b-47b672cdaed7 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:50.092612 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862260f3-a99d-493f-886b-47b672cdaed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:50.102520 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a41c9-e586-4ea5-8cf5-88a83fabfccc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:50.107995 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-2a2a41c9-e586-4ea5-8cf5-88a83fabfccc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:38:50.107995 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:50.107995 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:50.107995 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:50.107995 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:50.107995 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:50.107995 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:50.107995 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:50.107995 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:50.107995 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:50.107995 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:50.107995 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:50.107995 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:50.107995 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:50.107995 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:50.107995 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:50.108883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:50.108883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:50.108883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:50.108883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:50.108883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:50.108883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:50.108883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:50.108883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:50.108883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:50.108883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:50.108883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:50.108883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:50.108883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:50.108883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:50.108883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:50.108883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:50.109711 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:50.109711 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:50.109711 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:50.109711 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:50.109711 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:50.109711 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:50.109711 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:50.109711 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:50.109711 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:50.109711 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:50.109711 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:38:50.109711 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:38:50.109711 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 140/276] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:38:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:38:50.111526 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a41c9-e586-4ea5-8cf5-88a83fabfccc None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:50.116376 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-862260f3-a99d-493f-886b-47b672cdaed7 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:50.117592 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-862260f3-a99d-493f-886b-47b672cdaed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:50.171809 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:50.195738 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 137/277] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:50.196453 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862260f3-a99d-493f-886b-47b672cdaed7 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:50.241486 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a41c9-e586-4ea5-8cf5-88a83fabfccc None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:50.277015 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080af8b-b09f-40c7-9dff-a26a5d3ce62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:50.277694 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080af8b-b09f-40c7-9dff-a26a5d3ce62e None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:50.277918 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080af8b-b09f-40c7-9dff-a26a5d3ce62e None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:50.278293 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080af8b-b09f-40c7-9dff-a26a5d3ce62e None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:50.279016 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080af8b-b09f-40c7-9dff-a26a5d3ce62e None admin] RBAC: Adding query filter params (name=reader) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:50.279326 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080af8b-b09f-40c7-9dff-a26a5d3ce62e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:50.280790 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080af8b-b09f-40c7-9dff-a26a5d3ce62e None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:50.289361 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 141/278] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 04:38:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:50.290965 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cbbff-aaa2-4e73-bdb7-4483ae45ff75 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:50.291260 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cbbff-aaa2-4e73-bdb7-4483ae45ff75 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:50.291535 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0cbbff-aaa2-4e73-bdb7-4483ae45ff75 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:50.296914 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 142/279] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:50.297714 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cbbff-aaa2-4e73-bdb7-4483ae45ff75 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:50.298712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862260f3-a99d-493f-886b-47b672cdaed7 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:50.323761 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:50.332907 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ea8c7-fe1e-494c-a729-2da20403e492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:50.333542 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ea8c7-fe1e-494c-a729-2da20403e492 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:50.333824 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ea8c7-fe1e-494c-a729-2da20403e492 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:50.334130 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ea8c7-fe1e-494c-a729-2da20403e492 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:50.334851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ea8c7-fe1e-494c-a729-2da20403e492 None admin] RBAC: Adding query filter params (name=member) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:50.335182 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ea8c7-fe1e-494c-a729-2da20403e492 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:50.336582 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ea8c7-fe1e-494c-a729-2da20403e492 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:50.345108 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 138/280] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 04:38:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:50.345896 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ea8c7-fe1e-494c-a729-2da20403e492 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:50.398468 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0cbbff-aaa2-4e73-bdb7-4483ae45ff75 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:50.409308 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:50.433578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e83d6-72fd-4215-9cba-396b336d03aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:50.434196 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e83d6-72fd-4215-9cba-396b336d03aa None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:50.434487 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e83d6-72fd-4215-9cba-396b336d03aa None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:50.434760 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e83d6-72fd-4215-9cba-396b336d03aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:50.446310 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e83d6-72fd-4215-9cba-396b336d03aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:50.449262 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ea8c7-fe1e-494c-a729-2da20403e492 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:50.451627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-d13e83d6-72fd-4215-9cba-396b336d03aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:38:50.451627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:50.451627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:50.451627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:50.451627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:50.451627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:50.451627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:50.451627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:50.451627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:50.451627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:50.451627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:50.451627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:50.451627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:50.451627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:50.451627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:50.451627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:50.452510 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:50.452510 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:50.452510 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:50.452510 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:50.452510 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:50.452510 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:50.452510 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:50.452510 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:50.452510 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:50.452510 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:50.452510 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:50.452510 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:50.452510 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:50.452510 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:50.452510 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:50.452510 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:50.453329 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:50.453329 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:50.453329 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:50.453329 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:50.453329 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:50.453329 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:50.453329 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:50.453329 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:50.453329 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:50.453329 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:50.453329 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:38:50.453329 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:38:50.453329 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 143/281] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:38:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:38:50.454051 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f645d-9a5c-4ec2-9209-18eb6db1eba0 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:50.454655 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f645d-9a5c-4ec2-9209-18eb6db1eba0 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:50.454655 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f645d-9a5c-4ec2-9209-18eb6db1eba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:50.473665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-f33f645d-9a5c-4ec2-9209-18eb6db1eba0 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:50.474915 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-f33f645d-9a5c-4ec2-9209-18eb6db1eba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:50.484648 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db43da8-fbfb-46d0-ac3f-056fdc59fd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:50.485301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db43da8-fbfb-46d0-ac3f-056fdc59fd10 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:50.485582 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db43da8-fbfb-46d0-ac3f-056fdc59fd10 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:50.485859 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db43da8-fbfb-46d0-ac3f-056fdc59fd10 None admin] PATH_INFO: `/v3/users/55831e1dbb6b4684a683405009972462` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:50.487060 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db43da8-fbfb-46d0-ac3f-056fdc59fd10 None admin] RBAC: Authorizing `identity:get_user(user_id=55831e1dbb6b4684a683405009972462)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:50.488518 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db43da8-fbfb-46d0-ac3f-056fdc59fd10 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:50.490174 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 139/282] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:50 2022] GET /identity/v3/users/55831e1dbb6b4684a683405009972462 => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:50.495433 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db43da8-fbfb-46d0-ac3f-056fdc59fd10 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:50.543658 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 144/283] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:50.544420 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f645d-9a5c-4ec2-9209-18eb6db1eba0 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:50.566577 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:50.614898 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db43da8-fbfb-46d0-ac3f-056fdc59fd10 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:50.642487 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:50.646028 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f645d-9a5c-4ec2-9209-18eb6db1eba0 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:50.649453 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7c48c-5c0e-44b7-aac8-ed80ceb2e15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:50.650152 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7c48c-5c0e-44b7-aac8-ed80ceb2e15a None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:50.650437 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7c48c-5c0e-44b7-aac8-ed80ceb2e15a None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:50.650712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7c48c-5c0e-44b7-aac8-ed80ceb2e15a None admin] PATH_INFO: `/v3/users/1f49c9200b90405ca61539dd500d3e3d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:50.651879 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7c48c-5c0e-44b7-aac8-ed80ceb2e15a None admin] RBAC: Authorizing `identity:get_user(user_id=1f49c9200b90405ca61539dd500d3e3d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:50.653348 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7c48c-5c0e-44b7-aac8-ed80ceb2e15a None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:50.655043 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 140/284] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:50 2022] GET /identity/v3/users/1f49c9200b90405ca61539dd500d3e3d => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:50.655813 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7c48c-5c0e-44b7-aac8-ed80ceb2e15a None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:50.684541 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879b949-daa6-4ad7-8a7c-119d53c33f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:50.685167 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879b949-daa6-4ad7-8a7c-119d53c33f41 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:50.685445 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879b949-daa6-4ad7-8a7c-119d53c33f41 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:50.685717 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879b949-daa6-4ad7-8a7c-119d53c33f41 None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:50.686472 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879b949-daa6-4ad7-8a7c-119d53c33f41 None admin] RBAC: Adding query filter params (name=member) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:50.686777 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879b949-daa6-4ad7-8a7c-119d53c33f41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:50.688198 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879b949-daa6-4ad7-8a7c-119d53c33f41 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:50.696286 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 145/285] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 04:38:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:50.697072 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879b949-daa6-4ad7-8a7c-119d53c33f41 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:50.760457 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7c48c-5c0e-44b7-aac8-ed80ceb2e15a None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:50.785120 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:50.794143 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879b949-daa6-4ad7-8a7c-119d53c33f41 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:50.796726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e614299-d0ff-4c2d-8b2b-c9ea85876dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:50.797379 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e614299-d0ff-4c2d-8b2b-c9ea85876dd5 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:50.797657 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e614299-d0ff-4c2d-8b2b-c9ea85876dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:50.797931 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e614299-d0ff-4c2d-8b2b-c9ea85876dd5 None admin] PATH_INFO: `/v3/projects/e8127522c84e4d4e989b25defd999d24` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:50.799171 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e614299-d0ff-4c2d-8b2b-c9ea85876dd5 None admin] RBAC: Authorizing `identity:get_project(project_id=e8127522c84e4d4e989b25defd999d24)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:50.800656 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e614299-d0ff-4c2d-8b2b-c9ea85876dd5 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:50.802394 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 141/286] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:38:50 2022] GET /identity/v3/projects/e8127522c84e4d4e989b25defd999d24 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:50.803262 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e614299-d0ff-4c2d-8b2b-c9ea85876dd5 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:50.831272 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb9db8-49f9-4887-8c97-25a7f2e0b8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:50.831922 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb9db8-49f9-4887-8c97-25a7f2e0b8c9 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:50.832204 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb9db8-49f9-4887-8c97-25a7f2e0b8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:50.832476 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb9db8-49f9-4887-8c97-25a7f2e0b8c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:50.833630 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb9db8-49f9-4887-8c97-25a7f2e0b8c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:50.835149 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb9db8-49f9-4887-8c97-25a7f2e0b8c9 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:50.836760 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 146/287] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:38:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:50.837514 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb9db8-49f9-4887-8c97-25a7f2e0b8c9 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:50.867034 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:50.907901 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e614299-d0ff-4c2d-8b2b-c9ea85876dd5 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:50.935069 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb9db8-49f9-4887-8c97-25a7f2e0b8c9 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:50.942920 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0dab9-7fa0-4b30-ad4a-837cd2aa7e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:50.943904 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0dab9-7fa0-4b30-ad4a-837cd2aa7e8f None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:50.944196 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0dab9-7fa0-4b30-ad4a-837cd2aa7e8f None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:50.944535 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0dab9-7fa0-4b30-ad4a-837cd2aa7e8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:50.969136 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998b05a-995c-42bc-93ac-a137039f253b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:50.969863 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998b05a-995c-42bc-93ac-a137039f253b None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:50.970176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998b05a-995c-42bc-93ac-a137039f253b None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:50.970470 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b998b05a-995c-42bc-93ac-a137039f253b None admin] PATH_INFO: `/v3/users/065530520d3044c5bf0d4e0301169962` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:50.983683 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998b05a-995c-42bc-93ac-a137039f253b None admin] RBAC: Authorizing `identity:get_user(user_id=065530520d3044c5bf0d4e0301169962)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:50.985175 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b998b05a-995c-42bc-93ac-a137039f253b None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:50.986870 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 147/288] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:50 2022] GET /identity/v3/users/065530520d3044c5bf0d4e0301169962 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:50.987610 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998b05a-995c-42bc-93ac-a137039f253b None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:51.003693 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:51.013618 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0dab9-7fa0-4b30-ad4a-837cd2aa7e8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:51.015114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0dab9-7fa0-4b30-ad4a-837cd2aa7e8f None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:51.082250 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:51.094290 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b998b05a-995c-42bc-93ac-a137039f253b None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:51.116682 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 142/289] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:38:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:51.117574 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0dab9-7fa0-4b30-ad4a-837cd2aa7e8f None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:51.133694 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba02989-b6b5-4879-b189-2da23dc0400a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:51.134405 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba02989-b6b5-4879-b189-2da23dc0400a None admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:51.134682 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba02989-b6b5-4879-b189-2da23dc0400a None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:51.134959 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba02989-b6b5-4879-b189-2da23dc0400a None admin] PATH_INFO: `/v3/projects/e8127522c84e4d4e989b25defd999d24/users/55831e1dbb6b4684a683405009972462/roles/b4b41ae21c5744628519a58257d04609` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:51.136940 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba02989-b6b5-4879-b189-2da23dc0400a None admin] RBAC: Authorizing `identity:create_grant(project_id=e8127522c84e4d4e989b25defd999d24, user_id=55831e1dbb6b4684a683405009972462, role_id=b4b41ae21c5744628519a58257d04609)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:51.138460 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba02989-b6b5-4879-b189-2da23dc0400a None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:51.151612 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 148/290] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 04:38:50 2022] PUT /identity/v3/projects/e8127522c84e4d4e989b25defd999d24/users/55831e1dbb6b4684a683405009972462/roles/b4b41ae21c5744628519a58257d04609 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:38:51.152391 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba02989-b6b5-4879-b189-2da23dc0400a None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:51.222608 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:51.234357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0dab9-7fa0-4b30-ad4a-837cd2aa7e8f None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:51.266733 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba02989-b6b5-4879-b189-2da23dc0400a None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:51.274511 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a2b70-467f-4579-a92a-df4c1fca1652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:51.275160 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a2b70-467f-4579-a92a-df4c1fca1652 None admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:51.275444 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a2b70-467f-4579-a92a-df4c1fca1652 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:51.275718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a2b70-467f-4579-a92a-df4c1fca1652 None admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:51.276557 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a2b70-467f-4579-a92a-df4c1fca1652 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:51.278544 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a2b70-467f-4579-a92a-df4c1fca1652 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:51.304026 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 143/291] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 04:38:51 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:38:51.305298 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a2b70-467f-4579-a92a-df4c1fca1652 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:51.320818 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb022a-851b-43e2-88d5-09036b4b006f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:51.321874 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb022a-851b-43e2-88d5-09036b4b006f None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:51.321874 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb022a-851b-43e2-88d5-09036b4b006f None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:51.322158 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb022a-851b-43e2-88d5-09036b4b006f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:51.322962 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb022a-851b-43e2-88d5-09036b4b006f None admin] RBAC: Adding query filter params (role.id=201d465b851546b1a19c322a3356d48d, user.id=065530520d3044c5bf0d4e0301169962, scope.system=all) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:51.323281 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb022a-851b-43e2-88d5-09036b4b006f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:51.325255 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cb022a-851b-43e2-88d5-09036b4b006f None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:51.332515 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 149/292] 10.222.0.39 () {56 vars in 1308 bytes} [Tue Jul 26 04:38:51 2022] GET /identity/v3/role_assignments?user.id=065530520d3044c5bf0d4e0301169962&scope.system=all&role.id=201d465b851546b1a19c322a3356d48d => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:51.451960 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a2b70-467f-4579-a92a-df4c1fca1652 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:51.493896 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176221e-8464-40de-87c7-a9b1016a568e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:51.494611 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176221e-8464-40de-87c7-a9b1016a568e None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:51.494891 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176221e-8464-40de-87c7-a9b1016a568e None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:51.495164 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176221e-8464-40de-87c7-a9b1016a568e None admin] PATH_INFO: `/v3/projects/e8127522c84e4d4e989b25defd999d24` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:51.496374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176221e-8464-40de-87c7-a9b1016a568e None admin] RBAC: Authorizing `identity:get_project(project_id=e8127522c84e4d4e989b25defd999d24)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:51.497879 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176221e-8464-40de-87c7-a9b1016a568e None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:51.499799 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 144/293] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:38:51 2022] GET /identity/v3/projects/e8127522c84e4d4e989b25defd999d24 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:51.505689 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb022a-851b-43e2-88d5-09036b4b006f None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:51.526810 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:51.622318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cb022a-851b-43e2-88d5-09036b4b006f None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:51.658559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97090ef-2690-494f-a9cb-8200e0a07227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:51.659326 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97090ef-2690-494f-a9cb-8200e0a07227 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:51.659540 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97090ef-2690-494f-a9cb-8200e0a07227 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:51.659815 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97090ef-2690-494f-a9cb-8200e0a07227 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:51.660684 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97090ef-2690-494f-a9cb-8200e0a07227 None admin] RBAC: Adding query filter params (role.id=201d465b851546b1a19c322a3356d48d, scope.project.id=e8127522c84e4d4e989b25defd999d24, user.id=1f49c9200b90405ca61539dd500d3e3d) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:51.660993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97090ef-2690-494f-a9cb-8200e0a07227 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:51.662595 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97090ef-2690-494f-a9cb-8200e0a07227 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:51.670255 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 150/294] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:38:51 2022] GET /identity/v3/role_assignments?user.id=1f49c9200b90405ca61539dd500d3e3d&scope.project.id=e8127522c84e4d4e989b25defd999d24&role.id=201d465b851546b1a19c322a3356d48d => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:53.231161 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe1ba2-7a00-419e-8a8f-659523d270f5 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:53.232186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe1ba2-7a00-419e-8a8f-659523d270f5 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:53.232688 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe1ba2-7a00-419e-8a8f-659523d270f5 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:53.234533 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 145/295] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:53.240708 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905dad2-9b7d-4b1b-bbdb-217a9abf532b None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:53.241538 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905dad2-9b7d-4b1b-bbdb-217a9abf532b None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:53.242026 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1905dad2-9b7d-4b1b-bbdb-217a9abf532b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:53.260595 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-1905dad2-9b7d-4b1b-bbdb-217a9abf532b None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:53.262133 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-1905dad2-9b7d-4b1b-bbdb-217a9abf532b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:53.342366 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 151/296] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:53.354097 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7319c5-cc97-4e36-8a78-deeced96dde8 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:53.354705 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7319c5-cc97-4e36-8a78-deeced96dde8 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:53.355173 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7319c5-cc97-4e36-8a78-deeced96dde8 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:53.356949 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 146/297] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:53.362139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba13e30-e0be-49d4-88a2-5fe6e08a6a08 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:53.362429 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba13e30-e0be-49d4-88a2-5fe6e08a6a08 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:53.362704 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba13e30-e0be-49d4-88a2-5fe6e08a6a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:53.369235 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7319c5-cc97-4e36-8a78-deeced96dde8 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:53.375264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:53.381446 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-cba13e30-e0be-49d4-88a2-5fe6e08a6a08 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:53.383275 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-cba13e30-e0be-49d4-88a2-5fe6e08a6a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:53.392148 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:53.454761 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 152/298] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:53.476101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba13e30-e0be-49d4-88a2-5fe6e08a6a08 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:53.495055 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7319c5-cc97-4e36-8a78-deeced96dde8 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:53.531902 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf92fa0-6dd3-4075-8c3b-5ea337fecc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:53.532975 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf92fa0-6dd3-4075-8c3b-5ea337fecc8a None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:53.533487 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf92fa0-6dd3-4075-8c3b-5ea337fecc8a None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:53.533972 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf92fa0-6dd3-4075-8c3b-5ea337fecc8a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:53.545730 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf92fa0-6dd3-4075-8c3b-5ea337fecc8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:53.551603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-caf92fa0-6dd3-4075-8c3b-5ea337fecc8a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 04:38:53.551603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:53.551603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:53.551603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:53.551603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:53.551603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:53.551603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:53.551603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:53.551603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:53.551603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:53.551603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:53.551603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:53.551603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:53.551603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:53.551603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:53.551603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:53.552508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:53.552508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:53.552508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:53.552508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:53.552508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:53.552508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:53.552508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:53.552508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:53.552508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:53.552508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:53.552508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:53.552508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:53.552508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:53.552508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:53.552508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:53.552508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:53.553342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:53.553342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:53.553342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:53.553342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:53.553342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:53.553342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:53.553342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:53.553342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:53.553342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:53.553342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:53.553342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 04:38:53.553342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:38:53.556218 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 147/299] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:38:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:38:53.564738 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf92fa0-6dd3-4075-8c3b-5ea337fecc8a None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:53.576559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba13e30-e0be-49d4-88a2-5fe6e08a6a08 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:53.611892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcd5a0-4ae4-4dd3-aeed-63358ba84c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:53.612554 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcd5a0-4ae4-4dd3-aeed-63358ba84c90 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:53.612853 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcd5a0-4ae4-4dd3-aeed-63358ba84c90 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:53.613109 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcd5a0-4ae4-4dd3-aeed-63358ba84c90 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:53.616430 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:53.625066 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bcd5a0-4ae4-4dd3-aeed-63358ba84c90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:53.630718 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-c4bcd5a0-4ae4-4dd3-aeed-63358ba84c90 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:38:53.630718 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:53.630718 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:53.630718 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:53.630718 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:53.630718 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:53.630718 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:53.630718 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:53.630718 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:53.630718 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:53.630718 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:53.630718 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:53.630718 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:53.630718 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:53.630718 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:53.630718 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:53.631842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:53.631842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:53.631842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:53.631842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:53.631842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:53.631842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:53.631842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:53.631842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:53.631842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:53.631842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:53.631842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:53.631842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:53.631842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:53.631842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:53.631842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:53.631842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:53.632871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:53.632871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:53.632871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:53.632871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:53.632871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:53.632871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:53.632871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:53.632871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:53.632871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:53.632871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:53.632871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:38:53.632871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:38:53.635657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 153/300] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:38:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:38:53.636993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f8810-1b70-4a2c-b47b-caf3dd9e1d8e None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:53.637419 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f8810-1b70-4a2c-b47b-caf3dd9e1d8e None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:53.637840 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f8810-1b70-4a2c-b47b-caf3dd9e1d8e None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:53.639491 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 154/301] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:53.641114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f8810-1b70-4a2c-b47b-caf3dd9e1d8e None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:53.656185 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:53.682239 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf92fa0-6dd3-4075-8c3b-5ea337fecc8a None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:53.718000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381c23d-1130-41d1-9eca-fb09e2fa4448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:53.718635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381c23d-1130-41d1-9eca-fb09e2fa4448 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:53.719015 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381c23d-1130-41d1-9eca-fb09e2fa4448 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:53.719282 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381c23d-1130-41d1-9eca-fb09e2fa4448 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:53.719991 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381c23d-1130-41d1-9eca-fb09e2fa4448 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:53.720288 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381c23d-1130-41d1-9eca-fb09e2fa4448 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:53.721686 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381c23d-1130-41d1-9eca-fb09e2fa4448 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:53.729815 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 148/302] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 04:38:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:53.734171 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1cb06-8378-4911-a431-2a0ae6d5d477 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:53.734461 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1cb06-8378-4911-a431-2a0ae6d5d477 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:53.734737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1cb06-8378-4911-a431-2a0ae6d5d477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:53.749036 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f8810-1b70-4a2c-b47b-caf3dd9e1d8e None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:53.752321 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-1aa1cb06-8378-4911-a431-2a0ae6d5d477 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:53.753558 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-1aa1cb06-8378-4911-a431-2a0ae6d5d477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:53.780889 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01bf02c-687b-4dba-a499-7d9facab10ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:53.781501 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bf02c-687b-4dba-a499-7d9facab10ce None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:53.781771 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bf02c-687b-4dba-a499-7d9facab10ce None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:53.782068 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01bf02c-687b-4dba-a499-7d9facab10ce None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:53.782792 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01bf02c-687b-4dba-a499-7d9facab10ce None admin] RBAC: Adding query filter params (name=member) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:53.783172 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01bf02c-687b-4dba-a499-7d9facab10ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:53.784479 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01bf02c-687b-4dba-a499-7d9facab10ce None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:53.792381 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 155/303] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 04:38:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:38:53.793523 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a3f3d-f883-4508-b042-adc8ff3bd95a None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:53.793802 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a3f3d-f883-4508-b042-adc8ff3bd95a None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:53.794342 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a3f3d-f883-4508-b042-adc8ff3bd95a None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:53.796400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 156/304] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:53.796400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a3f3d-f883-4508-b042-adc8ff3bd95a None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:53.820519 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 149/305] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:53.821354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1cb06-8378-4911-a431-2a0ae6d5d477 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:53.858090 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:53.899417 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a3f3d-f883-4508-b042-adc8ff3bd95a None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:53.900567 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:53.931816 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4fa0c-08d8-417c-83de-2f306a64a09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:53.932463 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4fa0c-08d8-417c-83de-2f306a64a09c None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:53.932741 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4fa0c-08d8-417c-83de-2f306a64a09c None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:53.933013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4fa0c-08d8-417c-83de-2f306a64a09c None admin] PATH_INFO: `/v3/users/55831e1dbb6b4684a683405009972462` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:53.933339 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1cb06-8378-4911-a431-2a0ae6d5d477 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:53.934251 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4fa0c-08d8-417c-83de-2f306a64a09c None admin] RBAC: Authorizing `identity:get_user(user_id=55831e1dbb6b4684a683405009972462)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:53.935718 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4fa0c-08d8-417c-83de-2f306a64a09c None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:53.937330 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 157/306] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:53 2022] GET /identity/v3/users/55831e1dbb6b4684a683405009972462 => generated 297 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:53.938454 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899e445-ca97-48af-ac6f-3ed4cbbf7f84 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:53.938740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899e445-ca97-48af-ac6f-3ed4cbbf7f84 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:53.939012 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899e445-ca97-48af-ac6f-3ed4cbbf7f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:53.956572 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-c899e445-ca97-48af-ac6f-3ed4cbbf7f84 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:53.957749 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-c899e445-ca97-48af-ac6f-3ed4cbbf7f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:53.971172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c03ca-3e42-46a3-aee3-d32b5c98f8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:53.971999 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c03ca-3e42-46a3-aee3-d32b5c98f8b4 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:53.972362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c03ca-3e42-46a3-aee3-d32b5c98f8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:53.972664 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c03ca-3e42-46a3-aee3-d32b5c98f8b4 None admin] PATH_INFO: `/v3/users/065530520d3044c5bf0d4e0301169962` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:53.974005 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c03ca-3e42-46a3-aee3-d32b5c98f8b4 None admin] RBAC: Authorizing `identity:get_user(user_id=065530520d3044c5bf0d4e0301169962)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:53.976300 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c03ca-3e42-46a3-aee3-d32b5c98f8b4 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:53.978210 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 150/307] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:53 2022] GET /identity/v3/users/065530520d3044c5bf0d4e0301169962 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:53.978210 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c03ca-3e42-46a3-aee3-d32b5c98f8b4 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:54.031268 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 158/308] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:54.032037 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899e445-ca97-48af-ac6f-3ed4cbbf7f84 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:54.086729 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c03ca-3e42-46a3-aee3-d32b5c98f8b4 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:54.088357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:54.120321 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0d645-7a9a-4c43-9448-4f8ceb486f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:54.120965 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0d645-7a9a-4c43-9448-4f8ceb486f15 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:54.121237 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0d645-7a9a-4c43-9448-4f8ceb486f15 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:54.121503 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a0d645-7a9a-4c43-9448-4f8ceb486f15 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:54.124337 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:54.132369 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899e445-ca97-48af-ac6f-3ed4cbbf7f84 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:54.132571 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a0d645-7a9a-4c43-9448-4f8ceb486f15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:54.137448 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-49a0d645-7a9a-4c43-9448-4f8ceb486f15 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 04:38:54.137448 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:54.137448 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:54.137448 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:54.137448 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:54.137448 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:54.137448 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:54.137448 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:54.137448 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:54.137448 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:54.137448 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:54.137448 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:54.137448 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:54.137448 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:54.137448 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:54.137448 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:54.138389 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:54.138389 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:54.138389 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:54.138389 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:54.138389 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:54.138389 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:54.138389 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:54.138389 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:54.138389 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:54.138389 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:54.138389 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:54.138389 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:54.138389 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:54.138389 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:54.138389 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:54.138389 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:54.144440 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:54.144440 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:54.144440 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:54.144440 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:54.144440 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:54.144440 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:54.144440 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:54.144440 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:54.144440 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:54.144440 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:54.144440 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 04:38:54.144440 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:38:54.144440 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 151/309] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:38:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:38:54.144440 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0d645-7a9a-4c43-9448-4f8ceb486f15 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:54.165517 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93749a-9cb4-48ae-b66a-8b7c9a0b0b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:54.166165 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93749a-9cb4-48ae-b66a-8b7c9a0b0b57 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:54.166439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93749a-9cb4-48ae-b66a-8b7c9a0b0b57 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:54.166708 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c93749a-9cb4-48ae-b66a-8b7c9a0b0b57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:54.232730 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93749a-9cb4-48ae-b66a-8b7c9a0b0b57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:54.234240 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c93749a-9cb4-48ae-b66a-8b7c9a0b0b57 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:54.243130 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a0d645-7a9a-4c43-9448-4f8ceb486f15 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:54.276748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97575b-f9a0-4ecc-95f5-40cfd9fd4f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:54.277457 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97575b-f9a0-4ecc-95f5-40cfd9fd4f01 None admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:54.277734 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97575b-f9a0-4ecc-95f5-40cfd9fd4f01 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:54.278068 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97575b-f9a0-4ecc-95f5-40cfd9fd4f01 None admin] PATH_INFO: `/v3/system/users/065530520d3044c5bf0d4e0301169962/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:54.280958 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97575b-f9a0-4ecc-95f5-40cfd9fd4f01 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=065530520d3044c5bf0d4e0301169962, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:54.281066 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97575b-f9a0-4ecc-95f5-40cfd9fd4f01 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:54.289889 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 152/310] 10.222.0.39 () {58 vars in 1334 bytes} [Tue Jul 26 04:38:54 2022] PUT /identity/v3/system/users/065530520d3044c5bf0d4e0301169962/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:38:54.299223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97575b-f9a0-4ecc-95f5-40cfd9fd4f01 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:54.299955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:54.352126 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 159/311] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:38:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:38:54.352837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93749a-9cb4-48ae-b66a-8b7c9a0b0b57 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:54.369368 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:54.417236 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97575b-f9a0-4ecc-95f5-40cfd9fd4f01 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:54.459683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dcc4b3-5276-456a-bf93-ed3f09d38fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:54.459683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcc4b3-5276-456a-bf93-ed3f09d38fc2 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:54.459683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcc4b3-5276-456a-bf93-ed3f09d38fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:54.459683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dcc4b3-5276-456a-bf93-ed3f09d38fc2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:54.461731 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dcc4b3-5276-456a-bf93-ed3f09d38fc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:54.462931 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dcc4b3-5276-456a-bf93-ed3f09d38fc2 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:54.464753 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 153/312] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:38:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:54.465348 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dcc4b3-5276-456a-bf93-ed3f09d38fc2 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:54.472191 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c93749a-9cb4-48ae-b66a-8b7c9a0b0b57 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:54.506577 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c373121-270a-49b1-890d-1d7744d7e8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:54.507194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c373121-270a-49b1-890d-1d7744d7e8d9 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:54.507467 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c373121-270a-49b1-890d-1d7744d7e8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:54.507735 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c373121-270a-49b1-890d-1d7744d7e8d9 None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:54.508475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c373121-270a-49b1-890d-1d7744d7e8d9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:54.508778 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c373121-270a-49b1-890d-1d7744d7e8d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:54.510195 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c373121-270a-49b1-890d-1d7744d7e8d9 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:54.518748 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 160/313] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 04:38:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:54.519428 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c373121-270a-49b1-890d-1d7744d7e8d9 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:54.539373 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:54.577095 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dcc4b3-5276-456a-bf93-ed3f09d38fc2 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:54.603964 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:54.613210 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20deb533-bbac-45b2-b275-530e20d436d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:54.614124 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20deb533-bbac-45b2-b275-530e20d436d5 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:54.614416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20deb533-bbac-45b2-b275-530e20d436d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:54.614674 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20deb533-bbac-45b2-b275-530e20d436d5 None admin] PATH_INFO: `/v3/projects/e8127522c84e4d4e989b25defd999d24` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:54.615842 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20deb533-bbac-45b2-b275-530e20d436d5 None admin] RBAC: Authorizing `identity:get_project(project_id=e8127522c84e4d4e989b25defd999d24)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:54.617406 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20deb533-bbac-45b2-b275-530e20d436d5 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:54.623955 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 154/314] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:38:54 2022] GET /identity/v3/projects/e8127522c84e4d4e989b25defd999d24 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:54.623955 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20deb533-bbac-45b2-b275-530e20d436d5 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:54.633197 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c373121-270a-49b1-890d-1d7744d7e8d9 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:54.669956 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14c4e3-6a92-4109-8af9-84c63f75d5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:54.670877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14c4e3-6a92-4109-8af9-84c63f75d5fc None admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:54.671165 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14c4e3-6a92-4109-8af9-84c63f75d5fc None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:54.671592 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14c4e3-6a92-4109-8af9-84c63f75d5fc None admin] PATH_INFO: `/v3/groups` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:54.672542 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14c4e3-6a92-4109-8af9-84c63f75d5fc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:54.674054 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14c4e3-6a92-4109-8af9-84c63f75d5fc None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:54.692264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 161/315] 10.222.0.39 () {60 vars in 1134 bytes} [Tue Jul 26 04:38:54 2022] POST /identity/v3/groups => generated 229 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:38:54.693415 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14c4e3-6a92-4109-8af9-84c63f75d5fc None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:54.743095 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20deb533-bbac-45b2-b275-530e20d436d5 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:54.785353 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18aa89d-0f46-42f1-989e-eedd9e0e8a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:54.786788 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18aa89d-0f46-42f1-989e-eedd9e0e8a61 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:54.787078 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18aa89d-0f46-42f1-989e-eedd9e0e8a61 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:54.787352 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18aa89d-0f46-42f1-989e-eedd9e0e8a61 None admin] PATH_INFO: `/v3/users/d7e85e8896fd4a37bd057ea797a19ae4` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:54.791204 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:54.812276 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18aa89d-0f46-42f1-989e-eedd9e0e8a61 None admin] RBAC: Authorizing `identity:get_user(user_id=d7e85e8896fd4a37bd057ea797a19ae4)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:54.814339 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18aa89d-0f46-42f1-989e-eedd9e0e8a61 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:54.818057 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14c4e3-6a92-4109-8af9-84c63f75d5fc None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:54.822369 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 155/316] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:54 2022] GET /identity/v3/users/d7e85e8896fd4a37bd057ea797a19ae4 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:54.824413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18aa89d-0f46-42f1-989e-eedd9e0e8a61 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:54.859078 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e9fc1-f4e6-4aef-8894-b60277dc66e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:54.859734 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e9fc1-f4e6-4aef-8894-b60277dc66e6 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:54.860015 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e9fc1-f4e6-4aef-8894-b60277dc66e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:54.860289 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e9fc1-f4e6-4aef-8894-b60277dc66e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:54.861102 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e9fc1-f4e6-4aef-8894-b60277dc66e6 None admin] RBAC: Adding query filter params (role.id=b4b41ae21c5744628519a58257d04609, scope.project.id=e8127522c84e4d4e989b25defd999d24, user.id=55831e1dbb6b4684a683405009972462) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:54.861413 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e9fc1-f4e6-4aef-8894-b60277dc66e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:54.862945 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e9fc1-f4e6-4aef-8894-b60277dc66e6 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:54.869851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 162/317] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:38:54 2022] GET /identity/v3/role_assignments?user.id=55831e1dbb6b4684a683405009972462&scope.project.id=e8127522c84e4d4e989b25defd999d24&role.id=b4b41ae21c5744628519a58257d04609 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:54.897094 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:54.956287 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18aa89d-0f46-42f1-989e-eedd9e0e8a61 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:54.997944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f7c45-2261-4f39-b2c5-308c9036c320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:54.998651 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f7c45-2261-4f39-b2c5-308c9036c320 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:54.998931 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f7c45-2261-4f39-b2c5-308c9036c320 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:54.999202 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f7c45-2261-4f39-b2c5-308c9036c320 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:55.000029 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f7c45-2261-4f39-b2c5-308c9036c320 None admin] RBAC: Adding query filter params (role.id=b4b41ae21c5744628519a58257d04609, user.id=d7e85e8896fd4a37bd057ea797a19ae4, scope.system=all) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:55.000336 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f7c45-2261-4f39-b2c5-308c9036c320 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:55.001885 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f7c45-2261-4f39-b2c5-308c9036c320 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:55.008651 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 156/318] 10.222.0.39 () {56 vars in 1308 bytes} [Tue Jul 26 04:38:54 2022] GET /identity/v3/role_assignments?user.id=d7e85e8896fd4a37bd057ea797a19ae4&scope.system=all&role.id=b4b41ae21c5744628519a58257d04609 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:56.297245 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115e257-d4e6-4393-b400-6b84051c49fd None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:56.297770 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115e257-d4e6-4393-b400-6b84051c49fd None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:56.297770 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115e257-d4e6-4393-b400-6b84051c49fd None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:56.299413 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 163/319] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:56.304635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0737efe-bcd1-4608-ae2d-1e8807bc2b5e None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:56.305057 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0737efe-bcd1-4608-ae2d-1e8807bc2b5e None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:56.305229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0737efe-bcd1-4608-ae2d-1e8807bc2b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:56.324391 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-d0737efe-bcd1-4608-ae2d-1e8807bc2b5e None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:56.325961 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-d0737efe-bcd1-4608-ae2d-1e8807bc2b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:56.400690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 157/320] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:56.423308 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115e257-d4e6-4393-b400-6b84051c49fd None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:56.531688 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115e257-d4e6-4393-b400-6b84051c49fd None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:56.570011 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe8e7e-0363-4c9e-8955-a79a534e09d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:56.570596 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe8e7e-0363-4c9e-8955-a79a534e09d3 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:56.570868 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe8e7e-0363-4c9e-8955-a79a534e09d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:56.571139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe8e7e-0363-4c9e-8955-a79a534e09d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:56.582083 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efe8e7e-0363-4c9e-8955-a79a534e09d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:56.587597 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-4efe8e7e-0363-4c9e-8955-a79a534e09d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:38:56.587597 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:56.587597 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:56.587597 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:56.587597 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:56.587597 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:56.587597 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:56.587597 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:56.587597 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:56.587597 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:56.587597 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:56.587597 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:56.587597 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:56.587597 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:56.587597 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:56.587597 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:56.588466 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:56.588466 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:56.588466 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:56.588466 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:56.588466 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:56.588466 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:56.588466 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:56.588466 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:56.588466 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:56.588466 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:56.588466 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:56.588466 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:56.588466 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:56.588466 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:56.588466 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:56.588466 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:56.589269 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:56.589269 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:56.589269 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:56.589269 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:56.589269 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:56.589269 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:56.589269 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:56.589269 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:56.589269 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:56.589269 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:56.589269 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:38:56.589269 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:38:56.596663 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 164/321] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:38:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:38:56.596803 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0737efe-bcd1-4608-ae2d-1e8807bc2b5e None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:56.648896 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:56.708300 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0737efe-bcd1-4608-ae2d-1e8807bc2b5e None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:56.743825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ed256-7347-4979-8b46-196ef2410fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:56.744468 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ed256-7347-4979-8b46-196ef2410fd7 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:56.744749 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ed256-7347-4979-8b46-196ef2410fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:56.745022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ed256-7347-4979-8b46-196ef2410fd7 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:56.745739 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ed256-7347-4979-8b46-196ef2410fd7 None admin] RBAC: Adding query filter params (name=member) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:56.746071 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ed256-7347-4979-8b46-196ef2410fd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:56.747598 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ed256-7347-4979-8b46-196ef2410fd7 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:56.760934 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 158/322] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 04:38:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:56.762594 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe8e7e-0363-4c9e-8955-a79a534e09d3 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:56.765657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:56.804516 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18f842-f6ff-4966-a7bc-35ca3f0e314d None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:56.804799 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18f842-f6ff-4966-a7bc-35ca3f0e314d None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:56.805074 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db18f842-f6ff-4966-a7bc-35ca3f0e314d None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:56.806629 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 159/323] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:38:56.811453 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe19015-edaf-4afd-a071-f944dde854e4 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:56.811716 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe19015-edaf-4afd-a071-f944dde854e4 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:56.811980 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe19015-edaf-4afd-a071-f944dde854e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:56.830492 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-cbe19015-edaf-4afd-a071-f944dde854e4 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:56.831602 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-cbe19015-edaf-4afd-a071-f944dde854e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:56.872212 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe8e7e-0363-4c9e-8955-a79a534e09d3 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:56.901681 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 160/324] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 04:38:56.907530 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660522f1-2d83-45db-a2fb-0d98b0919712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:56.908186 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660522f1-2d83-45db-a2fb-0d98b0919712 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:56.908462 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660522f1-2d83-45db-a2fb-0d98b0919712 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:56.908730 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660522f1-2d83-45db-a2fb-0d98b0919712 None admin] PATH_INFO: `/v3/users/065530520d3044c5bf0d4e0301169962` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:56.909889 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660522f1-2d83-45db-a2fb-0d98b0919712 None admin] RBAC: Authorizing `identity:get_user(user_id=065530520d3044c5bf0d4e0301169962)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:56.911392 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660522f1-2d83-45db-a2fb-0d98b0919712 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:56.913205 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 165/325] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:56 2022] GET /identity/v3/users/065530520d3044c5bf0d4e0301169962 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:56.918971 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe19015-edaf-4afd-a071-f944dde854e4 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:56.923211 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660522f1-2d83-45db-a2fb-0d98b0919712 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:56.965167 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:56.997771 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:57.025801 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe19015-edaf-4afd-a071-f944dde854e4 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:57.030097 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660522f1-2d83-45db-a2fb-0d98b0919712 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:57.064423 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c6086-2814-49a3-b502-f753a8b65f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:57.065080 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c6086-2814-49a3-b502-f753a8b65f62 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:57.065362 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c6086-2814-49a3-b502-f753a8b65f62 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:57.065638 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c6086-2814-49a3-b502-f753a8b65f62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:57.066759 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bed9a5-f7c3-483a-bc87-980daa00b3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:57.066922 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c6086-2814-49a3-b502-f753a8b65f62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:57.067388 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bed9a5-f7c3-483a-bc87-980daa00b3fe None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:57.067673 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bed9a5-f7c3-483a-bc87-980daa00b3fe None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:57.067945 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bed9a5-f7c3-483a-bc87-980daa00b3fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:57.068423 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c6086-2814-49a3-b502-f753a8b65f62 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:57.068768 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bed9a5-f7c3-483a-bc87-980daa00b3fe None admin] RBAC: Adding query filter params (role.id=201d465b851546b1a19c322a3356d48d, user.id=065530520d3044c5bf0d4e0301169962, scope.system=all) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:57.069115 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bed9a5-f7c3-483a-bc87-980daa00b3fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:57.070216 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 166/326] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:38:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:38:57.070583 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bed9a5-f7c3-483a-bc87-980daa00b3fe None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:57.071349 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6d54f-e2c3-4856-b223-59db7c896d77 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:57.071633 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6d54f-e2c3-4856-b223-59db7c896d77 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:57.071911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6d54f-e2c3-4856-b223-59db7c896d77 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:57.073128 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 167/327] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:57.076074 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6d54f-e2c3-4856-b223-59db7c896d77 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:57.086083 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 161/328] 10.222.0.39 () {56 vars in 1308 bytes} [Tue Jul 26 04:38:56 2022] GET /identity/v3/role_assignments?user.id=065530520d3044c5bf0d4e0301169962&scope.system=all&role.id=201d465b851546b1a19c322a3356d48d => generated 510 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:57.087691 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78211539-eea8-42b2-9092-a81e487f16a8 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:57.087977 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78211539-eea8-42b2-9092-a81e487f16a8 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:57.088292 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78211539-eea8-42b2-9092-a81e487f16a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:57.111484 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-78211539-eea8-42b2-9092-a81e487f16a8 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:57.112843 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-78211539-eea8-42b2-9092-a81e487f16a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:57.187491 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 162/329] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:57.195840 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6d54f-e2c3-4856-b223-59db7c896d77 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:57.209941 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78211539-eea8-42b2-9092-a81e487f16a8 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:57.235587 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb3f06-9ab6-4b8d-a8f5-57c5e1829778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:57.236221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb3f06-9ab6-4b8d-a8f5-57c5e1829778 None admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:57.236514 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb3f06-9ab6-4b8d-a8f5-57c5e1829778 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:57.236797 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb3f06-9ab6-4b8d-a8f5-57c5e1829778 None admin] PATH_INFO: `/v3/groups` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:57.237583 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb3f06-9ab6-4b8d-a8f5-57c5e1829778 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:57.238306 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:57.239930 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb3f06-9ab6-4b8d-a8f5-57c5e1829778 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:57.252850 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:57.263105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 168/330] 10.222.0.39 () {60 vars in 1134 bytes} [Tue Jul 26 04:38:57 2022] POST /identity/v3/groups => generated 226 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:38:57.339549 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78211539-eea8-42b2-9092-a81e487f16a8 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:57.375701 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf5dae-45e4-496e-ba6b-89b4a28f675e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:57.376373 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf5dae-45e4-496e-ba6b-89b4a28f675e None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:57.376673 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf5dae-45e4-496e-ba6b-89b4a28f675e None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:57.376963 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf5dae-45e4-496e-ba6b-89b4a28f675e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:57.389444 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf5dae-45e4-496e-ba6b-89b4a28f675e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:38:57.394706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-71cf5dae-45e4-496e-ba6b-89b4a28f675e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 04:38:57.394706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:38:57.394706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:38:57.394706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:38:57.394706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:38:57.394706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:38:57.394706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:38:57.394706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:38:57.394706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:38:57.394706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:38:57.394706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:38:57.394706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:38:57.394706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:38:57.394706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:38:57.394706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:38:57.394706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:38:57.395653 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:38:57.395653 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:38:57.395653 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:38:57.395653 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:38:57.395653 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:38:57.395653 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:38:57.395653 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:38:57.395653 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:38:57.395653 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:38:57.395653 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:38:57.395653 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:38:57.395653 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:38:57.395653 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:38:57.395653 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:38:57.395653 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:38:57.395653 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:38:57.396453 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:38:57.396453 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:38:57.396453 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:38:57.396453 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:38:57.396453 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:38:57.396453 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:38:57.396453 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:38:57.396453 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:38:57.396453 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:38:57.396453 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:38:57.396453 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 04:38:57.396453 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:38:57.396453 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 163/331] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:38:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:38:57.402396 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb3f06-9ab6-4b8d-a8f5-57c5e1829778 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:57.510138 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb3f06-9ab6-4b8d-a8f5-57c5e1829778 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:57.546121 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdda97e-8dda-4a08-a9d3-ce2445dcee40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:57.546757 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdda97e-8dda-4a08-a9d3-ce2445dcee40 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:57.547042 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdda97e-8dda-4a08-a9d3-ce2445dcee40 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:57.547318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdda97e-8dda-4a08-a9d3-ce2445dcee40 None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:57.548060 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdda97e-8dda-4a08-a9d3-ce2445dcee40 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:38:57.548367 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdda97e-8dda-4a08-a9d3-ce2445dcee40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:57.549797 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdda97e-8dda-4a08-a9d3-ce2445dcee40 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:57.558993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 169/332] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 04:38:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:57.564607 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf5dae-45e4-496e-ba6b-89b4a28f675e None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:57.669605 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:57.681811 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf5dae-45e4-496e-ba6b-89b4a28f675e None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:57.722123 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18e3fd-f1ac-4fb8-b268-00573067de63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:57.723151 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18e3fd-f1ac-4fb8-b268-00573067de63 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:57.723626 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18e3fd-f1ac-4fb8-b268-00573067de63 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:57.724112 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18e3fd-f1ac-4fb8-b268-00573067de63 None admin] PATH_INFO: `/v3/users/d7e85e8896fd4a37bd057ea797a19ae4` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:57.725565 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18e3fd-f1ac-4fb8-b268-00573067de63 None admin] RBAC: Authorizing `identity:get_user(user_id=d7e85e8896fd4a37bd057ea797a19ae4)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:57.727277 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18e3fd-f1ac-4fb8-b268-00573067de63 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:57.729415 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 164/333] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:38:57 2022] GET /identity/v3/users/d7e85e8896fd4a37bd057ea797a19ae4 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:38:57.735155 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdda97e-8dda-4a08-a9d3-ce2445dcee40 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:38:57.801647 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:38:57.852153 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdda97e-8dda-4a08-a9d3-ce2445dcee40 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:38:57.888999 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29457fe2-550f-4179-a0dd-6d7d427f610a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:38:57.889690 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29457fe2-550f-4179-a0dd-6d7d427f610a None admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:57.889972 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29457fe2-550f-4179-a0dd-6d7d427f610a None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:57.890281 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29457fe2-550f-4179-a0dd-6d7d427f610a None admin] PATH_INFO: `/v3/system/users/d7e85e8896fd4a37bd057ea797a19ae4/roles/b4b41ae21c5744628519a58257d04609` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:57.891781 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29457fe2-550f-4179-a0dd-6d7d427f610a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d7e85e8896fd4a37bd057ea797a19ae4, role_id=b4b41ae21c5744628519a58257d04609)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:38:57.893206 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29457fe2-550f-4179-a0dd-6d7d427f610a None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:38:57.913747 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 170/334] 10.222.0.39 () {58 vars in 1334 bytes} [Tue Jul 26 04:38:57 2022] PUT /identity/v3/system/users/d7e85e8896fd4a37bd057ea797a19ae4/roles/b4b41ae21c5744628519a58257d04609 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:38:59.797016 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c123fd-7bae-4b4c-9bae-8306b958c5ce None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:59.797553 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c123fd-7bae-4b4c-9bae-8306b958c5ce None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:59.797848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c123fd-7bae-4b4c-9bae-8306b958c5ce None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:59.799657 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 165/335] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:38:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:38:59.804991 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a367910-e347-45da-bc93-6e47f844f0a4 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:38:59.805479 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a367910-e347-45da-bc93-6e47f844f0a4 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:38:59.805745 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a367910-e347-45da-bc93-6e47f844f0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:38:59.835185 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-2a367910-e347-45da-bc93-6e47f844f0a4 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:38:59.836425 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-2a367910-e347-45da-bc93-6e47f844f0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:38:59.928668 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 171/336] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:38:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:38:59.962131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c123fd-7bae-4b4c-9bae-8306b958c5ce None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:00.064167 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e819984-f190-44bb-94f9-7da14edabec6 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:00.064358 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e819984-f190-44bb-94f9-7da14edabec6 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:00.064612 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e819984-f190-44bb-94f9-7da14edabec6 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:00.070373 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 172/337] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:00.079476 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf11c1-36fc-4ef0-9ee9-2ff23887085e None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:00.079879 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf11c1-36fc-4ef0-9ee9-2ff23887085e None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:00.080164 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf11c1-36fc-4ef0-9ee9-2ff23887085e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:00.093108 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c123fd-7bae-4b4c-9bae-8306b958c5ce None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:00.115077 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-fadf11c1-36fc-4ef0-9ee9-2ff23887085e None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:00.116367 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-fadf11c1-36fc-4ef0-9ee9-2ff23887085e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:00.144405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d071c-5dc3-4516-8959-258a885d909e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:00.144405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d071c-5dc3-4516-8959-258a885d909e None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:00.144405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d071c-5dc3-4516-8959-258a885d909e None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:00.144405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d071c-5dc3-4516-8959-258a885d909e None admin] PATH_INFO: `/v3/roles/member` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:00.173173 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d071c-5dc3-4516-8959-258a885d909e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:00.178634 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-6d6d071c-5dc3-4516-8959-258a885d909e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:39:00.178634 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:00.178634 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:00.178634 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:00.178634 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:00.178634 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:00.178634 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:00.178634 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:00.178634 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:00.178634 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:00.178634 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:00.178634 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:00.178634 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:00.178634 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:00.178634 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:00.178634 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:00.179523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:00.179523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:00.179523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:00.179523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:00.179523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:00.179523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:00.179523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:00.179523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:00.179523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:00.179523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:00.179523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:00.179523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:00.179523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:00.179523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:00.179523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:00.179523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:00.180324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:00.180324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:00.180324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:00.180324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:00.180324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:00.180324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:00.180324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:00.180324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:00.180324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:00.180324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:00.180324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:39:00.180324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:00.187503 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 166/338] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:38:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:00.188721 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d071c-5dc3-4516-8959-258a885d909e None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:00.192960 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:00.224792 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 173/339] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:00.233071 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:00.276766 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf11c1-36fc-4ef0-9ee9-2ff23887085e None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:00.430471 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d071c-5dc3-4516-8959-258a885d909e None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:00.434457 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf11c1-36fc-4ef0-9ee9-2ff23887085e None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:00.488010 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c14c13-ee1c-4cdf-8a9e-fa2d2a5080a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:00.488679 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c14c13-ee1c-4cdf-8a9e-fa2d2a5080a7 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:00.488958 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c14c13-ee1c-4cdf-8a9e-fa2d2a5080a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:00.489235 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c14c13-ee1c-4cdf-8a9e-fa2d2a5080a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:00.507888 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813a9d1-6a0b-4e0d-971c-1f3967a66cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:00.508535 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813a9d1-6a0b-4e0d-971c-1f3967a66cc5 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:00.508814 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813a9d1-6a0b-4e0d-971c-1f3967a66cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:00.509085 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813a9d1-6a0b-4e0d-971c-1f3967a66cc5 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:00.509820 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813a9d1-6a0b-4e0d-971c-1f3967a66cc5 None admin] RBAC: Adding query filter params (name=member) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:00.510150 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813a9d1-6a0b-4e0d-971c-1f3967a66cc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:00.511561 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813a9d1-6a0b-4e0d-971c-1f3967a66cc5 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:00.516276 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c14c13-ee1c-4cdf-8a9e-fa2d2a5080a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:00.521551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-83c14c13-ee1c-4cdf-8a9e-fa2d2a5080a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:39:00.521551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:00.521551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:00.521551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:00.521551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:00.521551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:00.521551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:00.521551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:00.521551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:00.521551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:00.521551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:00.521551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:00.521551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:00.521551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:00.521551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:00.521551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:00.522511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:00.522511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:00.522511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:00.522511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:00.522511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:00.522511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:00.522511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:00.522511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:00.522511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:00.522511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:00.522511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:00.522511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:00.522511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:00.522511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:00.522511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:00.522511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:00.524224 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:00.524224 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:00.524224 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:00.524224 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:00.524224 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:00.524224 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:00.524224 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:00.524224 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:00.524224 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:00.524224 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:00.524224 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:39:00.524224 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:00.524224 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 174/340] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:39:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:39:00.531055 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c14c13-ee1c-4cdf-8a9e-fa2d2a5080a7 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:00.540625 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 167/341] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 04:39:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:00.546592 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813a9d1-6a0b-4e0d-971c-1f3967a66cc5 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:00.607194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:00.667142 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c14c13-ee1c-4cdf-8a9e-fa2d2a5080a7 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:00.708777 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68819a-fcda-4d7e-94d5-e18547756037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:00.709458 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68819a-fcda-4d7e-94d5-e18547756037 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:00.709739 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68819a-fcda-4d7e-94d5-e18547756037 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:00.710025 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68819a-fcda-4d7e-94d5-e18547756037 None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:00.710775 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68819a-fcda-4d7e-94d5-e18547756037 None admin] RBAC: Adding query filter params (name=member) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:00.711069 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68819a-fcda-4d7e-94d5-e18547756037 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:00.712478 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68819a-fcda-4d7e-94d5-e18547756037 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:00.733854 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 175/342] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 04:39:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:39:00.735195 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e87aa0-b20e-4aaa-b665-9feaef8314d8 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:00.735484 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e87aa0-b20e-4aaa-b665-9feaef8314d8 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:00.735761 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e87aa0-b20e-4aaa-b665-9feaef8314d8 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:00.743279 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 176/343] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:00.744165 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e87aa0-b20e-4aaa-b665-9feaef8314d8 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:00.751488 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:00.790669 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813a9d1-6a0b-4e0d-971c-1f3967a66cc5 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:00.856016 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc87243-b76b-4835-8bd9-2bb58c16bfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:00.856913 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc87243-b76b-4835-8bd9-2bb58c16bfb6 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:00.857612 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc87243-b76b-4835-8bd9-2bb58c16bfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:00.857899 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc87243-b76b-4835-8bd9-2bb58c16bfb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:00.910601 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e87aa0-b20e-4aaa-b665-9feaef8314d8 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:00.922932 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:00.955472 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc87243-b76b-4835-8bd9-2bb58c16bfb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:00.956963 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc87243-b76b-4835-8bd9-2bb58c16bfb6 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:00.966334 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec3921-6fc8-4163-b824-76c82648fb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:00.967285 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec3921-6fc8-4163-b824-76c82648fb7e None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:00.967800 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec3921-6fc8-4163-b824-76c82648fb7e None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:00.968303 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec3921-6fc8-4163-b824-76c82648fb7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:01.046188 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec3921-6fc8-4163-b824-76c82648fb7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:01.048057 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec3921-6fc8-4163-b824-76c82648fb7e None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:01.054127 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:01.085118 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 168/344] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:39:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 04:39:01.090756 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfceefe-2f33-41c8-8f97-d2b19fdd6c8d None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:01.091065 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfceefe-2f33-41c8-8f97-d2b19fdd6c8d None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:01.091327 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfceefe-2f33-41c8-8f97-d2b19fdd6c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:01.111804 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-9cfceefe-2f33-41c8-8f97-d2b19fdd6c8d None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:01.113130 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-9cfceefe-2f33-41c8-8f97-d2b19fdd6c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:01.162586 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 177/345] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:39:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:01.164264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d7575-d14f-47d6-9ce1-c45e64a3a459 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:01.164801 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d7575-d14f-47d6-9ce1-c45e64a3a459 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:01.165277 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d7575-d14f-47d6-9ce1-c45e64a3a459 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:01.167177 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 178/346] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:01.168251 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d7575-d14f-47d6-9ce1-c45e64a3a459 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:01.177877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:01.203837 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 169/347] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:01.205032 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfceefe-2f33-41c8-8f97-d2b19fdd6c8d None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:01.279331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d7575-d14f-47d6-9ce1-c45e64a3a459 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:01.317705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c2f99-ae49-4b93-8693-b8ce26408c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:01.318723 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c2f99-ae49-4b93-8693-b8ce26408c9d None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:01.319012 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c2f99-ae49-4b93-8693-b8ce26408c9d None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:01.319288 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c2f99-ae49-4b93-8693-b8ce26408c9d None admin] PATH_INFO: `/v3/projects/e8127522c84e4d4e989b25defd999d24` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:01.320532 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c2f99-ae49-4b93-8693-b8ce26408c9d None admin] RBAC: Authorizing `identity:get_project(project_id=e8127522c84e4d4e989b25defd999d24)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:01.322009 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c2f99-ae49-4b93-8693-b8ce26408c9d None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:01.324415 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 179/348] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:39:01 2022] GET /identity/v3/projects/e8127522c84e4d4e989b25defd999d24 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:01.329121 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd12a8-9875-4e6e-b1da-bef82f9567c4 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:01.329121 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd12a8-9875-4e6e-b1da-bef82f9567c4 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:01.329121 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd12a8-9875-4e6e-b1da-bef82f9567c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:01.347100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-9afd12a8-9875-4e6e-b1da-bef82f9567c4 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:01.348350 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-9afd12a8-9875-4e6e-b1da-bef82f9567c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:01.351157 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfceefe-2f33-41c8-8f97-d2b19fdd6c8d None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:01.366371 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:01.402955 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1c5fe-4dc4-4012-88b7-28e2a5d09ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:01.404128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1c5fe-4dc4-4012-88b7-28e2a5d09ed1 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:01.404677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1c5fe-4dc4-4012-88b7-28e2a5d09ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:01.404956 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1c5fe-4dc4-4012-88b7-28e2a5d09ed1 None admin] PATH_INFO: `/v3/projects/bb5564ea35cb4871823a95b50fd471c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:01.406765 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1c5fe-4dc4-4012-88b7-28e2a5d09ed1 None admin] RBAC: Authorizing `identity:get_project(project_id=bb5564ea35cb4871823a95b50fd471c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:01.409377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e1c5fe-4dc4-4012-88b7-28e2a5d09ed1 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:01.412319 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 170/349] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:39:01 2022] GET /identity/v3/projects/bb5564ea35cb4871823a95b50fd471c7 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:01.413200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1c5fe-4dc4-4012-88b7-28e2a5d09ed1 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:01.442183 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 180/350] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:01.444465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd12a8-9875-4e6e-b1da-bef82f9567c4 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:01.451239 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:01.555767 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1c5fe-4dc4-4012-88b7-28e2a5d09ed1 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:01.599933 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8bd0c9-e9eb-4e98-a807-7c50615e7972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:01.600910 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bd0c9-e9eb-4e98-a807-7c50615e7972 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:01.601203 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bd0c9-e9eb-4e98-a807-7c50615e7972 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:01.601467 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bd0c9-e9eb-4e98-a807-7c50615e7972 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:01.603920 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd12a8-9875-4e6e-b1da-bef82f9567c4 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:01.616575 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8bd0c9-e9eb-4e98-a807-7c50615e7972 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:01.623129 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-5a8bd0c9-e9eb-4e98-a807-7c50615e7972 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 04:39:01.623129 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:01.623129 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:01.623129 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:01.623129 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:01.623129 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:01.623129 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:01.623129 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:01.623129 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:01.623129 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:01.623129 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:01.623129 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:01.623129 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:01.623129 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:01.623129 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:01.623129 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:01.624096 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:01.624096 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:01.624096 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:01.624096 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:01.624096 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:01.624096 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:01.624096 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:01.624096 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:01.624096 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:01.624096 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:01.624096 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:01.624096 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:01.624096 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:01.624096 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:01.624096 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:01.624096 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:01.624928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:01.624928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:01.624928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:01.624928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:01.624928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:01.624928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:01.624928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:01.624928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:01.624928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:01.624928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:01.624928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 26 04:39:01.624928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:01.624928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 171/351] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:39:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:01.625619 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8bd0c9-e9eb-4e98-a807-7c50615e7972 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:01.663836 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62862b67-7bf1-4c56-a566-05c2abf2b978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:01.664989 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62862b67-7bf1-4c56-a566-05c2abf2b978 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:01.665279 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62862b67-7bf1-4c56-a566-05c2abf2b978 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:01.665561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62862b67-7bf1-4c56-a566-05c2abf2b978 None admin] PATH_INFO: `/v3/groups/c614d076bb7348588c1d6847057ddf4c` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:01.672528 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62862b67-7bf1-4c56-a566-05c2abf2b978 None admin] RBAC: Authorizing `identity:get_group(group_id=c614d076bb7348588c1d6847057ddf4c)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:01.674132 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62862b67-7bf1-4c56-a566-05c2abf2b978 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:01.676010 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 181/352] 10.222.0.39 () {56 vars in 1180 bytes} [Tue Jul 26 04:39:01 2022] GET /identity/v3/groups/c614d076bb7348588c1d6847057ddf4c => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:01.676631 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62862b67-7bf1-4c56-a566-05c2abf2b978 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:01.682504 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:01.755177 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:01.765300 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8bd0c9-e9eb-4e98-a807-7c50615e7972 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:01.800405 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62862b67-7bf1-4c56-a566-05c2abf2b978 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:01.806128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35c2ec-476a-4732-9894-8dacc6b1dc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:01.806480 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35c2ec-476a-4732-9894-8dacc6b1dc6a None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:01.806757 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35c2ec-476a-4732-9894-8dacc6b1dc6a None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:01.807031 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35c2ec-476a-4732-9894-8dacc6b1dc6a None admin] PATH_INFO: `/v3/groups/c614d076bb7348588c1d6847057ddf4c` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:01.808254 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35c2ec-476a-4732-9894-8dacc6b1dc6a None admin] RBAC: Authorizing `identity:get_group(group_id=c614d076bb7348588c1d6847057ddf4c)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:01.810857 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35c2ec-476a-4732-9894-8dacc6b1dc6a None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:01.812487 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 172/353] 10.222.0.39 () {56 vars in 1180 bytes} [Tue Jul 26 04:39:01 2022] GET /identity/v3/groups/c614d076bb7348588c1d6847057ddf4c => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:01.813671 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8610c-43c6-45ff-b4a0-1c9ef2f00201 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:01.813952 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8610c-43c6-45ff-b4a0-1c9ef2f00201 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:01.814295 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8610c-43c6-45ff-b4a0-1c9ef2f00201 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:01.815529 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 173/354] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:01.816257 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8610c-43c6-45ff-b4a0-1c9ef2f00201 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:01.850491 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce78f00-6596-4254-a21d-b0a3faaeabc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:01.851466 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce78f00-6596-4254-a21d-b0a3faaeabc3 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:01.851733 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce78f00-6596-4254-a21d-b0a3faaeabc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:01.852023 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce78f00-6596-4254-a21d-b0a3faaeabc3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:01.863636 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce78f00-6596-4254-a21d-b0a3faaeabc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:01.869302 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-1ce78f00-6596-4254-a21d-b0a3faaeabc3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 04:39:01.869302 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:01.869302 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:01.869302 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:01.869302 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:01.869302 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:01.869302 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:01.869302 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:01.869302 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:01.869302 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:01.869302 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:01.869302 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:01.869302 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:01.869302 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:01.869302 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:01.869302 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:01.870861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:01.870861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:01.870861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:01.870861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:01.870861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:01.870861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:01.870861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:01.870861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:01.870861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:01.870861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:01.870861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:01.870861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:01.870861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:01.870861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:01.870861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:01.870861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:01.872223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:01.872223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:01.872223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:01.872223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:01.872223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:01.872223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:01.872223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:01.872223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:01.872223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:01.872223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:01.872223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 04:39:01.872223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:01.872223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 182/355] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 04:39:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:01.872223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce78f00-6596-4254-a21d-b0a3faaeabc3 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:01.951703 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8610c-43c6-45ff-b4a0-1c9ef2f00201 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:01.954378 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:01.994832 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce78f00-6596-4254-a21d-b0a3faaeabc3 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:01.999588 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b05c7a-cfb1-4591-92c6-8e3029f31e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:02.000532 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b05c7a-cfb1-4591-92c6-8e3029f31e8d None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:02.000820 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b05c7a-cfb1-4591-92c6-8e3029f31e8d None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:02.001094 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b05c7a-cfb1-4591-92c6-8e3029f31e8d None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:02.001826 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b05c7a-cfb1-4591-92c6-8e3029f31e8d None admin] RBAC: Adding query filter params (name=reader) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:02.002605 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b05c7a-cfb1-4591-92c6-8e3029f31e8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:02.003726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b05c7a-cfb1-4591-92c6-8e3029f31e8d None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:02.013391 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 174/356] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 04:39:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:02.015341 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16b349-9f31-48cb-86d0-11029fb65f64 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:02.015630 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16b349-9f31-48cb-86d0-11029fb65f64 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:02.016341 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16b349-9f31-48cb-86d0-11029fb65f64 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:02.017194 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 175/357] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:02.018501 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f12ac6-3f8a-4c02-833f-44149e7659a1 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:02.018831 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f12ac6-3f8a-4c02-833f-44149e7659a1 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:02.019119 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f12ac6-3f8a-4c02-833f-44149e7659a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:02.032472 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:02.044545 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502c1e2-56a7-46f7-ba30-c858ff42fdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:02.044745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-61f12ac6-3f8a-4c02-833f-44149e7659a1 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:02.045186 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502c1e2-56a7-46f7-ba30-c858ff42fdd0 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:02.045465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502c1e2-56a7-46f7-ba30-c858ff42fdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:02.046147 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502c1e2-56a7-46f7-ba30-c858ff42fdd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:02.046273 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-61f12ac6-3f8a-4c02-833f-44149e7659a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:02.046585 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502c1e2-56a7-46f7-ba30-c858ff42fdd0 None admin] RBAC: Adding query filter params (group.id=c614d076bb7348588c1d6847057ddf4c, role.id=201d465b851546b1a19c322a3356d48d, scope.project.id=e8127522c84e4d4e989b25defd999d24) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:02.046893 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502c1e2-56a7-46f7-ba30-c858ff42fdd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:02.048821 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502c1e2-56a7-46f7-ba30-c858ff42fdd0 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:02.054954 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 183/358] 10.222.0.39 () {56 vars in 1376 bytes} [Tue Jul 26 04:39:01 2022] GET /identity/v3/role_assignments?group.id=c614d076bb7348588c1d6847057ddf4c&scope.project.id=e8127522c84e4d4e989b25defd999d24&role.id=201d465b851546b1a19c322a3356d48d => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:02.055772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502c1e2-56a7-46f7-ba30-c858ff42fdd0 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:02.146652 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 176/359] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:02.147552 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f12ac6-3f8a-4c02-833f-44149e7659a1 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:02.199584 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502c1e2-56a7-46f7-ba30-c858ff42fdd0 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:02.262753 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c435e-9814-40de-b188-994c4acfa1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:02.269202 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c435e-9814-40de-b188-994c4acfa1c5 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:02.269598 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c435e-9814-40de-b188-994c4acfa1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:02.270040 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c435e-9814-40de-b188-994c4acfa1c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:02.272345 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c435e-9814-40de-b188-994c4acfa1c5 None admin] RBAC: Adding query filter params (group.id=c614d076bb7348588c1d6847057ddf4c, role.id=201d465b851546b1a19c322a3356d48d, scope.project.id=bb5564ea35cb4871823a95b50fd471c7) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:02.273679 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c435e-9814-40de-b188-994c4acfa1c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:02.274359 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:02.274631 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c435e-9814-40de-b188-994c4acfa1c5 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:02.280038 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f12ac6-3f8a-4c02-833f-44149e7659a1 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:02.283025 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 184/360] 10.222.0.39 () {56 vars in 1376 bytes} [Tue Jul 26 04:39:02 2022] GET /identity/v3/role_assignments?group.id=c614d076bb7348588c1d6847057ddf4c&scope.project.id=bb5564ea35cb4871823a95b50fd471c7&role.id=201d465b851546b1a19c322a3356d48d => generated 260 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:02.283902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c435e-9814-40de-b188-994c4acfa1c5 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:02.328110 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4569b-f820-4a1e-8d3f-4f03806ac915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:02.328848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4569b-f820-4a1e-8d3f-4f03806ac915 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:02.329124 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4569b-f820-4a1e-8d3f-4f03806ac915 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:02.329502 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4569b-f820-4a1e-8d3f-4f03806ac915 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:02.330357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4569b-f820-4a1e-8d3f-4f03806ac915 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:02.330661 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4569b-f820-4a1e-8d3f-4f03806ac915 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:02.332122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4569b-f820-4a1e-8d3f-4f03806ac915 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:02.343834 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 177/361] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:02.345349 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0754e22-00cf-441d-b618-3e9ccea7c84a None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:02.345635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0754e22-00cf-441d-b618-3e9ccea7c84a None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:02.345906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0754e22-00cf-441d-b618-3e9ccea7c84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:02.366766 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:02.367764 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-b0754e22-00cf-441d-b618-3e9ccea7c84a None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:02.369013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-b0754e22-00cf-441d-b618-3e9ccea7c84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:02.448627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c435e-9814-40de-b188-994c4acfa1c5 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:02.479016 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 178/362] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:02.480261 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0754e22-00cf-441d-b618-3e9ccea7c84a None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:02.512427 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a6824-3855-49fe-bb37-91ba28b952d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:02.513099 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a6824-3855-49fe-bb37-91ba28b952d4 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:02.513374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a6824-3855-49fe-bb37-91ba28b952d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:02.513654 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a6824-3855-49fe-bb37-91ba28b952d4 None admin] PATH_INFO: `/v3/users/d7e85e8896fd4a37bd057ea797a19ae4` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:02.516305 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a6824-3855-49fe-bb37-91ba28b952d4 None admin] RBAC: Authorizing `identity:get_user(user_id=d7e85e8896fd4a37bd057ea797a19ae4)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:02.517798 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a6824-3855-49fe-bb37-91ba28b952d4 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:02.519830 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 185/363] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:39:02 2022] GET /identity/v3/users/d7e85e8896fd4a37bd057ea797a19ae4 => generated 293 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:02.524993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a6824-3855-49fe-bb37-91ba28b952d4 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:02.602446 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:02.624883 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0754e22-00cf-441d-b618-3e9ccea7c84a None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:02.663111 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a6824-3855-49fe-bb37-91ba28b952d4 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:02.673256 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd3dc1-4096-41ac-8ae8-eea7250f96ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:02.674407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd3dc1-4096-41ac-8ae8-eea7250f96ea None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:02.674807 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd3dc1-4096-41ac-8ae8-eea7250f96ea None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:02.675694 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd3dc1-4096-41ac-8ae8-eea7250f96ea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:02.691333 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:02.700230 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbd3dc1-4096-41ac-8ae8-eea7250f96ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:02.704630 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72814935-3c52-4415-8829-37c7c79b6bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:02.705310 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72814935-3c52-4415-8829-37c7c79b6bf3 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:02.705593 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72814935-3c52-4415-8829-37c7c79b6bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:02.705919 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72814935-3c52-4415-8829-37c7c79b6bf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:02.708614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-4fbd3dc1-4096-41ac-8ae8-eea7250f96ea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 04:39:02.708614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:02.708614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:02.708614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:02.708614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:02.708614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:02.708614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:02.708614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:02.708614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:02.708614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:02.708614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:02.708614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:02.708614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:02.708614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:02.708614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:02.708614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:02.709622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:02.709622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:02.709622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:02.709622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:02.709622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:02.709622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:02.709622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:02.709622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:02.709622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:02.709622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:02.709622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:02.709622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:02.709622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:02.709622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:02.709622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:02.709622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:02.710482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:02.710482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:02.710482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:02.710482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:02.710482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:02.710482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:02.710482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:02.710482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:02.710482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:02.710482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:02.710482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 04:39:02.710482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:02.713827 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 179/364] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 04:39:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:02.713827 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd3dc1-4096-41ac-8ae8-eea7250f96ea None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:02.801210 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72814935-3c52-4415-8829-37c7c79b6bf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:02.802815 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72814935-3c52-4415-8829-37c7c79b6bf3 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:02.846543 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd3dc1-4096-41ac-8ae8-eea7250f96ea None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:02.894796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3f5f9-481a-45bf-a241-fa613ac4ebd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:02.895431 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3f5f9-481a-45bf-a241-fa613ac4ebd5 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:02.895958 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3f5f9-481a-45bf-a241-fa613ac4ebd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:02.896235 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff3f5f9-481a-45bf-a241-fa613ac4ebd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:02.897534 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3f5f9-481a-45bf-a241-fa613ac4ebd5 None admin] RBAC: Adding query filter params (role.id=b4b41ae21c5744628519a58257d04609, user.id=d7e85e8896fd4a37bd057ea797a19ae4, scope.system=all) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:02.897861 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3f5f9-481a-45bf-a241-fa613ac4ebd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:02.899911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff3f5f9-481a-45bf-a241-fa613ac4ebd5 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:02.916188 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 180/365] 10.222.0.39 () {56 vars in 1308 bytes} [Tue Jul 26 04:39:02 2022] GET /identity/v3/role_assignments?user.id=d7e85e8896fd4a37bd057ea797a19ae4&scope.system=all&role.id=b4b41ae21c5744628519a58257d04609 => generated 510 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:02.917038 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3f5f9-481a-45bf-a241-fa613ac4ebd5 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:02.917225 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 186/366] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:39:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:02.918101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72814935-3c52-4415-8829-37c7c79b6bf3 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:02.935536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:02.953932 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:03.058896 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff3f5f9-481a-45bf-a241-fa613ac4ebd5 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:03.059728 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72814935-3c52-4415-8829-37c7c79b6bf3 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:03.101002 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacf13b-3ec1-4fa4-889a-485dd0c8849a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:03.102185 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacf13b-3ec1-4fa4-889a-485dd0c8849a None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:03.102640 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacf13b-3ec1-4fa4-889a-485dd0c8849a None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:03.103018 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacf13b-3ec1-4fa4-889a-485dd0c8849a None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:03.104048 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dacf13b-3ec1-4fa4-889a-485dd0c8849a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:03.104528 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dacf13b-3ec1-4fa4-889a-485dd0c8849a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:03.106835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dacf13b-3ec1-4fa4-889a-485dd0c8849a None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:03.116478 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6b6ea-969b-4876-94e0-5edd65a4e057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:03.117160 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6b6ea-969b-4876-94e0-5edd65a4e057 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:03.117441 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6b6ea-969b-4876-94e0-5edd65a4e057 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:03.117713 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6b6ea-969b-4876-94e0-5edd65a4e057 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:03.118329 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 187/367] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:03.119186 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacf13b-3ec1-4fa4-889a-485dd0c8849a None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:03.137231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6b6ea-969b-4876-94e0-5edd65a4e057 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:03.143539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-d4e6b6ea-969b-4876-94e0-5edd65a4e057 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:39:03.143539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:03.143539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:03.143539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:03.143539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:03.143539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:03.143539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:03.143539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:03.143539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:03.143539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:03.143539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:03.143539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:03.143539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:03.143539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:03.143539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:03.143539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:03.145637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:03.145637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:03.145637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:03.145637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:03.145637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:03.145637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:03.145637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:03.145637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:03.145637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:03.145637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:03.145637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:03.145637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:03.145637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:03.145637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:03.145637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:03.145637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:03.147784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:03.147784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:03.147784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:03.147784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:03.147784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:03.147784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:03.147784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:03.147784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:03.147784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:03.147784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:03.147784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:39:03.147784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:03.147784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 181/368] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:39:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:03.147784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6b6ea-969b-4876-94e0-5edd65a4e057 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:03.288132 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:03.297520 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:03.317782 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacf13b-3ec1-4fa4-889a-485dd0c8849a None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:03.339850 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6b6ea-969b-4876-94e0-5edd65a4e057 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:03.367471 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8451d14-a260-462e-90d2-ae476411fbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:03.368144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8451d14-a260-462e-90d2-ae476411fbe0 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:03.368425 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8451d14-a260-462e-90d2-ae476411fbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:03.368697 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8451d14-a260-462e-90d2-ae476411fbe0 None admin] PATH_INFO: `/v3/projects/bb5564ea35cb4871823a95b50fd471c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:03.369890 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8451d14-a260-462e-90d2-ae476411fbe0 None admin] RBAC: Authorizing `identity:get_project(project_id=bb5564ea35cb4871823a95b50fd471c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:03.371587 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8451d14-a260-462e-90d2-ae476411fbe0 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:03.373396 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 188/369] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:39:03 2022] GET /identity/v3/projects/bb5564ea35cb4871823a95b50fd471c7 => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:03.374232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8451d14-a260-462e-90d2-ae476411fbe0 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:03.394465 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319eb147-3716-47ea-a24e-b10086bd203c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:03.395112 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319eb147-3716-47ea-a24e-b10086bd203c None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:03.395388 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319eb147-3716-47ea-a24e-b10086bd203c None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:03.395665 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319eb147-3716-47ea-a24e-b10086bd203c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:03.482408 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319eb147-3716-47ea-a24e-b10086bd203c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:03.484323 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319eb147-3716-47ea-a24e-b10086bd203c None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:03.520362 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8451d14-a260-462e-90d2-ae476411fbe0 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:03.555539 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f936a7c-c535-455d-974b-ae770d610c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:03.555996 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f936a7c-c535-455d-974b-ae770d610c6b None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:03.556302 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f936a7c-c535-455d-974b-ae770d610c6b None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:03.556534 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f936a7c-c535-455d-974b-ae770d610c6b None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:03.557258 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f936a7c-c535-455d-974b-ae770d610c6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:03.557559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f936a7c-c535-455d-974b-ae770d610c6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:03.562804 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:03.563136 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f936a7c-c535-455d-974b-ae770d610c6b None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:03.591119 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 189/370] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:39:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:03.592002 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f936a7c-c535-455d-974b-ae770d610c6b None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:03.622551 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 182/371] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:39:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:03.623461 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319eb147-3716-47ea-a24e-b10086bd203c None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:03.648644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:03.752713 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f936a7c-c535-455d-974b-ae770d610c6b None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:03.753386 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319eb147-3716-47ea-a24e-b10086bd203c None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:03.795216 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299a40b-d0ed-4636-a679-0843b4d1a6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:03.795443 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262fec2-b4dd-40ac-83ff-ff7eb745d6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:03.796009 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262fec2-b4dd-40ac-83ff-ff7eb745d6f1 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:03.796292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262fec2-b4dd-40ac-83ff-ff7eb745d6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:03.796567 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262fec2-b4dd-40ac-83ff-ff7eb745d6f1 None admin] PATH_INFO: `/v3/groups/c614d076bb7348588c1d6847057ddf4c` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:03.797252 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299a40b-d0ed-4636-a679-0843b4d1a6fd None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:03.797731 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262fec2-b4dd-40ac-83ff-ff7eb745d6f1 None admin] RBAC: Authorizing `identity:get_group(group_id=c614d076bb7348588c1d6847057ddf4c)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:03.797843 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299a40b-d0ed-4636-a679-0843b4d1a6fd None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:03.798338 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299a40b-d0ed-4636-a679-0843b4d1a6fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:03.799257 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262fec2-b4dd-40ac-83ff-ff7eb745d6f1 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:03.807423 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 190/372] 10.222.0.39 () {56 vars in 1180 bytes} [Tue Jul 26 04:39:03 2022] GET /identity/v3/groups/c614d076bb7348588c1d6847057ddf4c => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:03.807423 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262fec2-b4dd-40ac-83ff-ff7eb745d6f1 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:03.858782 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:03.899934 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7299a40b-d0ed-4636-a679-0843b4d1a6fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:03.901365 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7299a40b-d0ed-4636-a679-0843b4d1a6fd None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:03.931504 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:03.959389 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262fec2-b4dd-40ac-83ff-ff7eb745d6f1 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:04.005435 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3040d1-1d52-446b-8899-52ffacce020e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:04.006435 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3040d1-1d52-446b-8899-52ffacce020e None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:04.006902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3040d1-1d52-446b-8899-52ffacce020e None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:04.007881 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3040d1-1d52-446b-8899-52ffacce020e None admin] PATH_INFO: `/v3/projects/e8127522c84e4d4e989b25defd999d24` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:04.009758 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3040d1-1d52-446b-8899-52ffacce020e None admin] RBAC: Authorizing `identity:get_project(project_id=e8127522c84e4d4e989b25defd999d24)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:04.011950 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3040d1-1d52-446b-8899-52ffacce020e None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:04.014983 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 191/373] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:39:03 2022] GET /identity/v3/projects/e8127522c84e4d4e989b25defd999d24 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:04.015968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3040d1-1d52-446b-8899-52ffacce020e None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:04.039106 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 183/374] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:39:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:04.045336 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299a40b-d0ed-4636-a679-0843b4d1a6fd None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:04.137781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:04.157534 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3040d1-1d52-446b-8899-52ffacce020e None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:04.190134 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299a40b-d0ed-4636-a679-0843b4d1a6fd None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:04.211863 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637d909-242f-41d5-bd1f-8d53634e830d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:04.212508 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637d909-242f-41d5-bd1f-8d53634e830d None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:04.212789 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637d909-242f-41d5-bd1f-8d53634e830d None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:04.213063 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637d909-242f-41d5-bd1f-8d53634e830d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:04.213874 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637d909-242f-41d5-bd1f-8d53634e830d None admin] RBAC: Adding query filter params (group.id=c614d076bb7348588c1d6847057ddf4c, role.id=e2b16a5edd7b472487fac12492349bc7, scope.project.id=bb5564ea35cb4871823a95b50fd471c7) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:04.214257 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637d909-242f-41d5-bd1f-8d53634e830d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:04.215701 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637d909-242f-41d5-bd1f-8d53634e830d None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:04.228893 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 192/375] 10.222.0.39 () {56 vars in 1376 bytes} [Tue Jul 26 04:39:04 2022] GET /identity/v3/role_assignments?group.id=c614d076bb7348588c1d6847057ddf4c&scope.project.id=bb5564ea35cb4871823a95b50fd471c7&role.id=e2b16a5edd7b472487fac12492349bc7 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:04.230258 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637d909-242f-41d5-bd1f-8d53634e830d None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:04.254262 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbebcd-b08e-4332-bc54-0d2e1ac7d76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:04.256810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbebcd-b08e-4332-bc54-0d2e1ac7d76b None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:04.257091 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbebcd-b08e-4332-bc54-0d2e1ac7d76b None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:04.257369 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cbebcd-b08e-4332-bc54-0d2e1ac7d76b None admin] PATH_INFO: `/v3/groups/c614d076bb7348588c1d6847057ddf4c` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:04.260831 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cbebcd-b08e-4332-bc54-0d2e1ac7d76b None admin] RBAC: Authorizing `identity:get_group(group_id=c614d076bb7348588c1d6847057ddf4c)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:04.265589 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cbebcd-b08e-4332-bc54-0d2e1ac7d76b None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:04.269362 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:04.271626 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 184/376] 10.222.0.39 () {56 vars in 1180 bytes} [Tue Jul 26 04:39:04 2022] GET /identity/v3/groups/c614d076bb7348588c1d6847057ddf4c => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:04.278593 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbebcd-b08e-4332-bc54-0d2e1ac7d76b None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:04.411056 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637d909-242f-41d5-bd1f-8d53634e830d None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:04.460601 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ba66e-9616-4bd1-9a60-a12d04bec8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:04.462014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ba66e-9616-4bd1-9a60-a12d04bec8e9 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:04.462447 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ba66e-9616-4bd1-9a60-a12d04bec8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:04.462881 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0ba66e-9616-4bd1-9a60-a12d04bec8e9 None admin] PATH_INFO: `/v3/projects/01e6e551a86f4df9abc0b95c6772bf0e` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:04.464918 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ba66e-9616-4bd1-9a60-a12d04bec8e9 None admin] RBAC: Authorizing `identity:get_project(project_id=01e6e551a86f4df9abc0b95c6772bf0e)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:04.467324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0ba66e-9616-4bd1-9a60-a12d04bec8e9 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:04.469793 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 193/377] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:39:04 2022] GET /identity/v3/projects/01e6e551a86f4df9abc0b95c6772bf0e => generated 344 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:04.475593 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ba66e-9616-4bd1-9a60-a12d04bec8e9 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:04.494006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cbebcd-b08e-4332-bc54-0d2e1ac7d76b None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:04.536465 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ce121-5613-47d2-b743-f5e8217d3a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:04.537521 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ce121-5613-47d2-b743-f5e8217d3a98 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:04.538070 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ce121-5613-47d2-b743-f5e8217d3a98 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:04.538482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ce121-5613-47d2-b743-f5e8217d3a98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:04.539432 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ce121-5613-47d2-b743-f5e8217d3a98 None admin] RBAC: Adding query filter params (group.id=c614d076bb7348588c1d6847057ddf4c, role.id=e2b16a5edd7b472487fac12492349bc7, scope.project.id=e8127522c84e4d4e989b25defd999d24) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:04.539902 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ce121-5613-47d2-b743-f5e8217d3a98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:04.541684 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ce121-5613-47d2-b743-f5e8217d3a98 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:04.543952 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:04.549009 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 185/378] 10.222.0.39 () {56 vars in 1376 bytes} [Tue Jul 26 04:39:04 2022] GET /identity/v3/role_assignments?group.id=c614d076bb7348588c1d6847057ddf4c&scope.project.id=e8127522c84e4d4e989b25defd999d24&role.id=e2b16a5edd7b472487fac12492349bc7 => generated 260 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:39:04.575023 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:04.597792 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0ba66e-9616-4bd1-9a60-a12d04bec8e9 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:04.641458 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d9ec8-9e5f-4ba1-a59e-8ff70dc0d3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:04.642172 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d9ec8-9e5f-4ba1-a59e-8ff70dc0d3f5 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:04.642454 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d9ec8-9e5f-4ba1-a59e-8ff70dc0d3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:04.642730 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d9ec8-9e5f-4ba1-a59e-8ff70dc0d3f5 None admin] PATH_INFO: `/v3/groups/69943f87f9494ce4bfc014064487a7ca` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:04.648876 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d9ec8-9e5f-4ba1-a59e-8ff70dc0d3f5 None admin] RBAC: Authorizing `identity:get_group(group_id=69943f87f9494ce4bfc014064487a7ca)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:04.650422 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d9ec8-9e5f-4ba1-a59e-8ff70dc0d3f5 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:04.652563 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 194/379] 10.222.0.39 () {56 vars in 1180 bytes} [Tue Jul 26 04:39:04 2022] GET /identity/v3/groups/69943f87f9494ce4bfc014064487a7ca => generated 229 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:39:04.658895 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ce121-5613-47d2-b743-f5e8217d3a98 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:04.715619 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf847086-353b-4748-8230-5156e260a24b None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:04.715887 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf847086-353b-4748-8230-5156e260a24b None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:04.716221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf847086-353b-4748-8230-5156e260a24b None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:04.717900 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 195/380] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:04.724809 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda3231-9043-43ee-b4b6-caeb223323ff None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:04.725172 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda3231-9043-43ee-b4b6-caeb223323ff None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:04.725421 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda3231-9043-43ee-b4b6-caeb223323ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:04.772679 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-6dda3231-9043-43ee-b4b6-caeb223323ff None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:04.774367 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-6dda3231-9043-43ee-b4b6-caeb223323ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:04.904453 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ce121-5613-47d2-b743-f5e8217d3a98 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:04.929303 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 196/381] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:04.931495 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747108a-711b-40e1-9565-1a913bdfdb80 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:04.932011 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747108a-711b-40e1-9565-1a913bdfdb80 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:04.932494 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747108a-711b-40e1-9565-1a913bdfdb80 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:04.934471 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 197/382] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:04.939873 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed3a94-3934-4a8a-8733-a2bdcc57e327 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:04.940366 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed3a94-3934-4a8a-8733-a2bdcc57e327 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:04.941098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed3a94-3934-4a8a-8733-a2bdcc57e327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:04.967416 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-17ed3a94-3934-4a8a-8733-a2bdcc57e327 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:04.968996 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-17ed3a94-3934-4a8a-8733-a2bdcc57e327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:04.993631 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da6520-444b-4e5f-864f-ef0d79775497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:04.994324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da6520-444b-4e5f-864f-ef0d79775497 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:04.994603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da6520-444b-4e5f-864f-ef0d79775497 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:04.994877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da6520-444b-4e5f-864f-ef0d79775497 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:04.995699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da6520-444b-4e5f-864f-ef0d79775497 None admin] RBAC: Adding query filter params (group.id=69943f87f9494ce4bfc014064487a7ca, role.id=2bfdd65b06554a6da967b3939da753c7, scope.project.id=01e6e551a86f4df9abc0b95c6772bf0e) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:04.996045 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da6520-444b-4e5f-864f-ef0d79775497 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:04.997518 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25da6520-444b-4e5f-864f-ef0d79775497 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:05.011329 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 186/383] 10.222.0.39 () {56 vars in 1376 bytes} [Tue Jul 26 04:39:04 2022] GET /identity/v3/role_assignments?group.id=69943f87f9494ce4bfc014064487a7ca&scope.project.id=01e6e551a86f4df9abc0b95c6772bf0e&role.id=2bfdd65b06554a6da967b3939da753c7 => generated 260 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:05.012224 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da6520-444b-4e5f-864f-ef0d79775497 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:05.066618 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 198/384] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 04:39:05.093849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed3a94-3934-4a8a-8733-a2bdcc57e327 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:05.112975 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:05.147328 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:05.238827 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed3a94-3934-4a8a-8733-a2bdcc57e327 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:05.279534 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c4acc-fea2-4e2d-bdcc-d568cd4b824f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:05.279938 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c4acc-fea2-4e2d-bdcc-d568cd4b824f None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:05.280222 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c4acc-fea2-4e2d-bdcc-d568cd4b824f None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:05.280498 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c4acc-fea2-4e2d-bdcc-d568cd4b824f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:05.292243 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c4acc-fea2-4e2d-bdcc-d568cd4b824f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:05.293042 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da6520-444b-4e5f-864f-ef0d79775497 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:05.298508 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-043c4acc-fea2-4e2d-bdcc-d568cd4b824f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:39:05.298508 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:05.298508 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:05.298508 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:05.298508 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:05.298508 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:05.298508 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:05.298508 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:05.298508 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:05.298508 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:05.298508 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:05.298508 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:05.298508 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:05.298508 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:05.298508 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:05.298508 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:05.299475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:05.299475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:05.299475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:05.299475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:05.299475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:05.299475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:05.299475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:05.299475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:05.299475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:05.299475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:05.299475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:05.299475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:05.299475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:05.299475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:05.299475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:05.299475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:05.300357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:05.300357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:05.300357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:05.300357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:05.300357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:05.300357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:05.300357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:05.300357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:05.300357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:05.300357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:05.300357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:39:05.300357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:05.300357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 199/385] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:39:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:39:05.308811 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c4acc-fea2-4e2d-bdcc-d568cd4b824f None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:05.389510 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b687b1-504a-40ee-b1d2-18153d347579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:05.390242 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b687b1-504a-40ee-b1d2-18153d347579 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:05.390533 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b687b1-504a-40ee-b1d2-18153d347579 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:05.390834 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b687b1-504a-40ee-b1d2-18153d347579 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:05.408107 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b687b1-504a-40ee-b1d2-18153d347579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:05.415264 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-98b687b1-504a-40ee-b1d2-18153d347579 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:39:05.415264 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:05.415264 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:05.415264 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:05.415264 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:05.415264 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:05.415264 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:05.415264 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:05.415264 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:05.415264 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:05.415264 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:05.415264 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:05.415264 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:05.415264 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:05.415264 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:05.415264 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:05.416229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:05.416229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:05.416229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:05.416229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:05.416229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:05.416229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:05.416229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:05.416229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:05.416229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:05.416229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:05.416229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:05.416229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:05.416229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:05.416229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:05.416229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:05.416229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:05.417064 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:05.417064 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:05.417064 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:05.417064 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:05.417064 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:05.417064 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:05.417064 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:05.417064 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:05.417064 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:05.417064 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:05.417064 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:39:05.417064 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:05.423456 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 187/386] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:39:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:05.430003 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b687b1-504a-40ee-b1d2-18153d347579 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:05.435355 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:05.498998 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c4acc-fea2-4e2d-bdcc-d568cd4b824f None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:05.564868 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb392f64-af85-4719-8da3-82da0a161f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:05.565514 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb392f64-af85-4719-8da3-82da0a161f3f None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:05.565792 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb392f64-af85-4719-8da3-82da0a161f3f None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:05.566092 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb392f64-af85-4719-8da3-82da0a161f3f None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:05.566835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb392f64-af85-4719-8da3-82da0a161f3f None admin] RBAC: Adding query filter params (name=member) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:05.568354 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb392f64-af85-4719-8da3-82da0a161f3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:05.569802 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb392f64-af85-4719-8da3-82da0a161f3f None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:05.593967 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 200/387] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 04:39:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:05.598819 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb392f64-af85-4719-8da3-82da0a161f3f None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:05.608726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b687b1-504a-40ee-b1d2-18153d347579 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:05.658813 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:05.681533 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eec86b-7fa5-4fe6-84fe-0f477b7fa56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:05.682223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eec86b-7fa5-4fe6-84fe-0f477b7fa56f None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:05.682504 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eec86b-7fa5-4fe6-84fe-0f477b7fa56f None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:05.682775 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eec86b-7fa5-4fe6-84fe-0f477b7fa56f None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:05.683513 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eec86b-7fa5-4fe6-84fe-0f477b7fa56f None admin] RBAC: Adding query filter params (name=member) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:05.683814 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eec86b-7fa5-4fe6-84fe-0f477b7fa56f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:05.685225 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eec86b-7fa5-4fe6-84fe-0f477b7fa56f None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:05.706886 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 188/388] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 04:39:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:39:05.711181 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eec86b-7fa5-4fe6-84fe-0f477b7fa56f None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:05.786030 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb392f64-af85-4719-8da3-82da0a161f3f None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:05.828209 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:05.835658 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa438e-346a-4ba5-b493-7f3d1c7aaaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:05.836486 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa438e-346a-4ba5-b493-7f3d1c7aaaf1 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:05.836770 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa438e-346a-4ba5-b493-7f3d1c7aaaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:05.837139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa438e-346a-4ba5-b493-7f3d1c7aaaf1 None admin] PATH_INFO: `/v3/groups/c614d076bb7348588c1d6847057ddf4c` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:05.838459 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa438e-346a-4ba5-b493-7f3d1c7aaaf1 None admin] RBAC: Authorizing `identity:get_group(group_id=c614d076bb7348588c1d6847057ddf4c)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:05.840083 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa438e-346a-4ba5-b493-7f3d1c7aaaf1 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:05.842105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 201/389] 10.222.0.39 () {56 vars in 1180 bytes} [Tue Jul 26 04:39:05 2022] GET /identity/v3/groups/c614d076bb7348588c1d6847057ddf4c => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:05.848263 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa438e-346a-4ba5-b493-7f3d1c7aaaf1 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:05.927191 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eec86b-7fa5-4fe6-84fe-0f477b7fa56f None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:05.971941 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631bd33-6a2f-4711-afcb-2b376443e744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:05.972610 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631bd33-6a2f-4711-afcb-2b376443e744 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:05.972892 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631bd33-6a2f-4711-afcb-2b376443e744 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:05.973160 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631bd33-6a2f-4711-afcb-2b376443e744 None admin] PATH_INFO: `/v3/groups/c614d076bb7348588c1d6847057ddf4c` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:05.974623 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631bd33-6a2f-4711-afcb-2b376443e744 None admin] RBAC: Authorizing `identity:get_group(group_id=c614d076bb7348588c1d6847057ddf4c)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:05.976113 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631bd33-6a2f-4711-afcb-2b376443e744 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:05.978436 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 189/390] 10.222.0.39 () {56 vars in 1180 bytes} [Tue Jul 26 04:39:05 2022] GET /identity/v3/groups/c614d076bb7348588c1d6847057ddf4c => generated 226 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:05.986011 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631bd33-6a2f-4711-afcb-2b376443e744 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:06.037181 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa438e-346a-4ba5-b493-7f3d1c7aaaf1 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:06.100968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:06.110259 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd8e37-ec6c-4384-bfa5-cd29fb4986a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:06.110977 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd8e37-ec6c-4384-bfa5-cd29fb4986a0 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:06.111257 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd8e37-ec6c-4384-bfa5-cd29fb4986a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:06.111528 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd8e37-ec6c-4384-bfa5-cd29fb4986a0 None admin] PATH_INFO: `/v3/projects/bb5564ea35cb4871823a95b50fd471c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:06.113532 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd8e37-ec6c-4384-bfa5-cd29fb4986a0 None admin] RBAC: Authorizing `identity:get_project(project_id=bb5564ea35cb4871823a95b50fd471c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:06.115124 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd8e37-ec6c-4384-bfa5-cd29fb4986a0 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:06.118419 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 202/391] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:39:05 2022] GET /identity/v3/projects/bb5564ea35cb4871823a95b50fd471c7 => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:06.123084 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd8e37-ec6c-4384-bfa5-cd29fb4986a0 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:06.197989 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631bd33-6a2f-4711-afcb-2b376443e744 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:06.246698 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:06.262926 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7acc945-ad32-4ce1-af8c-17f904a84b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:06.263591 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acc945-ad32-4ce1-af8c-17f904a84b9a None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:06.263904 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acc945-ad32-4ce1-af8c-17f904a84b9a None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:06.264187 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7acc945-ad32-4ce1-af8c-17f904a84b9a None admin] PATH_INFO: `/v3/projects/e8127522c84e4d4e989b25defd999d24` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:06.266493 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7acc945-ad32-4ce1-af8c-17f904a84b9a None admin] RBAC: Authorizing `identity:get_project(project_id=e8127522c84e4d4e989b25defd999d24)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:06.267979 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7acc945-ad32-4ce1-af8c-17f904a84b9a None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:06.270993 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 190/392] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:39:05 2022] GET /identity/v3/projects/e8127522c84e4d4e989b25defd999d24 => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:06.276712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7acc945-ad32-4ce1-af8c-17f904a84b9a None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:06.308370 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd8e37-ec6c-4384-bfa5-cd29fb4986a0 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:06.372066 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae46add-8fb2-4332-9072-a3fd1a0b5328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:06.372756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae46add-8fb2-4332-9072-a3fd1a0b5328 None admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:06.373041 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae46add-8fb2-4332-9072-a3fd1a0b5328 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:06.373319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae46add-8fb2-4332-9072-a3fd1a0b5328 None admin] PATH_INFO: `/v3/projects/bb5564ea35cb4871823a95b50fd471c7/groups/c614d076bb7348588c1d6847057ddf4c/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:06.375958 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae46add-8fb2-4332-9072-a3fd1a0b5328 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb5564ea35cb4871823a95b50fd471c7, group_id=c614d076bb7348588c1d6847057ddf4c, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:06.377630 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae46add-8fb2-4332-9072-a3fd1a0b5328 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:06.400414 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 203/393] 10.222.0.39 () {58 vars in 1442 bytes} [Tue Jul 26 04:39:06 2022] PUT /identity/v3/projects/bb5564ea35cb4871823a95b50fd471c7/groups/c614d076bb7348588c1d6847057ddf4c/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:39:06.470305 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7acc945-ad32-4ce1-af8c-17f904a84b9a None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:06.504491 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:06.526125 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200d0ff-b89b-4ca8-9a34-fbaba267f79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:06.527615 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200d0ff-b89b-4ca8-9a34-fbaba267f79d None admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:06.527856 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200d0ff-b89b-4ca8-9a34-fbaba267f79d None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:06.528164 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200d0ff-b89b-4ca8-9a34-fbaba267f79d None admin] PATH_INFO: `/v3/projects/e8127522c84e4d4e989b25defd999d24/groups/c614d076bb7348588c1d6847057ddf4c/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:06.531446 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200d0ff-b89b-4ca8-9a34-fbaba267f79d None admin] RBAC: Authorizing `identity:create_grant(project_id=e8127522c84e4d4e989b25defd999d24, group_id=c614d076bb7348588c1d6847057ddf4c, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:06.533692 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200d0ff-b89b-4ca8-9a34-fbaba267f79d None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:06.556256 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 191/394] 10.222.0.39 () {58 vars in 1442 bytes} [Tue Jul 26 04:39:06 2022] PUT /identity/v3/projects/e8127522c84e4d4e989b25defd999d24/groups/c614d076bb7348588c1d6847057ddf4c/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:39:06.907957 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b830a7a-1133-47bd-88b0-1a779d8877c0 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:06.908378 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b830a7a-1133-47bd-88b0-1a779d8877c0 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:06.908552 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b830a7a-1133-47bd-88b0-1a779d8877c0 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:06.910290 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 204/395] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:06.915441 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437f656-e5a9-46ec-8262-b9f32e56e5a7 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:06.915731 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437f656-e5a9-46ec-8262-b9f32e56e5a7 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:06.916010 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437f656-e5a9-46ec-8262-b9f32e56e5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:06.943065 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-3437f656-e5a9-46ec-8262-b9f32e56e5a7 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:06.944313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-3437f656-e5a9-46ec-8262-b9f32e56e5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:07.041320 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 192/396] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:07.041963 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf548a4-a964-4b8a-8afe-1bf4764176d9 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:07.042511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf548a4-a964-4b8a-8afe-1bf4764176d9 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:07.042976 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf548a4-a964-4b8a-8afe-1bf4764176d9 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:07.044759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 205/397] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:39:07.050317 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c575c-0993-4b11-830b-4a38ab04ec08 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:07.050820 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c575c-0993-4b11-830b-4a38ab04ec08 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:07.051283 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c575c-0993-4b11-830b-4a38ab04ec08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:07.070497 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-d05c575c-0993-4b11-830b-4a38ab04ec08 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:07.072010 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-d05c575c-0993-4b11-830b-4a38ab04ec08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:07.076240 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf548a4-a964-4b8a-8afe-1bf4764176d9 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:07.204486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 193/398] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 04:39:07.228080 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c575c-0993-4b11-830b-4a38ab04ec08 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:07.274950 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:07.328152 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf548a4-a964-4b8a-8afe-1bf4764176d9 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:07.344055 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c575c-0993-4b11-830b-4a38ab04ec08 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:07.382412 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9895883-5991-4574-812a-77f1a0b49cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:07.383458 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9895883-5991-4574-812a-77f1a0b49cda None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:07.383925 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9895883-5991-4574-812a-77f1a0b49cda None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:07.384407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9895883-5991-4574-812a-77f1a0b49cda None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:07.396213 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9895883-5991-4574-812a-77f1a0b49cda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:07.401875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-e9895883-5991-4574-812a-77f1a0b49cda None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 04:39:07.401875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:07.401875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:07.401875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:07.401875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:07.401875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:07.401875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:07.401875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:07.401875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:07.401875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:07.401875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:07.401875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:07.401875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:07.401875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:07.401875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:07.401875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:07.402832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:07.402832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:07.402832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:07.402832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:07.402832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:07.402832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:07.402832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:07.402832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:07.402832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:07.402832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:07.402832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:07.402832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:07.402832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:07.402832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:07.402832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:07.402832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:07.403642 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:07.403642 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:07.403642 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:07.403642 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:07.403642 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:07.403642 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:07.403642 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:07.403642 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:07.403642 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:07.403642 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:07.403642 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 04:39:07.403642 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:07.410397 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:07.411789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 194/399] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 04:39:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:39:07.415102 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9895883-5991-4574-812a-77f1a0b49cda None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:07.462910 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba313c-8d36-4eb7-a8d9-7f4c06fbbc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:07.464164 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba313c-8d36-4eb7-a8d9-7f4c06fbbc91 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:07.464164 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba313c-8d36-4eb7-a8d9-7f4c06fbbc91 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:07.464350 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba313c-8d36-4eb7-a8d9-7f4c06fbbc91 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:07.518878 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba313c-8d36-4eb7-a8d9-7f4c06fbbc91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:07.525238 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-24ba313c-8d36-4eb7-a8d9-7f4c06fbbc91 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 04:39:07.525238 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:07.525238 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:07.525238 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:07.525238 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:07.525238 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:07.525238 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:07.525238 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:07.525238 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:07.525238 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:07.525238 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:07.525238 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:07.525238 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:07.525238 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:07.525238 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:07.525238 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:07.527075 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:07.527075 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:07.527075 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:07.527075 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:07.527075 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:07.527075 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:07.527075 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:07.527075 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:07.527075 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:07.527075 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:07.527075 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:07.527075 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:07.527075 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:07.527075 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:07.527075 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:07.527075 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:07.528317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:07.528317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:07.528317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:07.528317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:07.528317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:07.528317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:07.528317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:07.528317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:07.528317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:07.528317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:07.528317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 04:39:07.528317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:07.534273 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 206/400] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 04:39:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 452 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:07.535306 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba313c-8d36-4eb7-a8d9-7f4c06fbbc91 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:07.545179 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9895883-5991-4574-812a-77f1a0b49cda None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:07.555964 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:07.584845 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756cab2-e5c4-445a-b716-6ca8209db459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:07.585858 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756cab2-e5c4-445a-b716-6ca8209db459 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:07.586757 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756cab2-e5c4-445a-b716-6ca8209db459 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:07.587451 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756cab2-e5c4-445a-b716-6ca8209db459 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:07.588398 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756cab2-e5c4-445a-b716-6ca8209db459 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:07.589192 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756cab2-e5c4-445a-b716-6ca8209db459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:07.591324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756cab2-e5c4-445a-b716-6ca8209db459 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:07.602357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 195/401] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:39:07.608339 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756cab2-e5c4-445a-b716-6ca8209db459 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:07.742331 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756cab2-e5c4-445a-b716-6ca8209db459 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:07.778915 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618145a4-5074-4a7a-bc8a-9bf1ae69e73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:07.780087 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618145a4-5074-4a7a-bc8a-9bf1ae69e73c None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:07.780372 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618145a4-5074-4a7a-bc8a-9bf1ae69e73c None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:07.780639 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618145a4-5074-4a7a-bc8a-9bf1ae69e73c None admin] PATH_INFO: `/v3/groups/c614d076bb7348588c1d6847057ddf4c` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:07.781846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618145a4-5074-4a7a-bc8a-9bf1ae69e73c None admin] RBAC: Authorizing `identity:get_group(group_id=c614d076bb7348588c1d6847057ddf4c)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:07.783510 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618145a4-5074-4a7a-bc8a-9bf1ae69e73c None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:07.785499 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 196/402] 10.222.0.39 () {56 vars in 1180 bytes} [Tue Jul 26 04:39:07 2022] GET /identity/v3/groups/c614d076bb7348588c1d6847057ddf4c => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:39:07.794181 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618145a4-5074-4a7a-bc8a-9bf1ae69e73c None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:07.848728 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba313c-8d36-4eb7-a8d9-7f4c06fbbc91 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:07.854604 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:07.888940 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cac6cf-2d65-4cac-9ae8-5cb978a6fb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:07.890054 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cac6cf-2d65-4cac-9ae8-5cb978a6fb22 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:07.890711 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cac6cf-2d65-4cac-9ae8-5cb978a6fb22 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:07.891246 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cac6cf-2d65-4cac-9ae8-5cb978a6fb22 None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:07.892432 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cac6cf-2d65-4cac-9ae8-5cb978a6fb22 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:07.893018 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cac6cf-2d65-4cac-9ae8-5cb978a6fb22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:07.894978 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cac6cf-2d65-4cac-9ae8-5cb978a6fb22 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:07.905692 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 207/403] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:07.907514 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381e4ce-ef3e-4112-a37d-40ff711ebd5a None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:07.908027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381e4ce-ef3e-4112-a37d-40ff711ebd5a None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:07.908544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381e4ce-ef3e-4112-a37d-40ff711ebd5a None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:07.915586 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 208/404] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:07.916980 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381e4ce-ef3e-4112-a37d-40ff711ebd5a None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:07.936540 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618145a4-5074-4a7a-bc8a-9bf1ae69e73c None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:07.989524 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c1e039-3891-4be6-86cf-d06cdcdc7f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:07.991151 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1e039-3891-4be6-86cf-d06cdcdc7f2b None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:07.992313 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:07.992718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1e039-3891-4be6-86cf-d06cdcdc7f2b None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:07.994433 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c1e039-3891-4be6-86cf-d06cdcdc7f2b None admin] PATH_INFO: `/v3/projects/e8127522c84e4d4e989b25defd999d24` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:07.997562 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c1e039-3891-4be6-86cf-d06cdcdc7f2b None admin] RBAC: Authorizing `identity:get_project(project_id=e8127522c84e4d4e989b25defd999d24)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:08.000447 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c1e039-3891-4be6-86cf-d06cdcdc7f2b None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:08.008518 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 197/405] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:39:07 2022] GET /identity/v3/projects/e8127522c84e4d4e989b25defd999d24 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:08.010205 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6d40f-f2c9-47d9-ad73-3cf0be4a36a3 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:08.010857 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6d40f-f2c9-47d9-ad73-3cf0be4a36a3 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:08.011337 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a6d40f-f2c9-47d9-ad73-3cf0be4a36a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:08.035776 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-14a6d40f-f2c9-47d9-ad73-3cf0be4a36a3 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:08.037365 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-14a6d40f-f2c9-47d9-ad73-3cf0be4a36a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:08.057313 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381e4ce-ef3e-4112-a37d-40ff711ebd5a None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:08.103184 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0dbc31-8db8-45fb-80bd-09389e2e3810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:08.104493 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0dbc31-8db8-45fb-80bd-09389e2e3810 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:08.105007 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0dbc31-8db8-45fb-80bd-09389e2e3810 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:08.105529 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0dbc31-8db8-45fb-80bd-09389e2e3810 None admin] PATH_INFO: `/v3/groups/c614d076bb7348588c1d6847057ddf4c` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:08.107218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0dbc31-8db8-45fb-80bd-09389e2e3810 None admin] RBAC: Authorizing `identity:get_group(group_id=c614d076bb7348588c1d6847057ddf4c)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:08.109435 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0dbc31-8db8-45fb-80bd-09389e2e3810 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:08.112256 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 209/406] 10.222.0.39 () {56 vars in 1180 bytes} [Tue Jul 26 04:39:07 2022] GET /identity/v3/groups/c614d076bb7348588c1d6847057ddf4c => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:08.113531 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0dbc31-8db8-45fb-80bd-09389e2e3810 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:08.144874 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 198/407] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:08.150040 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6d40f-f2c9-47d9-ad73-3cf0be4a36a3 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:08.202389 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:08.290010 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a6d40f-f2c9-47d9-ad73-3cf0be4a36a3 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:08.292164 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0dbc31-8db8-45fb-80bd-09389e2e3810 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:08.312864 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:08.329703 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4983e32-c8a4-4d48-9df2-44264f8298f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:08.330791 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4983e32-c8a4-4d48-9df2-44264f8298f8 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:08.331288 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4983e32-c8a4-4d48-9df2-44264f8298f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:08.331756 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4983e32-c8a4-4d48-9df2-44264f8298f8 None admin] PATH_INFO: `/v3/projects/bb5564ea35cb4871823a95b50fd471c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:08.333450 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4983e32-c8a4-4d48-9df2-44264f8298f8 None admin] RBAC: Authorizing `identity:get_project(project_id=bb5564ea35cb4871823a95b50fd471c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:08.335213 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebeb61-b623-4d81-a812-d36ee69714fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:08.335890 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebeb61-b623-4d81-a812-d36ee69714fe None admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:08.336008 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4983e32-c8a4-4d48-9df2-44264f8298f8 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:08.336177 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebeb61-b623-4d81-a812-d36ee69714fe None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:08.336427 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebeb61-b623-4d81-a812-d36ee69714fe None admin] PATH_INFO: `/v3/projects/e8127522c84e4d4e989b25defd999d24/groups/c614d076bb7348588c1d6847057ddf4c/roles/e2b16a5edd7b472487fac12492349bc7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:08.338666 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ebeb61-b623-4d81-a812-d36ee69714fe None admin] RBAC: Authorizing `identity:create_grant(project_id=e8127522c84e4d4e989b25defd999d24, group_id=c614d076bb7348588c1d6847057ddf4c, role_id=e2b16a5edd7b472487fac12492349bc7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:08.339118 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 199/408] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:39:08 2022] GET /identity/v3/projects/bb5564ea35cb4871823a95b50fd471c7 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:08.340192 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4983e32-c8a4-4d48-9df2-44264f8298f8 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:08.340308 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ebeb61-b623-4d81-a812-d36ee69714fe None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:08.364262 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 210/409] 10.222.0.39 () {58 vars in 1442 bytes} [Tue Jul 26 04:39:08 2022] PUT /identity/v3/projects/e8127522c84e4d4e989b25defd999d24/groups/c614d076bb7348588c1d6847057ddf4c/roles/e2b16a5edd7b472487fac12492349bc7 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:39:08.364262 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebeb61-b623-4d81-a812-d36ee69714fe None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:08.484193 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebeb61-b623-4d81-a812-d36ee69714fe None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:08.520852 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:08.531388 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf860d3e-7f92-4824-852e-3afb44084345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:08.532214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4983e32-c8a4-4d48-9df2-44264f8298f8 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:08.532537 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf860d3e-7f92-4824-852e-3afb44084345 None admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:08.532953 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf860d3e-7f92-4824-852e-3afb44084345 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:08.533363 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf860d3e-7f92-4824-852e-3afb44084345 None admin] PATH_INFO: `/v3/projects/bb5564ea35cb4871823a95b50fd471c7/groups/c614d076bb7348588c1d6847057ddf4c/roles/e2b16a5edd7b472487fac12492349bc7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:08.544611 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf860d3e-7f92-4824-852e-3afb44084345 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb5564ea35cb4871823a95b50fd471c7, group_id=c614d076bb7348588c1d6847057ddf4c, role_id=e2b16a5edd7b472487fac12492349bc7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:08.546400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf860d3e-7f92-4824-852e-3afb44084345 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:08.573806 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 211/410] 10.222.0.39 () {58 vars in 1442 bytes} [Tue Jul 26 04:39:08 2022] PUT /identity/v3/projects/bb5564ea35cb4871823a95b50fd471c7/groups/c614d076bb7348588c1d6847057ddf4c/roles/e2b16a5edd7b472487fac12492349bc7 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:39:08.599530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c448b-17a6-4f61-96d9-ffa7a415082f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:08.600485 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c448b-17a6-4f61-96d9-ffa7a415082f None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:08.600938 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c448b-17a6-4f61-96d9-ffa7a415082f None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:08.601359 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c448b-17a6-4f61-96d9-ffa7a415082f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:08.614899 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c448b-17a6-4f61-96d9-ffa7a415082f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:08.620201 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-4c2c448b-17a6-4f61-96d9-ffa7a415082f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:39:08.620201 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:08.620201 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:08.620201 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:08.620201 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:08.620201 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:08.620201 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:08.620201 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:08.620201 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:08.620201 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:08.620201 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:08.620201 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:08.620201 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:08.620201 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:08.620201 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:08.620201 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:08.621331 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:08.621331 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:08.621331 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:08.621331 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:08.621331 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:08.621331 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:08.621331 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:08.621331 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:08.621331 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:08.621331 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:08.621331 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:08.621331 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:08.621331 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:08.621331 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:08.621331 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:08.621331 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:08.622352 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:08.622352 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:08.622352 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:08.622352 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:08.622352 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:08.622352 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:08.622352 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:08.622352 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:08.622352 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:08.622352 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:08.622352 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:39:08.622352 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:08.624433 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 200/411] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:39:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:08.635312 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf860d3e-7f92-4824-852e-3afb44084345 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:08.683767 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:08.767079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf860d3e-7f92-4824-852e-3afb44084345 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:08.805380 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c6cba-83ab-4a81-b68b-217a7be6d51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:08.805935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c6cba-83ab-4a81-b68b-217a7be6d51e None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:08.806252 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c6cba-83ab-4a81-b68b-217a7be6d51e None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:08.806529 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c6cba-83ab-4a81-b68b-217a7be6d51e None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:08.807304 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c6cba-83ab-4a81-b68b-217a7be6d51e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:08.807618 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c6cba-83ab-4a81-b68b-217a7be6d51e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:08.809077 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c6cba-83ab-4a81-b68b-217a7be6d51e None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:08.818419 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 212/412] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:39:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:08.824483 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c448b-17a6-4f61-96d9-ffa7a415082f None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:08.940138 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c448b-17a6-4f61-96d9-ffa7a415082f None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:08.949612 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109234aa-f235-46c0-b0cc-f5419df62b4b None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:08.949936 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109234aa-f235-46c0-b0cc-f5419df62b4b None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:08.950191 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109234aa-f235-46c0-b0cc-f5419df62b4b None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:08.952644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 213/413] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:39:08.959205 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b194ee4-df7d-4267-806f-d6bb98c9eaa0 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:08.959532 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b194ee4-df7d-4267-806f-d6bb98c9eaa0 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:08.959769 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b194ee4-df7d-4267-806f-d6bb98c9eaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:09.002242 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-3b194ee4-df7d-4267-806f-d6bb98c9eaa0 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:09.005179 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-3b194ee4-df7d-4267-806f-d6bb98c9eaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:09.018983 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ff884-ea8f-4956-aa53-59239a590227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:09.020023 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ff884-ea8f-4956-aa53-59239a590227 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:09.020526 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ff884-ea8f-4956-aa53-59239a590227 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:09.021046 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ff884-ea8f-4956-aa53-59239a590227 None admin] PATH_INFO: `/v3/groups/69943f87f9494ce4bfc014064487a7ca` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:09.024665 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ff884-ea8f-4956-aa53-59239a590227 None admin] RBAC: Authorizing `identity:get_group(group_id=69943f87f9494ce4bfc014064487a7ca)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:09.026575 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ff884-ea8f-4956-aa53-59239a590227 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:09.028634 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 201/414] 10.222.0.39 () {56 vars in 1180 bytes} [Tue Jul 26 04:39:08 2022] GET /identity/v3/groups/69943f87f9494ce4bfc014064487a7ca => generated 229 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:09.035019 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ff884-ea8f-4956-aa53-59239a590227 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:09.063168 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:09.132496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 214/415] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:09.134882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47a952-49c4-4fb5-8f0a-496e76b37558 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:09.135166 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47a952-49c4-4fb5-8f0a-496e76b37558 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:09.135436 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47a952-49c4-4fb5-8f0a-496e76b37558 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:09.138379 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 215/416] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:09.142616 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffeb13-564c-467b-aa8e-8a056f23f0d5 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:09.142971 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffeb13-564c-467b-aa8e-8a056f23f0d5 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:09.143307 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffeb13-564c-467b-aa8e-8a056f23f0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:09.168936 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-e3ffeb13-564c-467b-aa8e-8a056f23f0d5 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:09.170186 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-e3ffeb13-564c-467b-aa8e-8a056f23f0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:09.185882 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ff884-ea8f-4956-aa53-59239a590227 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:09.202388 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:09.229148 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4def4-96cd-4264-be89-438df884fe49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:09.230157 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4def4-96cd-4264-be89-438df884fe49 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:09.230443 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4def4-96cd-4264-be89-438df884fe49 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:09.230979 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c4def4-96cd-4264-be89-438df884fe49 None admin] PATH_INFO: `/v3/projects/01e6e551a86f4df9abc0b95c6772bf0e` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:09.232166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4def4-96cd-4264-be89-438df884fe49 None admin] RBAC: Authorizing `identity:get_project(project_id=01e6e551a86f4df9abc0b95c6772bf0e)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:09.234418 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c4def4-96cd-4264-be89-438df884fe49 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:09.236840 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 202/417] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:39:09 2022] GET /identity/v3/projects/01e6e551a86f4df9abc0b95c6772bf0e => generated 344 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:09.237626 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4def4-96cd-4264-be89-438df884fe49 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:09.258534 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 216/418] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 04:39:09.260296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffeb13-564c-467b-aa8e-8a056f23f0d5 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:09.347926 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:09.359656 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c4def4-96cd-4264-be89-438df884fe49 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:09.372912 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffeb13-564c-467b-aa8e-8a056f23f0d5 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:09.400948 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e55a80-e519-4c27-a3b3-450f3feeb94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:09.401879 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e55a80-e519-4c27-a3b3-450f3feeb94b None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:09.402319 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e55a80-e519-4c27-a3b3-450f3feeb94b None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:09.402799 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e55a80-e519-4c27-a3b3-450f3feeb94b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:09.408096 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ba1ba-e900-48f1-b963-42457ad3df94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:09.408789 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ba1ba-e900-48f1-b963-42457ad3df94 None admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:09.409064 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ba1ba-e900-48f1-b963-42457ad3df94 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:09.409333 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ba1ba-e900-48f1-b963-42457ad3df94 None admin] PATH_INFO: `/v3/projects/01e6e551a86f4df9abc0b95c6772bf0e/groups/69943f87f9494ce4bfc014064487a7ca/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:09.411318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ba1ba-e900-48f1-b963-42457ad3df94 None admin] RBAC: Authorizing `identity:create_grant(project_id=01e6e551a86f4df9abc0b95c6772bf0e, group_id=69943f87f9494ce4bfc014064487a7ca, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:09.412804 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ba1ba-e900-48f1-b963-42457ad3df94 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:09.415292 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e55a80-e519-4c27-a3b3-450f3feeb94b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:09.420696 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-b0e55a80-e519-4c27-a3b3-450f3feeb94b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:39:09.420696 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:09.420696 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:09.420696 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:09.420696 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:09.420696 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:09.420696 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:09.420696 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:09.420696 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:09.420696 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:09.420696 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:09.420696 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:09.420696 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:09.420696 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:09.420696 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:09.420696 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:09.421788 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:09.421788 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:09.421788 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:09.421788 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:09.421788 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:09.421788 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:09.421788 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:09.421788 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:09.421788 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:09.421788 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:09.421788 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:09.421788 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:09.421788 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:09.421788 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:09.421788 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:09.421788 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:09.422692 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:09.422692 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:09.422692 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:09.422692 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:09.422692 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:09.422692 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:09.422692 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:09.422692 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:09.422692 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:09.422692 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:09.422692 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:39:09.422692 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:09.425371 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 203/419] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:39:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:09.426500 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e55a80-e519-4c27-a3b3-450f3feeb94b None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:09.433723 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 217/420] 10.222.0.39 () {58 vars in 1442 bytes} [Tue Jul 26 04:39:09 2022] PUT /identity/v3/projects/01e6e551a86f4df9abc0b95c6772bf0e/groups/69943f87f9494ce4bfc014064487a7ca/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:39:09.434764 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ba1ba-e900-48f1-b963-42457ad3df94 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:09.457068 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:09.565479 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ba1ba-e900-48f1-b963-42457ad3df94 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:09.580497 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e55a80-e519-4c27-a3b3-450f3feeb94b None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:09.603121 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63d552-5404-4ed1-819f-b48901399293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:09.603676 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63d552-5404-4ed1-819f-b48901399293 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:09.603957 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63d552-5404-4ed1-819f-b48901399293 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:09.604232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63d552-5404-4ed1-819f-b48901399293 None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:09.605097 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63d552-5404-4ed1-819f-b48901399293 None admin] RBAC: Adding query filter params (name=member) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:09.605287 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63d552-5404-4ed1-819f-b48901399293 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:09.606715 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63d552-5404-4ed1-819f-b48901399293 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:09.616202 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 218/421] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 04:39:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:39:09.622369 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63d552-5404-4ed1-819f-b48901399293 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:09.630833 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeda8f8-bac7-4be5-98b1-e8b25ceb000d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:09.631962 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeda8f8-bac7-4be5-98b1-e8b25ceb000d None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:09.632484 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeda8f8-bac7-4be5-98b1-e8b25ceb000d None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:09.632968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeda8f8-bac7-4be5-98b1-e8b25ceb000d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:09.654260 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeda8f8-bac7-4be5-98b1-e8b25ceb000d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:09.669143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-bbeda8f8-bac7-4be5-98b1-e8b25ceb000d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:39:09.669143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:09.669143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:09.669143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:09.669143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:09.669143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:09.669143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:09.669143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:09.669143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:09.669143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:09.669143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:09.669143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:09.669143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:09.669143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:09.669143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:09.669143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:09.670156 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:09.670156 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:09.670156 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:09.670156 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:09.670156 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:09.670156 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:09.670156 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:09.670156 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:09.670156 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:09.670156 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:09.670156 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:09.670156 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:09.670156 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:09.670156 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:09.670156 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:09.670156 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:09.670971 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:09.670971 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:09.670971 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:09.670971 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:09.670971 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:09.670971 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:09.670971 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:09.670971 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:09.670971 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:09.670971 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:09.670971 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 26 04:39:09.670971 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:09.673546 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 204/422] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:39:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:09.681428 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeda8f8-bac7-4be5-98b1-e8b25ceb000d None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:09.708006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:09.716893 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:09.736370 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63d552-5404-4ed1-819f-b48901399293 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:09.781658 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d035a-f9df-45b2-a288-f021a254f8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:09.782376 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d035a-f9df-45b2-a288-f021a254f8c8 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:09.782656 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d035a-f9df-45b2-a288-f021a254f8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:09.782929 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d035a-f9df-45b2-a288-f021a254f8c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:09.930140 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeda8f8-bac7-4be5-98b1-e8b25ceb000d None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:09.939444 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d035a-f9df-45b2-a288-f021a254f8c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:09.941474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d035a-f9df-45b2-a288-f021a254f8c8 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:10.038196 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5362a0-751d-4796-b516-bdfed9e10fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:10.039260 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5362a0-751d-4796-b516-bdfed9e10fc0 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:10.039771 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5362a0-751d-4796-b516-bdfed9e10fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:10.040254 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5362a0-751d-4796-b516-bdfed9e10fc0 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:10.041291 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5362a0-751d-4796-b516-bdfed9e10fc0 None admin] RBAC: Adding query filter params (name=member) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:10.041818 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5362a0-751d-4796-b516-bdfed9e10fc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:10.043589 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5362a0-751d-4796-b516-bdfed9e10fc0 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:10.068557 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 205/423] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 04:39:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:39:10.076204 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5362a0-751d-4796-b516-bdfed9e10fc0 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:10.109899 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:10.157890 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 219/424] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:39:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 04:39:10.167567 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d035a-f9df-45b2-a288-f021a254f8c8 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:10.261287 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:10.317851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5362a0-751d-4796-b516-bdfed9e10fc0 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:10.384214 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d035a-f9df-45b2-a288-f021a254f8c8 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:10.401750 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2b5c2-199a-4756-a3b9-700fe3494b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:10.403163 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2b5c2-199a-4756-a3b9-700fe3494b21 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:10.403646 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2b5c2-199a-4756-a3b9-700fe3494b21 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:10.404142 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2b5c2-199a-4756-a3b9-700fe3494b21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:10.465788 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fae2ef-88af-43b5-916a-3a5c838e7d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:10.467322 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fae2ef-88af-43b5-916a-3a5c838e7d8b None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:10.468752 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fae2ef-88af-43b5-916a-3a5c838e7d8b None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:10.470328 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fae2ef-88af-43b5-916a-3a5c838e7d8b None admin] PATH_INFO: `/v3/projects/bb5564ea35cb4871823a95b50fd471c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:10.472325 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fae2ef-88af-43b5-916a-3a5c838e7d8b None admin] RBAC: Authorizing `identity:get_project(project_id=bb5564ea35cb4871823a95b50fd471c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:10.477822 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fae2ef-88af-43b5-916a-3a5c838e7d8b None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:10.481242 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 220/425] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:39:10 2022] GET /identity/v3/projects/bb5564ea35cb4871823a95b50fd471c7 => generated 298 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:10.487586 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fae2ef-88af-43b5-916a-3a5c838e7d8b None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:10.565118 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2b5c2-199a-4756-a3b9-700fe3494b21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:10.567108 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2b5c2-199a-4756-a3b9-700fe3494b21 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:10.605714 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:10.710765 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fae2ef-88af-43b5-916a-3a5c838e7d8b None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:10.738798 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:10.793155 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa501541-adfc-4432-b03c-1c4fe8b3401a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:10.797446 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa501541-adfc-4432-b03c-1c4fe8b3401a None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:10.797727 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa501541-adfc-4432-b03c-1c4fe8b3401a None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:10.802078 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa501541-adfc-4432-b03c-1c4fe8b3401a None admin] PATH_INFO: `/v3/groups/c614d076bb7348588c1d6847057ddf4c` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:10.803971 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa501541-adfc-4432-b03c-1c4fe8b3401a None admin] RBAC: Authorizing `identity:get_group(group_id=c614d076bb7348588c1d6847057ddf4c)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:10.805479 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa501541-adfc-4432-b03c-1c4fe8b3401a None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:10.807353 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 206/426] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:39:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 727 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 04:39:10.807608 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 221/427] 10.222.0.39 () {56 vars in 1180 bytes} [Tue Jul 26 04:39:10 2022] GET /identity/v3/groups/c614d076bb7348588c1d6847057ddf4c => generated 226 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:10.809543 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2b5c2-199a-4756-a3b9-700fe3494b21 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:10.814749 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa501541-adfc-4432-b03c-1c4fe8b3401a None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:10.995411 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2b5c2-199a-4756-a3b9-700fe3494b21 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:11.024220 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa501541-adfc-4432-b03c-1c4fe8b3401a None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:11.042368 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:11.044451 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d207530-23a1-4b88-a106-db5b45efe1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:11.045282 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d207530-23a1-4b88-a106-db5b45efe1e3 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:11.045704 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d207530-23a1-4b88-a106-db5b45efe1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:11.046160 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d207530-23a1-4b88-a106-db5b45efe1e3 None admin] PATH_INFO: `/v3/projects/e8127522c84e4d4e989b25defd999d24` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:11.048259 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d207530-23a1-4b88-a106-db5b45efe1e3 None admin] RBAC: Authorizing `identity:get_project(project_id=e8127522c84e4d4e989b25defd999d24)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:11.050185 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d207530-23a1-4b88-a106-db5b45efe1e3 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:11.053024 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 207/428] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:39:10 2022] GET /identity/v3/projects/e8127522c84e4d4e989b25defd999d24 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:11.059887 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6e279-35b7-475c-a88a-a3c933584b0a None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:11.060469 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6e279-35b7-475c-a88a-a3c933584b0a None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:11.060968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6e279-35b7-475c-a88a-a3c933584b0a None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:11.063583 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 208/429] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:11.064539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6e279-35b7-475c-a88a-a3c933584b0a None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:11.071418 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465060a-8e73-4ab0-8a9e-55fae46895dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:11.072136 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465060a-8e73-4ab0-8a9e-55fae46895dc None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:11.072483 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465060a-8e73-4ab0-8a9e-55fae46895dc None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:11.072844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465060a-8e73-4ab0-8a9e-55fae46895dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:11.074122 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465060a-8e73-4ab0-8a9e-55fae46895dc None admin] RBAC: Adding query filter params (group.id=c614d076bb7348588c1d6847057ddf4c, role.id=201d465b851546b1a19c322a3356d48d, scope.project.id=bb5564ea35cb4871823a95b50fd471c7) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:11.074499 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465060a-8e73-4ab0-8a9e-55fae46895dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:11.076351 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465060a-8e73-4ab0-8a9e-55fae46895dc None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:11.083215 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 222/430] 10.222.0.39 () {56 vars in 1376 bytes} [Tue Jul 26 04:39:10 2022] GET /identity/v3/role_assignments?group.id=c614d076bb7348588c1d6847057ddf4c&scope.project.id=bb5564ea35cb4871823a95b50fd471c7&role.id=201d465b851546b1a19c322a3356d48d => generated 611 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:11.084750 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a4e78-b7d9-4c0f-8da9-499103bb9bcb None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:11.085107 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a4e78-b7d9-4c0f-8da9-499103bb9bcb None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:11.085447 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a4e78-b7d9-4c0f-8da9-499103bb9bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:11.106083 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-578a4e78-b7d9-4c0f-8da9-499103bb9bcb None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:11.107613 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-578a4e78-b7d9-4c0f-8da9-499103bb9bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:11.152518 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:11.234077 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 223/431] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:11.235989 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23246eb8-7b42-4b63-ae54-3b9d57bf6f13 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:11.236721 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23246eb8-7b42-4b63-ae54-3b9d57bf6f13 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:11.238841 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23246eb8-7b42-4b63-ae54-3b9d57bf6f13 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:11.241268 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 224/432] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:11.248556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f1140-25af-42a5-b3ab-0f97bf72494b None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:11.251249 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f1140-25af-42a5-b3ab-0f97bf72494b None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:11.252685 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f1140-25af-42a5-b3ab-0f97bf72494b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:11.266836 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6e279-35b7-475c-a88a-a3c933584b0a None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:11.286886 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-cc7f1140-25af-42a5-b3ab-0f97bf72494b None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:11.288292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-cc7f1140-25af-42a5-b3ab-0f97bf72494b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:11.312399 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8569ea-a998-4482-87e4-b3d32bef6e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:11.313460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8569ea-a998-4482-87e4-b3d32bef6e7c None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:11.313930 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8569ea-a998-4482-87e4-b3d32bef6e7c None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:11.314424 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8569ea-a998-4482-87e4-b3d32bef6e7c None admin] PATH_INFO: `/v3/groups/c614d076bb7348588c1d6847057ddf4c` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:11.315926 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8569ea-a998-4482-87e4-b3d32bef6e7c None admin] RBAC: Authorizing `identity:get_group(group_id=c614d076bb7348588c1d6847057ddf4c)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:11.317683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8569ea-a998-4482-87e4-b3d32bef6e7c None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:11.319829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 209/433] 10.222.0.39 () {56 vars in 1180 bytes} [Tue Jul 26 04:39:11 2022] GET /identity/v3/groups/c614d076bb7348588c1d6847057ddf4c => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:11.320761 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8569ea-a998-4482-87e4-b3d32bef6e7c None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:11.375855 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 225/434] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:11.378036 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f1140-25af-42a5-b3ab-0f97bf72494b None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:11.434998 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:11.464510 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8569ea-a998-4482-87e4-b3d32bef6e7c None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:11.478213 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:11.510632 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cb911-c922-4d82-a658-1f6c08a0d91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:11.511634 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cb911-c922-4d82-a658-1f6c08a0d91b None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:11.512076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cb911-c922-4d82-a658-1f6c08a0d91b None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:11.512350 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1cb911-c922-4d82-a658-1f6c08a0d91b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:11.524047 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f1140-25af-42a5-b3ab-0f97bf72494b None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:11.526073 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1cb911-c922-4d82-a658-1f6c08a0d91b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:11.531031 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-0f1cb911-c922-4d82-a658-1f6c08a0d91b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 04:39:11.531031 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:11.531031 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:11.531031 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:11.531031 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:11.531031 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:11.531031 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:11.531031 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:11.531031 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:11.531031 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:11.531031 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:11.531031 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:11.531031 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:11.531031 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:11.531031 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:11.531031 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:11.531955 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:11.531955 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:11.531955 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:11.531955 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:11.531955 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:11.531955 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:11.531955 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:11.531955 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:11.531955 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:11.531955 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:11.531955 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:11.531955 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:11.531955 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:11.531955 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:11.531955 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:11.531955 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:11.532745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:11.532745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:11.532745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:11.532745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:11.532745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:11.532745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:11.532745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:11.532745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:11.532745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:11.532745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:11.532745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 04:39:11.532745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:11.532745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 210/435] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 04:39:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:11.533432 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cb911-c922-4d82-a658-1f6c08a0d91b None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:11.572884 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dae313-16f9-4bf5-9776-11421066f4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:11.572884 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dae313-16f9-4bf5-9776-11421066f4bf None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:11.573546 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dae313-16f9-4bf5-9776-11421066f4bf None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:11.573616 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dae313-16f9-4bf5-9776-11421066f4bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:11.577221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dae313-16f9-4bf5-9776-11421066f4bf None admin] RBAC: Adding query filter params (group.id=c614d076bb7348588c1d6847057ddf4c, role.id=201d465b851546b1a19c322a3356d48d, scope.project.id=e8127522c84e4d4e989b25defd999d24) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:11.577221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dae313-16f9-4bf5-9776-11421066f4bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:11.577221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dae313-16f9-4bf5-9776-11421066f4bf None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:11.585483 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 226/436] 10.222.0.39 () {56 vars in 1376 bytes} [Tue Jul 26 04:39:11 2022] GET /identity/v3/role_assignments?group.id=c614d076bb7348588c1d6847057ddf4c&scope.project.id=e8127522c84e4d4e989b25defd999d24&role.id=201d465b851546b1a19c322a3356d48d => generated 611 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:11.586270 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dae313-16f9-4bf5-9776-11421066f4bf None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:11.676800 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1cb911-c922-4d82-a658-1f6c08a0d91b None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:11.717477 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de9b48-c68c-46c3-850e-878d69cf02d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:11.718229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de9b48-c68c-46c3-850e-878d69cf02d7 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:11.718506 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de9b48-c68c-46c3-850e-878d69cf02d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:11.718782 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de9b48-c68c-46c3-850e-878d69cf02d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:11.730205 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dae313-16f9-4bf5-9776-11421066f4bf None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:11.731672 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de9b48-c68c-46c3-850e-878d69cf02d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:11.733581 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:11.738179 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-37de9b48-c68c-46c3-850e-878d69cf02d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 04:39:11.738179 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:11.738179 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:11.738179 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:11.738179 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:11.738179 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:11.738179 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:11.738179 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:11.738179 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:11.738179 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:11.738179 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:11.738179 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:11.738179 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:11.738179 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:11.738179 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:11.738179 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:11.740354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:11.740354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:11.740354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:11.740354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:11.740354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:11.740354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:11.740354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:11.740354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:11.740354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:11.740354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:11.740354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:11.740354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:11.740354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:11.740354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:11.740354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:11.740354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:11.741143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:11.741143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:11.741143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:11.741143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:11.741143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:11.741143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:11.741143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:11.741143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:11.741143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:11.741143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:11.741143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 04:39:11.741143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:11.744781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 211/437] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 04:39:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:11.745762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de9b48-c68c-46c3-850e-878d69cf02d7 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:11.778262 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed0d8e-87a1-4847-a7e5-c2e98a2dc755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:11.778978 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:11.780208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed0d8e-87a1-4847-a7e5-c2e98a2dc755 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:11.780704 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed0d8e-87a1-4847-a7e5-c2e98a2dc755 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:11.781506 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aed0d8e-87a1-4847-a7e5-c2e98a2dc755 None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:11.782549 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed0d8e-87a1-4847-a7e5-c2e98a2dc755 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:11.783066 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed0d8e-87a1-4847-a7e5-c2e98a2dc755 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:11.784584 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aed0d8e-87a1-4847-a7e5-c2e98a2dc755 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:11.797622 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 227/438] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:11.803336 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed0d8e-87a1-4847-a7e5-c2e98a2dc755 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:11.861097 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de9b48-c68c-46c3-850e-878d69cf02d7 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:11.894089 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b183b-fe4d-4f4f-92a6-8842d51f58f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:11.894712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b183b-fe4d-4f4f-92a6-8842d51f58f7 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:11.894987 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b183b-fe4d-4f4f-92a6-8842d51f58f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:11.895508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b183b-fe4d-4f4f-92a6-8842d51f58f7 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:11.895992 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b183b-fe4d-4f4f-92a6-8842d51f58f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:11.896293 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b183b-fe4d-4f4f-92a6-8842d51f58f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:11.897695 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b183b-fe4d-4f4f-92a6-8842d51f58f7 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:11.905742 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 212/439] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:11.906983 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70db3ff-e498-4430-84fc-6d901dbd5e19 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:11.907278 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70db3ff-e498-4430-84fc-6d901dbd5e19 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:11.907538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70db3ff-e498-4430-84fc-6d901dbd5e19 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:11.911447 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aed0d8e-87a1-4847-a7e5-c2e98a2dc755 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:11.912855 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 213/440] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:11.913558 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70db3ff-e498-4430-84fc-6d901dbd5e19 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:11.947849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb229c-9a39-4f86-8fd2-638d484a515f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:11.948948 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb229c-9a39-4f86-8fd2-638d484a515f None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:11.949227 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb229c-9a39-4f86-8fd2-638d484a515f None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:11.949498 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb229c-9a39-4f86-8fd2-638d484a515f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:11.983975 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:12.010987 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:12.019896 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb229c-9a39-4f86-8fd2-638d484a515f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:12.021416 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb229c-9a39-4f86-8fd2-638d484a515f None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:12.021874 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70db3ff-e498-4430-84fc-6d901dbd5e19 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:12.058806 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967af4c-558a-444d-9118-bd26f4f05b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:12.059334 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967af4c-558a-444d-9118-bd26f4f05b12 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:12.059614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967af4c-558a-444d-9118-bd26f4f05b12 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:12.059884 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967af4c-558a-444d-9118-bd26f4f05b12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:12.124373 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 228/441] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:39:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 04:39:12.129805 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967af4c-558a-444d-9118-bd26f4f05b12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:12.130379 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1b52e-93d0-457d-954e-3e9250096cfd None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:12.130669 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1b52e-93d0-457d-954e-3e9250096cfd None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:12.130944 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1b52e-93d0-457d-954e-3e9250096cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:12.131358 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967af4c-558a-444d-9118-bd26f4f05b12 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:12.148725 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-8aa1b52e-93d0-457d-954e-3e9250096cfd None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:12.150013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-8aa1b52e-93d0-457d-954e-3e9250096cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:12.210355 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:12.221858 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 229/442] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:12.222756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1b52e-93d0-457d-954e-3e9250096cfd None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:12.223942 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:12.237282 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 214/443] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:39:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:12.242934 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967af4c-558a-444d-9118-bd26f4f05b12 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:12.343991 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1b52e-93d0-457d-954e-3e9250096cfd None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:12.347817 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967af4c-558a-444d-9118-bd26f4f05b12 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:12.379777 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db14d29-79f0-4107-9234-4033c1a14a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:12.380419 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db14d29-79f0-4107-9234-4033c1a14a3c None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:12.380701 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db14d29-79f0-4107-9234-4033c1a14a3c None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:12.380971 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db14d29-79f0-4107-9234-4033c1a14a3c None admin] PATH_INFO: `/v3/projects/e8127522c84e4d4e989b25defd999d24` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:12.382168 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db14d29-79f0-4107-9234-4033c1a14a3c None admin] RBAC: Authorizing `identity:get_project(project_id=e8127522c84e4d4e989b25defd999d24)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:12.383022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff60ba4-d55c-4d5d-abd7-b02f5cf4906d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:12.383641 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db14d29-79f0-4107-9234-4033c1a14a3c None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:12.383743 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff60ba4-d55c-4d5d-abd7-b02f5cf4906d None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:12.383932 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff60ba4-d55c-4d5d-abd7-b02f5cf4906d None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:12.384199 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff60ba4-d55c-4d5d-abd7-b02f5cf4906d None admin] PATH_INFO: `/v3/projects/bb5564ea35cb4871823a95b50fd471c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:12.385322 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 230/444] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:39:12 2022] GET /identity/v3/projects/e8127522c84e4d4e989b25defd999d24 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:12.385431 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff60ba4-d55c-4d5d-abd7-b02f5cf4906d None admin] RBAC: Authorizing `identity:get_project(project_id=bb5564ea35cb4871823a95b50fd471c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:12.386107 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db14d29-79f0-4107-9234-4033c1a14a3c None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:12.386811 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff60ba4-d55c-4d5d-abd7-b02f5cf4906d None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:12.388774 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 215/445] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:39:12 2022] GET /identity/v3/projects/bb5564ea35cb4871823a95b50fd471c7 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:39:12.390993 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff60ba4-d55c-4d5d-abd7-b02f5cf4906d None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:12.447221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:12.454009 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:12.487208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db14d29-79f0-4107-9234-4033c1a14a3c None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:12.498274 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff60ba4-d55c-4d5d-abd7-b02f5cf4906d None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:12.529959 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d6322-574c-4888-a212-f1c3d49fb401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:12.530741 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d6322-574c-4888-a212-f1c3d49fb401 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:12.531025 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d6322-574c-4888-a212-f1c3d49fb401 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:12.531297 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d6322-574c-4888-a212-f1c3d49fb401 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:12.532632 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64be16-f9b5-4e46-ba55-cd64435100f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:12.533290 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64be16-f9b5-4e46-ba55-cd64435100f4 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:12.533569 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64be16-f9b5-4e46-ba55-cd64435100f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:12.533842 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64be16-f9b5-4e46-ba55-cd64435100f4 None admin] PATH_INFO: `/v3/groups/c614d076bb7348588c1d6847057ddf4c` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:12.535245 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64be16-f9b5-4e46-ba55-cd64435100f4 None admin] RBAC: Authorizing `identity:get_group(group_id=c614d076bb7348588c1d6847057ddf4c)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:12.537469 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64be16-f9b5-4e46-ba55-cd64435100f4 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:12.544888 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 216/446] 10.222.0.39 () {56 vars in 1180 bytes} [Tue Jul 26 04:39:12 2022] GET /identity/v3/groups/c614d076bb7348588c1d6847057ddf4c => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:39:12.544888 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64be16-f9b5-4e46-ba55-cd64435100f4 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:12.545173 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715d6322-574c-4888-a212-f1c3d49fb401 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:12.547070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-715d6322-574c-4888-a212-f1c3d49fb401 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:39:12.547070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:12.547070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:12.547070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:12.547070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:12.547070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:12.547070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:12.547070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:12.547070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:12.547070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:12.547070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:12.547070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:12.547070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:12.547070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:12.547070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:12.547070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:12.548142 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:12.548142 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:12.548142 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:12.548142 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:12.548142 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:12.548142 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:12.548142 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:12.548142 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:12.548142 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:12.548142 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:12.548142 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:12.548142 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:12.548142 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:12.548142 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:12.548142 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:12.548142 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:12.548938 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:12.548938 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:12.548938 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:12.548938 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:12.548938 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:12.548938 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:12.548938 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:12.548938 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:12.548938 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:12.548938 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:12.548938 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:39:12.548938 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:12.548938 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 231/447] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:39:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:12.550031 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d6322-574c-4888-a212-f1c3d49fb401 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:12.647798 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64be16-f9b5-4e46-ba55-cd64435100f4 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:12.663864 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715d6322-574c-4888-a212-f1c3d49fb401 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:12.673785 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:12.683180 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445ad4c-f176-41b9-ac4c-104985ce68ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:12.683872 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445ad4c-f176-41b9-ac4c-104985ce68ca None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:12.684150 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445ad4c-f176-41b9-ac4c-104985ce68ca None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:12.684413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445ad4c-f176-41b9-ac4c-104985ce68ca None admin] PATH_INFO: `/v3/groups/c614d076bb7348588c1d6847057ddf4c` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:12.685623 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445ad4c-f176-41b9-ac4c-104985ce68ca None admin] RBAC: Authorizing `identity:get_group(group_id=c614d076bb7348588c1d6847057ddf4c)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:12.687128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445ad4c-f176-41b9-ac4c-104985ce68ca None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:12.687894 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:12.688776 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 217/448] 10.222.0.39 () {56 vars in 1180 bytes} [Tue Jul 26 04:39:12 2022] GET /identity/v3/groups/c614d076bb7348588c1d6847057ddf4c => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:12.689568 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445ad4c-f176-41b9-ac4c-104985ce68ca None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:12.704966 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe182dd-5df7-46da-a5da-fb5d78a8cd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:12.705601 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe182dd-5df7-46da-a5da-fb5d78a8cd03 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:12.705877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe182dd-5df7-46da-a5da-fb5d78a8cd03 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:12.706196 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe182dd-5df7-46da-a5da-fb5d78a8cd03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:12.706999 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe182dd-5df7-46da-a5da-fb5d78a8cd03 None admin] RBAC: Adding query filter params (group.id=c614d076bb7348588c1d6847057ddf4c, role.id=e2b16a5edd7b472487fac12492349bc7, scope.project.id=e8127522c84e4d4e989b25defd999d24) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:12.707305 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe182dd-5df7-46da-a5da-fb5d78a8cd03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:12.708860 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe182dd-5df7-46da-a5da-fb5d78a8cd03 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:12.714945 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 232/449] 10.222.0.39 () {56 vars in 1376 bytes} [Tue Jul 26 04:39:12 2022] GET /identity/v3/role_assignments?group.id=c614d076bb7348588c1d6847057ddf4c&scope.project.id=e8127522c84e4d4e989b25defd999d24&role.id=e2b16a5edd7b472487fac12492349bc7 => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:12.715744 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe182dd-5df7-46da-a5da-fb5d78a8cd03 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:12.821424 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445ad4c-f176-41b9-ac4c-104985ce68ca None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:12.828933 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe182dd-5df7-46da-a5da-fb5d78a8cd03 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:12.869429 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f971e2-4ba6-4d83-9a2e-7d6ff5a029d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:12.870124 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f971e2-4ba6-4d83-9a2e-7d6ff5a029d9 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:12.870408 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f971e2-4ba6-4d83-9a2e-7d6ff5a029d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:12.870730 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f971e2-4ba6-4d83-9a2e-7d6ff5a029d9 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:12.871482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f971e2-4ba6-4d83-9a2e-7d6ff5a029d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:12.871788 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f971e2-4ba6-4d83-9a2e-7d6ff5a029d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:12.873230 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f971e2-4ba6-4d83-9a2e-7d6ff5a029d9 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:12.876141 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b5823-6aaf-4a71-a854-86b3b389275b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:12.877466 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b5823-6aaf-4a71-a854-86b3b389275b None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:12.877748 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b5823-6aaf-4a71-a854-86b3b389275b None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:12.878047 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b5823-6aaf-4a71-a854-86b3b389275b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:12.878861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b5823-6aaf-4a71-a854-86b3b389275b None admin] RBAC: Adding query filter params (group.id=c614d076bb7348588c1d6847057ddf4c, role.id=e2b16a5edd7b472487fac12492349bc7, scope.project.id=bb5564ea35cb4871823a95b50fd471c7) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:12.879181 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b5823-6aaf-4a71-a854-86b3b389275b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:12.880744 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b5823-6aaf-4a71-a854-86b3b389275b None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:12.883567 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 218/450] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:39:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:12.888517 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 233/451] 10.222.0.39 () {56 vars in 1376 bytes} [Tue Jul 26 04:39:12 2022] GET /identity/v3/role_assignments?group.id=c614d076bb7348588c1d6847057ddf4c&scope.project.id=bb5564ea35cb4871823a95b50fd471c7&role.id=e2b16a5edd7b472487fac12492349bc7 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:12.889380 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f971e2-4ba6-4d83-9a2e-7d6ff5a029d9 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:12.958592 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:13.013594 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f971e2-4ba6-4d83-9a2e-7d6ff5a029d9 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:13.051076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82251935-e1fb-45f3-b976-7c9b1ee476c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:13.051805 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82251935-e1fb-45f3-b976-7c9b1ee476c2 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:13.052084 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82251935-e1fb-45f3-b976-7c9b1ee476c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:13.052352 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82251935-e1fb-45f3-b976-7c9b1ee476c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:13.124227 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82251935-e1fb-45f3-b976-7c9b1ee476c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:13.125745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82251935-e1fb-45f3-b976-7c9b1ee476c2 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:13.184248 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:13.229871 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 219/452] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:39:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 26 04:39:13.235735 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b5823-6aaf-4a71-a854-86b3b389275b None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:13.298461 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:13.349464 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b5823-6aaf-4a71-a854-86b3b389275b None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:13.383008 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f2d79-ca18-474c-a92e-fb8de665c5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:13.383657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f2d79-ca18-474c-a92e-fb8de665c5b4 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:13.383932 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f2d79-ca18-474c-a92e-fb8de665c5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:13.384199 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f2d79-ca18-474c-a92e-fb8de665c5b4 None admin] PATH_INFO: `/v3/projects/01e6e551a86f4df9abc0b95c6772bf0e` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:13.385404 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f2d79-ca18-474c-a92e-fb8de665c5b4 None admin] RBAC: Authorizing `identity:get_project(project_id=01e6e551a86f4df9abc0b95c6772bf0e)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:13.386912 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f2d79-ca18-474c-a92e-fb8de665c5b4 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:13.388613 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 234/453] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:39:13 2022] GET /identity/v3/projects/01e6e551a86f4df9abc0b95c6772bf0e => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:13.394653 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82251935-e1fb-45f3-b976-7c9b1ee476c2 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:13.498425 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82251935-e1fb-45f3-b976-7c9b1ee476c2 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:13.534065 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718ba1f-1ca7-4ed9-956e-3ea9cb928921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:13.534745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718ba1f-1ca7-4ed9-956e-3ea9cb928921 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:13.535008 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718ba1f-1ca7-4ed9-956e-3ea9cb928921 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:13.535275 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718ba1f-1ca7-4ed9-956e-3ea9cb928921 None admin] PATH_INFO: `/v3/groups/69943f87f9494ce4bfc014064487a7ca` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:13.536497 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718ba1f-1ca7-4ed9-956e-3ea9cb928921 None admin] RBAC: Authorizing `identity:get_group(group_id=69943f87f9494ce4bfc014064487a7ca)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:13.538000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718ba1f-1ca7-4ed9-956e-3ea9cb928921 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:13.539636 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 220/454] 10.222.0.39 () {56 vars in 1180 bytes} [Tue Jul 26 04:39:13 2022] GET /identity/v3/groups/69943f87f9494ce4bfc014064487a7ca => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:13.545634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f2d79-ca18-474c-a92e-fb8de665c5b4 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:13.643886 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f2d79-ca18-474c-a92e-fb8de665c5b4 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:13.663854 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:13.678214 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808417a0-68a8-473d-8de2-f5aeb40b3eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:13.678840 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808417a0-68a8-473d-8de2-f5aeb40b3eb1 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:13.679121 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808417a0-68a8-473d-8de2-f5aeb40b3eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:13.679393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808417a0-68a8-473d-8de2-f5aeb40b3eb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:13.680185 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808417a0-68a8-473d-8de2-f5aeb40b3eb1 None admin] RBAC: Adding query filter params (group.id=69943f87f9494ce4bfc014064487a7ca, role.id=2bfdd65b06554a6da967b3939da753c7, scope.project.id=01e6e551a86f4df9abc0b95c6772bf0e) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:13.680501 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808417a0-68a8-473d-8de2-f5aeb40b3eb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:13.682017 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808417a0-68a8-473d-8de2-f5aeb40b3eb1 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:13.687791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 235/455] 10.222.0.39 () {56 vars in 1376 bytes} [Tue Jul 26 04:39:13 2022] GET /identity/v3/role_assignments?group.id=69943f87f9494ce4bfc014064487a7ca&scope.project.id=01e6e551a86f4df9abc0b95c6772bf0e&role.id=2bfdd65b06554a6da967b3939da753c7 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:16.171269 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d6544-19e2-4a64-a124-68617cacb1b1 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:16.171801 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d6544-19e2-4a64-a124-68617cacb1b1 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:16.171801 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d6544-19e2-4a64-a124-68617cacb1b1 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:16.173409 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 221/456] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:16.190758 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a003dc5-636c-47bc-87a6-3e4d9394df13 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:16.191264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a003dc5-636c-47bc-87a6-3e4d9394df13 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:16.191336 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a003dc5-636c-47bc-87a6-3e4d9394df13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:16.199240 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab179d0d-6315-4d1c-8cb3-53eded8e3b7d None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:16.199866 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab179d0d-6315-4d1c-8cb3-53eded8e3b7d None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:16.200361 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab179d0d-6315-4d1c-8cb3-53eded8e3b7d None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:16.202194 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 222/457] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:16.211407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6258c20-2f21-4e40-99ee-0499a88e62c4 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:16.211992 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6258c20-2f21-4e40-99ee-0499a88e62c4 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:16.212458 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6258c20-2f21-4e40-99ee-0499a88e62c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:16.219124 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-6a003dc5-636c-47bc-87a6-3e4d9394df13 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:16.220305 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-6a003dc5-636c-47bc-87a6-3e4d9394df13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:16.249404 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-d6258c20-2f21-4e40-99ee-0499a88e62c4 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:16.250742 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-d6258c20-2f21-4e40-99ee-0499a88e62c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:16.300405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:16.367663 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 236/458] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 04:39:16.370131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 223/459] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:16.391579 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a003dc5-636c-47bc-87a6-3e4d9394df13 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:16.401053 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6258c20-2f21-4e40-99ee-0499a88e62c4 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:16.525524 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a003dc5-636c-47bc-87a6-3e4d9394df13 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:16.533795 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6258c20-2f21-4e40-99ee-0499a88e62c4 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:16.542199 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:16.565452 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98baa4f-a20c-4861-b9f4-a1f18062f913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:16.566400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98baa4f-a20c-4861-b9f4-a1f18062f913 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:16.567004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98baa4f-a20c-4861-b9f4-a1f18062f913 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:16.567450 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98baa4f-a20c-4861-b9f4-a1f18062f913 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:16.570193 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d08bd-2803-4c57-8640-14a419e23ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:16.571037 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d08bd-2803-4c57-8640-14a419e23ae0 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:16.571484 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d08bd-2803-4c57-8640-14a419e23ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:16.571901 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d08bd-2803-4c57-8640-14a419e23ae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:16.579701 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98baa4f-a20c-4861-b9f4-a1f18062f913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:16.581523 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98baa4f-a20c-4861-b9f4-a1f18062f913 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:16.583682 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d08bd-2803-4c57-8640-14a419e23ae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:16.585344 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d08bd-2803-4c57-8640-14a419e23ae0 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:16.599019 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-a98baa4f-a20c-4861-b9f4-a1f18062f913 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:16.599019 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:16.599019 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:16.599019 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:16.599019 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:16.599019 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:16.599019 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:16.599019 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:16.599019 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:16.599019 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:16.599019 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:16.599019 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:16.599019 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:16.599019 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:16.599019 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:16.600627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:16.600627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:16.600627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:16.600627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:16.600627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:16.600627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:16.600627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:16.600627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:16.600627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:16.600627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:16.600627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:16.600627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:16.600627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:16.600627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:16.600627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:16.600627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:16.600627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:16.602146 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:16.602146 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:16.602146 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:16.602146 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:16.602146 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 237/460] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:16.603494 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da56f1f-4c06-4348-b1ce-9574d0298cc9 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:16.603775 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da56f1f-4c06-4348-b1ce-9574d0298cc9 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:16.604045 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da56f1f-4c06-4348-b1ce-9574d0298cc9 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:16.605393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 238/461] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:16.607596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-6f8d08bd-2803-4c57-8640-14a419e23ae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:16.607596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:16.607596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:16.607596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:16.607596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:16.607596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:16.607596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:16.607596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:16.607596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:16.607596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:16.607596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:16.607596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:16.607596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:16.607596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:16.607596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:16.608558 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:16.608558 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:16.608558 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:16.608558 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:16.608558 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:16.608558 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:16.608558 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:16.608558 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:16.608558 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:16.608558 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:16.608558 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:16.608558 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:16.608558 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:16.608558 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:16.608558 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:16.608558 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:16.608558 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:16.609458 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:16.609458 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:16.609458 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:16.609458 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:16.611789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 224/462] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:39:16.615043 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da56f1f-4c06-4348-b1ce-9574d0298cc9 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:16.615693 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240b198-f37a-4e42-ab27-f0863ac84dc3 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:16.616250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240b198-f37a-4e42-ab27-f0863ac84dc3 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:16.616760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6240b198-f37a-4e42-ab27-f0863ac84dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:16.640002 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-6240b198-f37a-4e42-ab27-f0863ac84dc3 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:16.642149 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-6240b198-f37a-4e42-ab27-f0863ac84dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:16.645482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:16.736139 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 225/463] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:16.737505 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240b198-f37a-4e42-ab27-f0863ac84dc3 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:16.742993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da56f1f-4c06-4348-b1ce-9574d0298cc9 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:16.796880 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3cee9-504f-499f-a70e-e4d46f3fe91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:16.797750 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3cee9-504f-499f-a70e-e4d46f3fe91a None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:16.798205 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3cee9-504f-499f-a70e-e4d46f3fe91a None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:16.798622 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3cee9-504f-499f-a70e-e4d46f3fe91a None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:16.799581 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3cee9-504f-499f-a70e-e4d46f3fe91a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:16.800148 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3cee9-504f-499f-a70e-e4d46f3fe91a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:16.801939 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3cee9-504f-499f-a70e-e4d46f3fe91a None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:16.826476 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 239/464] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:16.828601 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3cee9-504f-499f-a70e-e4d46f3fe91a None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:16.860683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6240b198-f37a-4e42-ab27-f0863ac84dc3 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:16.865733 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:16.898885 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d93570-fc01-4ba1-a6c6-979b029441ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:16.899908 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d93570-fc01-4ba1-a6c6-979b029441ee None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:16.900292 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d93570-fc01-4ba1-a6c6-979b029441ee None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:16.900572 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d93570-fc01-4ba1-a6c6-979b029441ee None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:16.901276 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d93570-fc01-4ba1-a6c6-979b029441ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:16.901573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d93570-fc01-4ba1-a6c6-979b029441ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:16.903086 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d93570-fc01-4ba1-a6c6-979b029441ee None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:16.910687 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:16.921508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 226/465] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:16.922710 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d93570-fc01-4ba1-a6c6-979b029441ee None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:16.955016 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3cee9-504f-499f-a70e-e4d46f3fe91a None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:16.991229 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cb802-d18e-4658-980d-130043e4aebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:16.991886 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cb802-d18e-4658-980d-130043e4aebf None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:16.992165 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cb802-d18e-4658-980d-130043e4aebf None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:16.992439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cb802-d18e-4658-980d-130043e4aebf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:17.008800 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778cb802-d18e-4658-980d-130043e4aebf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:17.010331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778cb802-d18e-4658-980d-130043e4aebf None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:17.025789 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-778cb802-d18e-4658-980d-130043e4aebf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:17.025789 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:17.025789 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:17.025789 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:17.025789 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:17.025789 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:17.025789 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:17.025789 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:17.025789 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:17.025789 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:17.025789 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:17.025789 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:17.025789 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:17.025789 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:17.025789 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:17.026736 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:17.026736 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:17.026736 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:17.026736 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:17.026736 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:17.026736 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:17.026736 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:17.026736 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:17.026736 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:17.026736 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:17.026736 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:17.026736 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:17.026736 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:17.026736 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:17.026736 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:17.026736 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:17.026736 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:17.027605 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:17.027605 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:17.027605 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:17.027605 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:17.027605 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 240/466] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:17.028556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dd914-72c3-46d9-8952-9d1468f6bb93 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:17.028725 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dd914-72c3-46d9-8952-9d1468f6bb93 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:17.029167 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413dd914-72c3-46d9-8952-9d1468f6bb93 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:17.030654 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 241/467] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:17.031540 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413dd914-72c3-46d9-8952-9d1468f6bb93 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:17.041368 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d93570-fc01-4ba1-a6c6-979b029441ee None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:17.078681 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1ac8c5-e95e-4b13-a8ce-02b34f24e33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:17.079260 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ac8c5-e95e-4b13-a8ce-02b34f24e33c None admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:17.079546 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ac8c5-e95e-4b13-a8ce-02b34f24e33c None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:17.079821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ac8c5-e95e-4b13-a8ce-02b34f24e33c None admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:17.080507 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ac8c5-e95e-4b13-a8ce-02b34f24e33c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:17.082002 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1ac8c5-e95e-4b13-a8ce-02b34f24e33c None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:17.106090 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 227/468] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 04:39:16 2022] POST /identity/v3/users => generated 248 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:39:17.107420 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317ec02-a7e5-4574-9ab1-a95c23f5ede1 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:17.107710 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317ec02-a7e5-4574-9ab1-a95c23f5ede1 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:17.107991 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317ec02-a7e5-4574-9ab1-a95c23f5ede1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:17.129093 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-6317ec02-a7e5-4574-9ab1-a95c23f5ede1 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:17.130624 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-6317ec02-a7e5-4574-9ab1-a95c23f5ede1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:17.134941 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:17.165110 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413dd914-72c3-46d9-8952-9d1468f6bb93 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:17.199135 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:17.217866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c64638-9a72-4691-b425-967d016f31fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:17.218634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c64638-9a72-4691-b425-967d016f31fd None admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:17.218840 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c64638-9a72-4691-b425-967d016f31fd None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:17.219156 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c64638-9a72-4691-b425-967d016f31fd None admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:17.220221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c64638-9a72-4691-b425-967d016f31fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:17.222740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c64638-9a72-4691-b425-967d016f31fd None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:17.226522 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 228/469] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:17.227714 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317ec02-a7e5-4574-9ab1-a95c23f5ede1 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:17.262009 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 242/470] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 04:39:17 2022] POST /identity/v3/users => generated 246 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:39:17.264230 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c64638-9a72-4691-b425-967d016f31fd None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:17.423923 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317ec02-a7e5-4574-9ab1-a95c23f5ede1 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:17.453255 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c64638-9a72-4691-b425-967d016f31fd None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:17.471709 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122824c-b291-4bd3-98d7-9bf5e68ba1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:17.472355 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122824c-b291-4bd3-98d7-9bf5e68ba1dc None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:17.472644 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122824c-b291-4bd3-98d7-9bf5e68ba1dc None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:17.472919 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6122824c-b291-4bd3-98d7-9bf5e68ba1dc None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:17.473702 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122824c-b291-4bd3-98d7-9bf5e68ba1dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:17.474076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122824c-b291-4bd3-98d7-9bf5e68ba1dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:17.475545 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6122824c-b291-4bd3-98d7-9bf5e68ba1dc None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:17.492294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 229/471] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:17.498122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122824c-b291-4bd3-98d7-9bf5e68ba1dc None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:17.502629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36b780-9006-47d2-8c95-307e0ffbbfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:17.503582 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36b780-9006-47d2-8c95-307e0ffbbfd4 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:17.504061 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36b780-9006-47d2-8c95-307e0ffbbfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:17.504595 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36b780-9006-47d2-8c95-307e0ffbbfd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:17.514442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:17.520211 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36b780-9006-47d2-8c95-307e0ffbbfd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:17.522663 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36b780-9006-47d2-8c95-307e0ffbbfd4 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:17.541079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-2a36b780-9006-47d2-8c95-307e0ffbbfd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:17.541079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:17.541079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:17.541079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:17.541079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:17.541079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:17.541079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:17.541079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:17.541079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:17.541079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:17.541079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:17.541079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:17.541079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:17.541079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:17.541079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:17.542027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:17.542027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:17.542027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:17.542027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:17.542027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:17.542027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:17.542027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:17.542027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:17.542027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:17.542027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:17.542027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:17.542027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:17.542027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:17.542027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:17.542027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:17.542027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:17.542027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:17.542904 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:17.542904 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:17.542904 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:17.542904 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:17.542904 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 243/472] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:39:17.543977 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9b13c-dd0e-4cb7-a8f7-b0f33b7d8113 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:17.544372 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9b13c-dd0e-4cb7-a8f7-b0f33b7d8113 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:17.544655 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9b13c-dd0e-4cb7-a8f7-b0f33b7d8113 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:17.547473 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 244/473] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:17.550601 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9b13c-dd0e-4cb7-a8f7-b0f33b7d8113 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:17.557317 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:17.622239 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6122824c-b291-4bd3-98d7-9bf5e68ba1dc None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:17.658247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f894718-57ed-456c-a38b-9a3ac3c14a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:17.659138 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f894718-57ed-456c-a38b-9a3ac3c14a04 None admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:17.659593 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f894718-57ed-456c-a38b-9a3ac3c14a04 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:17.660014 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f894718-57ed-456c-a38b-9a3ac3c14a04 None admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:17.660921 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f894718-57ed-456c-a38b-9a3ac3c14a04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:17.662425 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f894718-57ed-456c-a38b-9a3ac3c14a04 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:17.676894 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9b13c-dd0e-4cb7-a8f7-b0f33b7d8113 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:17.688937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 230/474] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 04:39:17 2022] POST /identity/v3/users => generated 248 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:39:17.690623 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9f51c-45e0-4a3d-8747-40cff1afb50b None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:17.690918 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9f51c-45e0-4a3d-8747-40cff1afb50b None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:17.691239 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9f51c-45e0-4a3d-8747-40cff1afb50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:17.713393 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-2dd9f51c-45e0-4a3d-8747-40cff1afb50b None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:17.714927 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-2dd9f51c-45e0-4a3d-8747-40cff1afb50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:17.727068 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdfd3b-e73b-4313-9274-c46834de833b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:17.727068 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdfd3b-e73b-4313-9274-c46834de833b None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:17.727068 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdfd3b-e73b-4313-9274-c46834de833b None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:17.732549 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdfd3b-e73b-4313-9274-c46834de833b None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:17.734022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fdfd3b-e73b-4313-9274-c46834de833b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:17.734022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fdfd3b-e73b-4313-9274-c46834de833b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:17.738508 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fdfd3b-e73b-4313-9274-c46834de833b None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:17.767111 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 245/475] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:17.771270 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdfd3b-e73b-4313-9274-c46834de833b None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:17.871179 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:17.872156 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 231/476] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:17.893569 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9f51c-45e0-4a3d-8747-40cff1afb50b None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:17.944953 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdfd3b-e73b-4313-9274-c46834de833b None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:17.950428 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:17.992870 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba62a10-af23-4a7e-a367-69e03188dc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:17.993510 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba62a10-af23-4a7e-a367-69e03188dc30 None admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:17.993790 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba62a10-af23-4a7e-a367-69e03188dc30 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:17.994471 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba62a10-af23-4a7e-a367-69e03188dc30 None admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:17.995308 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba62a10-af23-4a7e-a367-69e03188dc30 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:17.996804 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba62a10-af23-4a7e-a367-69e03188dc30 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:18.025859 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 246/477] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 04:39:17 2022] POST /identity/v3/users => generated 249 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:39:18.029022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9f51c-45e0-4a3d-8747-40cff1afb50b None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:18.070275 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ea43f-3fa3-4128-889b-6bcf07b174e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:18.070936 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ea43f-3fa3-4128-889b-6bcf07b174e3 None admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:18.071218 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ea43f-3fa3-4128-889b-6bcf07b174e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:18.071491 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ea43f-3fa3-4128-889b-6bcf07b174e3 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:18.072240 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ea43f-3fa3-4128-889b-6bcf07b174e3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:18.074080 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ea43f-3fa3-4128-889b-6bcf07b174e3 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:18.084584 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.sql.core [None req-967ea43f-3fa3-4128-889b-6bcf07b174e3 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 26 04:39:18.084584 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 26 04:39:18.084584 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [parameters: {'id': 'e66fd78a41624b7c9f0f3e8d0e552a48', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 26 04:39:18.084584 dv-cinder-850574-1-smb devstack@keystone.service[86745]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86745) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 04:39:18.102186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-967ea43f-3fa3-4128-889b-6bcf07b174e3 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 26 04:39:18.102186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:18.102186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 04:39:18.102186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 04:39:18.102186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 04:39:18.102186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 04:39:18.102186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 04:39:18.102186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 04:39:18.102186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 04:39:18.102186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application conn.query(q) Jul 26 04:39:18.102186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 04:39:18.102186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 04:39:18.102186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 04:39:18.102186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application result.read() Jul 26 04:39:18.102186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 04:39:18.103114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 04:39:18.103114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 04:39:18.103114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 04:39:18.103114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 04:39:18.103114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 04:39:18.103114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 04:39:18.103114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 04:39:18.103114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 26 04:39:18.103114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:18.103114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 04:39:18.103114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:18.103114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:18.103114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 04:39:18.103114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 04:39:18.103114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 26 04:39:18.103114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return ref.to_dict() Jul 26 04:39:18.103114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 04:39:18.103114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application next(self.gen) Jul 26 04:39:18.104018 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 04:39:18.104018 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application yield resource Jul 26 04:39:18.104018 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 04:39:18.104018 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application next(self.gen) Jul 26 04:39:18.104018 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 04:39:18.104018 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 04:39:18.104018 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:39:18.104018 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 04:39:18.104018 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:39:18.104018 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise self.value Jul 26 04:39:18.104018 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 04:39:18.104018 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 04:39:18.104018 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 04:39:18.104018 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application session.commit() Jul 26 04:39:18.104018 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 04:39:18.104018 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 04:39:18.104018 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 04:39:18.104881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 04:39:18.104881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 04:39:18.104881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self.session.flush() Jul 26 04:39:18.104881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 04:39:18.104881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 04:39:18.104881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 04:39:18.104881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 04:39:18.104881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 04:39:18.104881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application compat.raise_( Jul 26 04:39:18.104881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 04:39:18.104881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception Jul 26 04:39:18.104881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 04:39:18.104881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 04:39:18.104881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 04:39:18.104881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 04:39:18.104881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 04:39:18.104881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 04:39:18.105737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 04:39:18.105737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 04:39:18.105737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 26 04:39:18.105737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 26 04:39:18.105737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 04:39:18.105737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 04:39:18.105737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 04:39:18.105737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 04:39:18.105737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 04:39:18.105737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 04:39:18.105737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 04:39:18.105737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 04:39:18.105737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 04:39:18.105737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 04:39:18.105737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 04:39:18.105737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception Jul 26 04:39:18.108164 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 04:39:18.108164 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 04:39:18.108164 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 04:39:18.108164 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 04:39:18.108164 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 04:39:18.108164 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 04:39:18.108164 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 04:39:18.108164 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application conn.query(q) Jul 26 04:39:18.108164 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 04:39:18.108164 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 04:39:18.108164 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 04:39:18.108164 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application result.read() Jul 26 04:39:18.108164 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 04:39:18.108164 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 04:39:18.108164 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 04:39:18.108164 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 04:39:18.110110 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 04:39:18.110110 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 04:39:18.110110 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 04:39:18.110110 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 04:39:18.110110 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 26 04:39:18.110110 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 26 04:39:18.110110 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [parameters: {'id': 'e66fd78a41624b7c9f0f3e8d0e552a48', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 26 04:39:18.110110 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 04:39:18.110110 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:18.110110 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 04:39:18.110110 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:18.110110 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:18.110110 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:18.110110 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:18.110110 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:18.110110 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:18.116937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:18.116937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:18.116937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:18.116937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:18.116937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:18.116937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:18.116937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 26 04:39:18.116937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 26 04:39:18.116937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:18.116937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:18.116937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 26 04:39:18.116937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 26 04:39:18.116937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 04:39:18.116937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 04:39:18.116937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 26 04:39:18.116937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:18.118992 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 232/478] 10.222.0.39 () {60 vars in 1131 bytes} [Tue Jul 26 04:39:17 2022] POST /identity/v3/roles => generated 144 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:39:18.119126 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba62a10-af23-4a7e-a367-69e03188dc30 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:18.246500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba62a10-af23-4a7e-a367-69e03188dc30 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:18.249654 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:18.316414 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9f310-4e56-461f-9010-b258326080da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:18.317079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9f310-4e56-461f-9010-b258326080da None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:18.317355 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9f310-4e56-461f-9010-b258326080da None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:18.317628 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9f310-4e56-461f-9010-b258326080da None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:18.336837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b9f310-4e56-461f-9010-b258326080da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:18.342290 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-e5b9f310-4e56-461f-9010-b258326080da None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 04:39:18.342290 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:18.342290 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:18.342290 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:18.342290 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:18.342290 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:18.342290 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:18.342290 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:18.342290 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:18.342290 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:18.342290 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:18.342290 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:18.342290 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:18.342290 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:18.342290 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:18.342290 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:18.344350 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:18.344350 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:18.344350 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:18.344350 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:18.344350 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:18.344350 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:18.344350 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:18.344350 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:18.344350 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:18.344350 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:18.344350 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:18.344350 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:18.344350 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:18.344350 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:18.344350 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:18.344350 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:18.346292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:18.346292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:18.346292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:18.346292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:18.346292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:18.346292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:18.346292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:18.346292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:18.346292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:18.346292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:18.346292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 26 04:39:18.346292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:18.346292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 247/479] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 04:39:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:18.357101 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ea43f-3fa3-4128-889b-6bcf07b174e3 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:18.465225 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:18.471943 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ea43f-3fa3-4128-889b-6bcf07b174e3 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:18.508607 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1959ed-a0d7-4e04-855e-0d26d64720e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:18.509144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1959ed-a0d7-4e04-855e-0d26d64720e4 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:18.509425 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1959ed-a0d7-4e04-855e-0d26d64720e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:18.509694 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1959ed-a0d7-4e04-855e-0d26d64720e4 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:18.510451 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1959ed-a0d7-4e04-855e-0d26d64720e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:18.510759 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1959ed-a0d7-4e04-855e-0d26d64720e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:18.512154 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1959ed-a0d7-4e04-855e-0d26d64720e4 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:18.521545 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 233/480] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:19.596240 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354c575-eb6b-410a-86e0-b5182329cb0a None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:19.596759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354c575-eb6b-410a-86e0-b5182329cb0a None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:19.596759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354c575-eb6b-410a-86e0-b5182329cb0a None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:19.598425 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 248/481] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:19.603945 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923aa15-7b0f-4758-b0d2-915f066fa3a5 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:19.604783 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923aa15-7b0f-4758-b0d2-915f066fa3a5 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:19.605254 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923aa15-7b0f-4758-b0d2-915f066fa3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:19.635338 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-5923aa15-7b0f-4758-b0d2-915f066fa3a5 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:19.636992 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-5923aa15-7b0f-4758-b0d2-915f066fa3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:19.729078 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 234/482] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:19.763922 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354c575-eb6b-410a-86e0-b5182329cb0a None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:19.774604 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1ee33-f26b-4802-bc10-46bee3e95b01 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:19.775223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1ee33-f26b-4802-bc10-46bee3e95b01 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:19.775692 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1ee33-f26b-4802-bc10-46bee3e95b01 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:19.778148 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 235/483] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:39:19.784021 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903d8db-d5bc-4e9c-aa4e-88c02376ae30 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:19.784297 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903d8db-d5bc-4e9c-aa4e-88c02376ae30 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:19.784714 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903d8db-d5bc-4e9c-aa4e-88c02376ae30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:19.814392 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-3903d8db-d5bc-4e9c-aa4e-88c02376ae30 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:19.816521 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-3903d8db-d5bc-4e9c-aa4e-88c02376ae30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:19.932136 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354c575-eb6b-410a-86e0-b5182329cb0a None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:19.959531 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 236/484] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:19.987681 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a96ade-b601-4c08-9b33-67f4fa37937c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:19.988337 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a96ade-b601-4c08-9b33-67f4fa37937c None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:19.988766 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a96ade-b601-4c08-9b33-67f4fa37937c None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:19.989044 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a96ade-b601-4c08-9b33-67f4fa37937c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:20.002452 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903d8db-d5bc-4e9c-aa4e-88c02376ae30 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:20.019173 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a96ade-b601-4c08-9b33-67f4fa37937c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:20.023836 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:20.024820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-c9a96ade-b601-4c08-9b33-67f4fa37937c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:20.024820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:20.024820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:20.024820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:20.024820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:20.024820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:20.024820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:20.024820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:20.024820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:20.024820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:20.024820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:20.024820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:20.024820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:20.024820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:20.024820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:20.024820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:20.025686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:20.025686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:20.025686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:20.025686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:20.025686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:20.025686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:20.025686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:20.025686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:20.025686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:20.025686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:20.025686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:20.025686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:20.025686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:20.025686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:20.025686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:20.025686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:20.032629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:20.032629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:20.032629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:20.032629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:20.032629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:20.032629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:20.032629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:20.032629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:20.032629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:20.032629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:20.032629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:20.032629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:20.032629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 249/485] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 04:39:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:20.038074 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a96ade-b601-4c08-9b33-67f4fa37937c None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:20.082436 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:20.116753 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903d8db-d5bc-4e9c-aa4e-88c02376ae30 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:20.159123 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fa781-0288-4f64-b1c9-77e539db5128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:20.159793 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fa781-0288-4f64-b1c9-77e539db5128 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:20.160076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fa781-0288-4f64-b1c9-77e539db5128 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:20.160383 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fa781-0288-4f64-b1c9-77e539db5128 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:20.177235 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702fa781-0288-4f64-b1c9-77e539db5128 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:20.186079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-702fa781-0288-4f64-b1c9-77e539db5128 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:20.186079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:20.186079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:20.186079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:20.186079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:20.186079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:20.186079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:20.186079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:20.186079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:20.186079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:20.186079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:20.186079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:20.186079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:20.186079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:20.186079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:20.186079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:20.187013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:20.187013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:20.187013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:20.187013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:20.187013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:20.187013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:20.187013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:20.187013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:20.187013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:20.187013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:20.187013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:20.187013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:20.187013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:20.187013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:20.187013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:20.187013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:20.187813 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:20.187813 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:20.187813 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:20.187813 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:20.187813 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:20.187813 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:20.187813 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:20.187813 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:20.187813 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:20.187813 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:20.187813 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:20.187813 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:20.187813 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 237/486] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 04:39:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:20.195278 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fa781-0288-4f64-b1c9-77e539db5128 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:20.242008 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a96ade-b601-4c08-9b33-67f4fa37937c None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:20.277453 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17986d03-9fe0-42f3-85fc-e001de18c746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:20.278128 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17986d03-9fe0-42f3-85fc-e001de18c746 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:20.281258 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17986d03-9fe0-42f3-85fc-e001de18c746 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:20.281595 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17986d03-9fe0-42f3-85fc-e001de18c746 None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:20.282478 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17986d03-9fe0-42f3-85fc-e001de18c746 None admin] RBAC: Adding query filter params (name=service) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:20.282796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17986d03-9fe0-42f3-85fc-e001de18c746 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:20.284307 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17986d03-9fe0-42f3-85fc-e001de18c746 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:20.293712 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 250/487] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 04:39:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:39:20.299195 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17986d03-9fe0-42f3-85fc-e001de18c746 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:20.395628 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:20.397176 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:20.422377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17986d03-9fe0-42f3-85fc-e001de18c746 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:20.423109 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fa781-0288-4f64-b1c9-77e539db5128 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:20.465194 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97a953-b730-49e9-89f5-3c8936ffae4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:20.465194 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97a953-b730-49e9-89f5-3c8936ffae4f None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:20.465194 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97a953-b730-49e9-89f5-3c8936ffae4f None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:20.465194 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97a953-b730-49e9-89f5-3c8936ffae4f None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:20.465808 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab97a953-b730-49e9-89f5-3c8936ffae4f None admin] RBAC: Adding query filter params (name=service) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:20.465808 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab97a953-b730-49e9-89f5-3c8936ffae4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:20.465808 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab97a953-b730-49e9-89f5-3c8936ffae4f None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:20.475721 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 238/488] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 04:39:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:20.476542 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5024a-75dd-43be-ae87-03385a29dbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:20.477125 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3df85-d119-4eee-8a05-d640e86903a5 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:20.477495 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3df85-d119-4eee-8a05-d640e86903a5 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:20.477793 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5024a-75dd-43be-ae87-03385a29dbb9 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:20.477892 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d3df85-d119-4eee-8a05-d640e86903a5 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:20.478342 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5024a-75dd-43be-ae87-03385a29dbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:20.478837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5024a-75dd-43be-ae87-03385a29dbb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:20.483737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 239/489] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:20.483737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3df85-d119-4eee-8a05-d640e86903a5 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:20.505621 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f5024a-75dd-43be-ae87-03385a29dbb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:20.507506 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f5024a-75dd-43be-ae87-03385a29dbb9 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:20.523101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-76f5024a-75dd-43be-ae87-03385a29dbb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:20.523101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:20.523101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:20.523101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:20.523101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:20.523101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:20.523101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:20.523101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:20.523101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:20.523101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:20.523101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:20.523101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:20.523101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:20.523101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:20.523101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:20.524006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:20.524006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:20.524006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:20.524006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:20.524006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:20.524006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:20.524006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:20.524006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:20.524006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:20.524006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:20.524006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:20.524006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:20.524006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:20.524006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:20.524006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:20.524006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:20.524006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:20.524856 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:20.524856 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:20.524856 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:20.524856 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:20.531068 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 251/490] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:20.532733 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac1cc3-70e3-4e87-8fe4-92eae3e3f8c1 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:20.533042 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac1cc3-70e3-4e87-8fe4-92eae3e3f8c1 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:20.533321 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac1cc3-70e3-4e87-8fe4-92eae3e3f8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:20.557422 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-3dac1cc3-70e3-4e87-8fe4-92eae3e3f8c1 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:20.558953 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-3dac1cc3-70e3-4e87-8fe4-92eae3e3f8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:20.615919 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d3df85-d119-4eee-8a05-d640e86903a5 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:20.658002 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 252/491] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:20.658002 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac1cc3-70e3-4e87-8fe4-92eae3e3f8c1 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:20.671806 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8ea9c-14bb-4545-be91-ec67a9565043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:20.672473 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8ea9c-14bb-4545-be91-ec67a9565043 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:20.672752 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8ea9c-14bb-4545-be91-ec67a9565043 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:20.673023 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8ea9c-14bb-4545-be91-ec67a9565043 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:20.685035 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:20.690389 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc8ea9c-14bb-4545-be91-ec67a9565043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:20.692828 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc8ea9c-14bb-4545-be91-ec67a9565043 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:20.708745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-1bc8ea9c-14bb-4545-be91-ec67a9565043 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:20.708745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:20.708745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:20.708745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:20.708745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:20.708745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:20.708745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:20.708745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:20.708745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:20.708745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:20.708745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:20.708745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:20.708745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:20.708745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:20.708745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:20.709725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:20.709725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:20.709725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:20.709725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:20.709725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:20.709725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:20.709725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:20.709725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:20.709725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:20.709725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:20.709725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:20.709725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:20.709725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:20.709725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:20.709725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:20.709725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:20.709725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:20.710596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:20.710596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:20.710596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:20.710596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:20.710596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 240/492] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:20.711306 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8ea9c-14bb-4545-be91-ec67a9565043 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:20.751379 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:20.794990 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac1cc3-70e3-4e87-8fe4-92eae3e3f8c1 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:20.829537 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8ea9c-14bb-4545-be91-ec67a9565043 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:20.841890 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53823ced-6e5b-4f78-81b8-70fde987ea53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:20.842786 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53823ced-6e5b-4f78-81b8-70fde987ea53 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:20.843215 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53823ced-6e5b-4f78-81b8-70fde987ea53 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:20.843631 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53823ced-6e5b-4f78-81b8-70fde987ea53 None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:20.844488 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53823ced-6e5b-4f78-81b8-70fde987ea53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:20.844942 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53823ced-6e5b-4f78-81b8-70fde987ea53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:20.846362 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53823ced-6e5b-4f78-81b8-70fde987ea53 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:20.862033 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 253/493] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:20.862033 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53823ced-6e5b-4f78-81b8-70fde987ea53 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:20.870257 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b04dd5-ca6a-45e5-9418-9a3a4c4d8102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:20.870921 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b04dd5-ca6a-45e5-9418-9a3a4c4d8102 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:20.871465 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b04dd5-ca6a-45e5-9418-9a3a4c4d8102 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:20.871465 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b04dd5-ca6a-45e5-9418-9a3a4c4d8102 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:20.883133 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b04dd5-ca6a-45e5-9418-9a3a4c4d8102 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:20.888542 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-a5b04dd5-ca6a-45e5-9418-9a3a4c4d8102 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:20.888542 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:20.888542 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:20.888542 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:20.888542 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:20.888542 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:20.888542 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:20.888542 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:20.888542 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:20.888542 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:20.888542 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:20.888542 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:20.888542 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:20.888542 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:20.888542 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:20.888542 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:20.889447 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:20.889447 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:20.889447 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:20.889447 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:20.889447 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:20.889447 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:20.889447 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:20.889447 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:20.889447 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:20.889447 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:20.889447 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:20.889447 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:20.889447 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:20.889447 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:20.889447 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:20.889447 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:20.890784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:20.890784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:20.890784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:20.890784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:20.890784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:20.890784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:20.890784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:20.890784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:20.890784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:20.890784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:20.890784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:20.890784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:20.890784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 241/494] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 04:39:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:20.891442 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1d3f6-ba3e-4ce4-b0c3-41a0484e3efd None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:20.891442 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1d3f6-ba3e-4ce4-b0c3-41a0484e3efd None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:20.891804 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1d3f6-ba3e-4ce4-b0c3-41a0484e3efd None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:20.892988 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 242/495] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:20.897845 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1d3f6-ba3e-4ce4-b0c3-41a0484e3efd None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:20.953426 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:20.970003 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53823ced-6e5b-4f78-81b8-70fde987ea53 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:20.998189 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:21.009914 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77734eca-e63c-4ac8-966a-6436ca51389c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:21.010498 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77734eca-e63c-4ac8-966a-6436ca51389c None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:21.010855 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77734eca-e63c-4ac8-966a-6436ca51389c None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:21.011132 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77734eca-e63c-4ac8-966a-6436ca51389c None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:21.011463 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1d3f6-ba3e-4ce4-b0c3-41a0484e3efd None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:21.011825 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77734eca-e63c-4ac8-966a-6436ca51389c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:21.012122 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77734eca-e63c-4ac8-966a-6436ca51389c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:21.014489 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77734eca-e63c-4ac8-966a-6436ca51389c None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:21.028042 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 254/496] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:21.028882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77734eca-e63c-4ac8-966a-6436ca51389c None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:21.053965 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc72e7-e171-4c92-8f87-8c835ea1b137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:21.054657 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc72e7-e171-4c92-8f87-8c835ea1b137 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:21.054942 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc72e7-e171-4c92-8f87-8c835ea1b137 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:21.055219 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc72e7-e171-4c92-8f87-8c835ea1b137 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:21.063642 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc72e7-e171-4c92-8f87-8c835ea1b137 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:21.065161 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc72e7-e171-4c92-8f87-8c835ea1b137 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:21.078466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-a7fc72e7-e171-4c92-8f87-8c835ea1b137 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 04:39:21.078466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:21.078466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:21.078466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:21.078466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:21.078466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:21.078466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:21.078466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:21.078466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:21.078466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:21.078466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:21.078466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:21.078466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:39:21.078466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:39:21.078466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:39:21.078466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:39:21.079416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:21.079416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:21.079416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:39:21.079416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:21.079416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:39:21.079416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:21.079416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:21.079416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:21.079416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:21.079416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:21.079416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:21.079416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:21.079416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:21.079416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:21.079416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:21.079416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:21.079416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:21.079416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:21.080297 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:21.080297 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:21.080297 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:39:21.080297 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:39:21.080297 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:39:21.080297 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:39:21.080297 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:39:21.080297 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:39:21.080297 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 04:39:21.080297 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:21.080297 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 243/497] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:39:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:21.080851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fd8db-1b25-4f22-a693-a6e912f863eb None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:21.081406 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fd8db-1b25-4f22-a693-a6e912f863eb None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:21.081406 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fd8db-1b25-4f22-a693-a6e912f863eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:21.100609 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-f34fd8db-1b25-4f22-a693-a6e912f863eb None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:21.101815 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-f34fd8db-1b25-4f22-a693-a6e912f863eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:21.143051 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77734eca-e63c-4ac8-966a-6436ca51389c None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:21.170983 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 244/498] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:21.171835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34fd8db-1b25-4f22-a693-a6e912f863eb None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:21.185621 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2d31e-f287-4fed-8434-df921fb57ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:21.186273 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2d31e-f287-4fed-8434-df921fb57ef3 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:21.186536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2d31e-f287-4fed-8434-df921fb57ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:21.186816 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c2d31e-f287-4fed-8434-df921fb57ef3 None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:21.187515 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2d31e-f287-4fed-8434-df921fb57ef3 None admin] RBAC: Adding query filter params (name=service) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:21.187817 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2d31e-f287-4fed-8434-df921fb57ef3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:21.189249 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c2d31e-f287-4fed-8434-df921fb57ef3 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:21.198406 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 255/499] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 04:39:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:21.199226 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2d31e-f287-4fed-8434-df921fb57ef3 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:21.223285 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:21.247083 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:21.284095 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34fd8db-1b25-4f22-a693-a6e912f863eb None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:21.302834 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c2d31e-f287-4fed-8434-df921fb57ef3 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:21.320576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f8cf4-d681-44a9-a4d2-d40e5f8c2b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:21.321242 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f8cf4-d681-44a9-a4d2-d40e5f8c2b70 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:21.321522 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f8cf4-d681-44a9-a4d2-d40e5f8c2b70 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:21.321790 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f8cf4-d681-44a9-a4d2-d40e5f8c2b70 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:21.330392 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f8cf4-d681-44a9-a4d2-d40e5f8c2b70 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:21.331909 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f8cf4-d681-44a9-a4d2-d40e5f8c2b70 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:21.338659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a8d97-876a-4714-8e47-2643e01fbc87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:21.339281 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a8d97-876a-4714-8e47-2643e01fbc87 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:21.339558 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a8d97-876a-4714-8e47-2643e01fbc87 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:21.339826 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a8d97-876a-4714-8e47-2643e01fbc87 None admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:21.340628 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a8d97-876a-4714-8e47-2643e01fbc87 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:21.340937 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a8d97-876a-4714-8e47-2643e01fbc87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:21.342411 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60a8d97-876a-4714-8e47-2643e01fbc87 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:21.344301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-f41f8cf4-d681-44a9-a4d2-d40e5f8c2b70 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 04:39:21.344301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:21.344301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:21.344301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:21.344301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:21.344301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:21.344301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:21.344301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:21.344301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:21.344301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:21.344301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:21.344301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:21.344301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:39:21.344301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:39:21.344301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:39:21.344301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:39:21.345144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:21.345144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:21.345144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:39:21.345144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:21.345144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:39:21.345144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:21.345144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:21.345144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:21.345144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:21.345144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:21.345144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:21.345144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:21.345144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:21.345144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:21.345144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:21.345144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:21.345144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:21.345144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:21.346057 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:21.346057 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:21.346057 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:39:21.346057 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:39:21.346057 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:39:21.346057 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:39:21.346057 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:39:21.346057 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:39:21.346057 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 04:39:21.346057 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:21.346057 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 245/500] 10.222.0.39 () {56 vars in 1093 bytes} [Tue Jul 26 04:39:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:21.346712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1756f90-f56f-48f7-a095-9092e16efe47 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:21.347095 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1756f90-f56f-48f7-a095-9092e16efe47 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:21.347181 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1756f90-f56f-48f7-a095-9092e16efe47 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:21.352501 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 246/501] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:21.353145 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1756f90-f56f-48f7-a095-9092e16efe47 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:21.379231 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 256/502] 10.222.0.39 () {56 vars in 1137 bytes} [Tue Jul 26 04:39:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:21.380010 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a8d97-876a-4714-8e47-2643e01fbc87 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:21.455260 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:21.459435 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1756f90-f56f-48f7-a095-9092e16efe47 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:21.480755 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a8d97-876a-4714-8e47-2643e01fbc87 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:21.488097 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:21.494147 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ba179-6f19-41bb-94bc-c879c9184327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:21.494796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ba179-6f19-41bb-94bc-c879c9184327 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:21.495075 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ba179-6f19-41bb-94bc-c879c9184327 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:21.495351 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ba179-6f19-41bb-94bc-c879c9184327 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:21.505345 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ba179-6f19-41bb-94bc-c879c9184327 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:21.511499 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-c07ba179-6f19-41bb-94bc-c879c9184327 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:21.511499 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:21.511499 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:21.511499 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:21.511499 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:21.511499 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:21.511499 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:21.511499 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:21.511499 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:21.511499 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:21.511499 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:21.511499 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:21.511499 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:21.511499 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:21.511499 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:21.511499 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:21.512397 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:21.512397 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:21.512397 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:21.512397 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:21.512397 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:21.512397 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:21.512397 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:21.512397 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:21.512397 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:21.512397 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:21.512397 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:21.512397 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:21.512397 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:21.512397 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:21.512397 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:21.512397 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:21.513208 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:21.513208 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:21.513208 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:21.513208 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:21.513208 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:21.513208 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:21.513208 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:21.513208 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:21.513208 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:21.513208 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:21.513208 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:21.513208 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:21.513208 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 247/503] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 04:39:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:21.513874 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ba179-6f19-41bb-94bc-c879c9184327 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:21.520270 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe08ec-4fb4-41ad-b65f-5ee83fbb8af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:21.520916 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe08ec-4fb4-41ad-b65f-5ee83fbb8af9 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:21.521196 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe08ec-4fb4-41ad-b65f-5ee83fbb8af9 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:21.521465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe08ec-4fb4-41ad-b65f-5ee83fbb8af9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:21.531910 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe08ec-4fb4-41ad-b65f-5ee83fbb8af9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:21.533458 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe08ec-4fb4-41ad-b65f-5ee83fbb8af9 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:21.548377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-d5fe08ec-4fb4-41ad-b65f-5ee83fbb8af9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:21.548377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:21.548377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:21.548377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:21.548377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:21.548377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:21.548377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:21.548377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:21.548377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:21.548377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:21.548377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:21.548377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:21.548377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:21.548377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:21.548377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:21.549301 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:21.549301 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:21.549301 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:21.549301 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:21.549301 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:21.549301 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:21.549301 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:21.549301 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:21.549301 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:21.549301 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:21.549301 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:21.549301 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:21.549301 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:21.549301 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:21.549301 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:21.549301 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:21.549301 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:21.550442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:21.550442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:21.550442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:21.550442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:21.550442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 257/504] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:21.551172 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68517bed-ca3c-4623-a235-5566e7bdc412 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:21.551453 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68517bed-ca3c-4623-a235-5566e7bdc412 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:21.551730 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68517bed-ca3c-4623-a235-5566e7bdc412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:21.569483 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-68517bed-ca3c-4623-a235-5566e7bdc412 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:21.570725 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-68517bed-ca3c-4623-a235-5566e7bdc412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:21.618852 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ba179-6f19-41bb-94bc-c879c9184327 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:21.637056 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 258/505] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:21.638359 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68517bed-ca3c-4623-a235-5566e7bdc412 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:21.652386 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792e0a4-1c10-4a02-ac1b-54a30f6f24a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:21.653019 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792e0a4-1c10-4a02-ac1b-54a30f6f24a9 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:21.653301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792e0a4-1c10-4a02-ac1b-54a30f6f24a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:21.653579 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792e0a4-1c10-4a02-ac1b-54a30f6f24a9 None admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:21.654413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792e0a4-1c10-4a02-ac1b-54a30f6f24a9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:21.654725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792e0a4-1c10-4a02-ac1b-54a30f6f24a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:21.656171 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792e0a4-1c10-4a02-ac1b-54a30f6f24a9 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:21.693166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 248/506] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Jul 26 04:39:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:21.694083 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792e0a4-1c10-4a02-ac1b-54a30f6f24a9 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:21.714762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:21.731731 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:21.744503 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68517bed-ca3c-4623-a235-5566e7bdc412 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:21.784846 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a234dc7-d831-41aa-b85c-294fd31febff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:21.785443 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a234dc7-d831-41aa-b85c-294fd31febff None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:21.785700 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a234dc7-d831-41aa-b85c-294fd31febff None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:21.786004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a234dc7-d831-41aa-b85c-294fd31febff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:21.799968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792e0a4-1c10-4a02-ac1b-54a30f6f24a9 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:21.834939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0c0e3-0ae8-4280-8ff8-33f20e4b4542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:21.835567 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0c0e3-0ae8-4280-8ff8-33f20e4b4542 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:21.835841 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0c0e3-0ae8-4280-8ff8-33f20e4b4542 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:21.836110 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0c0e3-0ae8-4280-8ff8-33f20e4b4542 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:21.836834 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad0c0e3-0ae8-4280-8ff8-33f20e4b4542 None admin] RBAC: Adding query filter params (name=service) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:21.837136 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad0c0e3-0ae8-4280-8ff8-33f20e4b4542 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:21.838597 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad0c0e3-0ae8-4280-8ff8-33f20e4b4542 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:21.847519 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 249/507] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 04:39:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:21.848315 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0c0e3-0ae8-4280-8ff8-33f20e4b4542 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:21.859565 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a234dc7-d831-41aa-b85c-294fd31febff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:21.861058 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a234dc7-d831-41aa-b85c-294fd31febff None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:21.930500 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:21.946710 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:21.950589 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0c0e3-0ae8-4280-8ff8-33f20e4b4542 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:21.960487 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 259/508] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:39:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:21.961333 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a234dc7-d831-41aa-b85c-294fd31febff None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:21.984936 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5470bd-36c5-4690-b077-daadf7f7b417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:21.985558 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5470bd-36c5-4690-b077-daadf7f7b417 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:21.985835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5470bd-36c5-4690-b077-daadf7f7b417 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:21.986108 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5470bd-36c5-4690-b077-daadf7f7b417 None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:21.986789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5470bd-36c5-4690-b077-daadf7f7b417 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:21.987088 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5470bd-36c5-4690-b077-daadf7f7b417 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:21.988545 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5470bd-36c5-4690-b077-daadf7f7b417 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:22.000186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 250/509] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:22.000995 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5470bd-36c5-4690-b077-daadf7f7b417 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:22.065138 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a234dc7-d831-41aa-b85c-294fd31febff None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:22.097450 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517d8d5-1ac3-42e5-826f-cb8e718425ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:22.098139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517d8d5-1ac3-42e5-826f-cb8e718425ac None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:22.098417 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517d8d5-1ac3-42e5-826f-cb8e718425ac None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:22.098682 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517d8d5-1ac3-42e5-826f-cb8e718425ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:22.099206 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5470bd-36c5-4690-b077-daadf7f7b417 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:22.108879 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517d8d5-1ac3-42e5-826f-cb8e718425ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:22.110375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517d8d5-1ac3-42e5-826f-cb8e718425ac None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:22.124563 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-e517d8d5-1ac3-42e5-826f-cb8e718425ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:22.124563 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:22.124563 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:22.124563 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:22.124563 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:22.124563 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:22.124563 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:22.124563 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:22.124563 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:22.124563 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:22.124563 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:22.124563 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:22.124563 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:22.124563 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:22.124563 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:22.125432 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:22.125432 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:22.125432 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:22.125432 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:22.125432 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:22.125432 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:22.125432 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:22.125432 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:22.125432 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:22.125432 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:22.125432 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:22.125432 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:22.125432 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:22.125432 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:22.125432 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:22.125432 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:22.125432 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:22.126340 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:22.126340 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:22.126340 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:22.126340 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:22.126340 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 260/510] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:22.126600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517d8d5-1ac3-42e5-826f-cb8e718425ac None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:22.138993 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a942cdb-4f7c-496a-af09-4b461e9b78d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:22.139617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a942cdb-4f7c-496a-af09-4b461e9b78d3 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:22.139892 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a942cdb-4f7c-496a-af09-4b461e9b78d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:22.140131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a942cdb-4f7c-496a-af09-4b461e9b78d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:22.152200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:22.169972 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:22.211250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a942cdb-4f7c-496a-af09-4b461e9b78d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:22.212768 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a942cdb-4f7c-496a-af09-4b461e9b78d3 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:22.231447 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517d8d5-1ac3-42e5-826f-cb8e718425ac None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:22.263266 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170fae4-46d2-4de5-9a7b-d0cd9dfe9647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:22.266088 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170fae4-46d2-4de5-9a7b-d0cd9dfe9647 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:22.266088 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170fae4-46d2-4de5-9a7b-d0cd9dfe9647 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:22.266088 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170fae4-46d2-4de5-9a7b-d0cd9dfe9647 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:22.276096 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170fae4-46d2-4de5-9a7b-d0cd9dfe9647 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:22.277570 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170fae4-46d2-4de5-9a7b-d0cd9dfe9647 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:22.292038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-6170fae4-46d2-4de5-9a7b-d0cd9dfe9647 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:22.292038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:22.292038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:22.292038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:22.292038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:22.292038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:22.292038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:22.292038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:22.292038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:22.292038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:22.292038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:22.292038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:22.292038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:22.292038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:22.292038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:22.293100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:22.293100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:22.293100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:22.293100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:22.293100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:22.293100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:22.293100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:22.293100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:22.293100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:22.293100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:22.293100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:22.293100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:22.293100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:22.293100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:22.293100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:22.293100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:22.293100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:22.294020 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:22.294020 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:22.294020 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:22.294020 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:22.294020 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 261/511] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:22.294434 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170fae4-46d2-4de5-9a7b-d0cd9dfe9647 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:22.323564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 251/512] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:39:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:22.324318 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a942cdb-4f7c-496a-af09-4b461e9b78d3 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:22.368957 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:22.387497 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:22.397033 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170fae4-46d2-4de5-9a7b-d0cd9dfe9647 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:22.427025 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a942cdb-4f7c-496a-af09-4b461e9b78d3 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:22.429216 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49743732-e9c2-49dc-be7c-30051fbf2171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:22.429844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49743732-e9c2-49dc-be7c-30051fbf2171 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:22.430167 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49743732-e9c2-49dc-be7c-30051fbf2171 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:22.430420 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49743732-e9c2-49dc-be7c-30051fbf2171 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:22.441691 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49743732-e9c2-49dc-be7c-30051fbf2171 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:22.443238 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49743732-e9c2-49dc-be7c-30051fbf2171 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:22.457522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-49743732-e9c2-49dc-be7c-30051fbf2171 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:22.457522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:22.457522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:22.457522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:22.457522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:22.457522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:22.457522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:22.457522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:22.457522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:22.457522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:22.457522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:22.457522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:22.457522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:22.457522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:22.457522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:22.458392 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:22.458392 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:22.458392 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:22.458392 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:22.458392 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:22.458392 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:22.458392 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:22.458392 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:22.458392 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:22.458392 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:22.458392 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:22.458392 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:22.458392 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:22.458392 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:22.458392 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:22.458392 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:22.458392 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:22.459556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:22.459556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:22.459556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:22.459556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:22.459556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 262/513] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:22.459943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49743732-e9c2-49dc-be7c-30051fbf2171 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:22.465707 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328b101-ad40-4896-8f59-09ad01cdd467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:22.466401 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328b101-ad40-4896-8f59-09ad01cdd467 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:22.466683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328b101-ad40-4896-8f59-09ad01cdd467 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:22.466953 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328b101-ad40-4896-8f59-09ad01cdd467 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:22.475224 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328b101-ad40-4896-8f59-09ad01cdd467 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:22.476688 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328b101-ad40-4896-8f59-09ad01cdd467 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:22.488412 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-2328b101-ad40-4896-8f59-09ad01cdd467 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 04:39:22.488412 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:22.488412 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:22.488412 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:22.488412 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:22.488412 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:22.488412 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:22.488412 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:22.488412 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:22.488412 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:22.488412 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:22.488412 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:22.488412 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:39:22.488412 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:39:22.488412 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:39:22.488412 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:39:22.489342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:22.489342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:22.489342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:39:22.489342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:22.489342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:39:22.489342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:22.489342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:22.489342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:22.489342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:22.489342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:22.489342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:22.489342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:22.489342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:22.489342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:22.489342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:22.489342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:22.489342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:22.489342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:22.490305 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:22.490305 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:22.490305 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:39:22.490305 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:39:22.490305 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:39:22.490305 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:39:22.490305 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:39:22.490305 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:39:22.490305 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 04:39:22.490305 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:22.490305 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 252/514] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:39:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:22.490305 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328b101-ad40-4896-8f59-09ad01cdd467 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:22.561407 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49743732-e9c2-49dc-be7c-30051fbf2171 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:22.589092 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:22.591990 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328b101-ad40-4896-8f59-09ad01cdd467 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:22.596517 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a5290-fdcd-4217-9ff0-620485b55673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:22.597166 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a5290-fdcd-4217-9ff0-620485b55673 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:22.597446 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a5290-fdcd-4217-9ff0-620485b55673 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:22.597822 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a5290-fdcd-4217-9ff0-620485b55673 None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:22.598549 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a5290-fdcd-4217-9ff0-620485b55673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:22.598853 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a5290-fdcd-4217-9ff0-620485b55673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:22.600278 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a5290-fdcd-4217-9ff0-620485b55673 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:22.613095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 263/515] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:22.614032 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a5290-fdcd-4217-9ff0-620485b55673 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:22.619608 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:22.630000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e7c96-472b-4a24-a04c-63f1079ad352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:22.630654 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e7c96-472b-4a24-a04c-63f1079ad352 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:22.630950 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e7c96-472b-4a24-a04c-63f1079ad352 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:22.631201 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e7c96-472b-4a24-a04c-63f1079ad352 None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:22.631894 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e7c96-472b-4a24-a04c-63f1079ad352 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:22.632190 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e7c96-472b-4a24-a04c-63f1079ad352 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:22.633577 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e7c96-472b-4a24-a04c-63f1079ad352 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:22.645838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 253/516] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:22.646683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e7c96-472b-4a24-a04c-63f1079ad352 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:22.717561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a5290-fdcd-4217-9ff0-620485b55673 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:22.743743 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e7c96-472b-4a24-a04c-63f1079ad352 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:22.750585 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40d803-c40c-408a-b16a-f09a142545a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:22.751224 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40d803-c40c-408a-b16a-f09a142545a5 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:22.751503 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40d803-c40c-408a-b16a-f09a142545a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:22.751770 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40d803-c40c-408a-b16a-f09a142545a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:22.761676 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40d803-c40c-408a-b16a-f09a142545a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:22.763171 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40d803-c40c-408a-b16a-f09a142545a5 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:22.777866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-9c40d803-c40c-408a-b16a-f09a142545a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:22.777866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:22.777866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:22.777866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:22.777866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:22.777866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:22.777866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:22.777866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:22.777866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:22.777866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:22.777866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:22.777866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:22.777866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:22.777866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:22.777866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:22.778933 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:22.778933 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:22.778933 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:22.778933 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:22.778933 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:22.778933 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:22.778933 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:22.778933 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:22.778933 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:22.778933 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:22.778933 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:22.778933 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:22.778933 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:22.778933 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:22.778933 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:22.778933 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:22.778933 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:22.779969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:22.779969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:22.779969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:22.779969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:22.779969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 264/517] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:22.779969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40d803-c40c-408a-b16a-f09a142545a5 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:22.781122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33016d7c-4e7f-4608-9d29-dff0732c9ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:22.781856 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33016d7c-4e7f-4608-9d29-dff0732c9ab5 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:22.782222 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33016d7c-4e7f-4608-9d29-dff0732c9ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:22.782561 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33016d7c-4e7f-4608-9d29-dff0732c9ab5 None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:22.783327 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33016d7c-4e7f-4608-9d29-dff0732c9ab5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:22.783685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33016d7c-4e7f-4608-9d29-dff0732c9ab5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:22.785225 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33016d7c-4e7f-4608-9d29-dff0732c9ab5 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:22.797307 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 254/518] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:22.798131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33016d7c-4e7f-4608-9d29-dff0732c9ab5 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:22.824388 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:22.836376 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:22.883632 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40d803-c40c-408a-b16a-f09a142545a5 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:22.909774 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33016d7c-4e7f-4608-9d29-dff0732c9ab5 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:22.916805 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f54359-7d1b-427e-a152-a8d2576585ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:22.917419 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f54359-7d1b-427e-a152-a8d2576585ee None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:22.917700 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f54359-7d1b-427e-a152-a8d2576585ee None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:22.918058 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f54359-7d1b-427e-a152-a8d2576585ee None admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:22.918820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f54359-7d1b-427e-a152-a8d2576585ee None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:22.919129 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f54359-7d1b-427e-a152-a8d2576585ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:22.920586 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f54359-7d1b-427e-a152-a8d2576585ee None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:22.937907 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 265/519] 10.222.0.39 () {56 vars in 1137 bytes} [Tue Jul 26 04:39:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:22.937907 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f54359-7d1b-427e-a152-a8d2576585ee None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:22.948188 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db4b7b-6e45-4f61-8e2c-73b27d41d5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:22.948821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db4b7b-6e45-4f61-8e2c-73b27d41d5e1 None admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:22.949101 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db4b7b-6e45-4f61-8e2c-73b27d41d5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:22.949378 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db4b7b-6e45-4f61-8e2c-73b27d41d5e1 None admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:22.950222 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db4b7b-6e45-4f61-8e2c-73b27d41d5e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:22.951686 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db4b7b-6e45-4f61-8e2c-73b27d41d5e1 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:22.974154 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 255/520] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 04:39:22 2022] POST /identity/v3/users => generated 247 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:39:22.974989 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db4b7b-6e45-4f61-8e2c-73b27d41d5e1 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:23.057994 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f54359-7d1b-427e-a152-a8d2576585ee None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:23.067412 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:23.074722 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:23.097626 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db4b7b-6e45-4f61-8e2c-73b27d41d5e1 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:23.098243 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55541cbb-6d49-4a08-be1d-bdefa590bd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:23.098918 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55541cbb-6d49-4a08-be1d-bdefa590bd73 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:23.099199 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55541cbb-6d49-4a08-be1d-bdefa590bd73 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:23.099474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55541cbb-6d49-4a08-be1d-bdefa590bd73 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:23.107790 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55541cbb-6d49-4a08-be1d-bdefa590bd73 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:23.109427 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55541cbb-6d49-4a08-be1d-bdefa590bd73 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:23.124966 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-55541cbb-6d49-4a08-be1d-bdefa590bd73 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 04:39:23.124966 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:23.124966 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:23.124966 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:23.124966 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:23.124966 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:23.124966 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:23.124966 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:23.124966 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:23.124966 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:23.124966 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:23.124966 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:23.124966 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:39:23.124966 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:39:23.124966 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:39:23.124966 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:39:23.125943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:23.125943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:23.125943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:39:23.125943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:23.125943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:39:23.125943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:23.125943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:23.125943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:23.125943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:23.125943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:23.125943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:23.125943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:23.125943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:23.125943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:23.125943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:23.125943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:23.125943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:23.125943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:23.126865 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:23.126865 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:23.126865 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:39:23.126865 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:39:23.126865 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:39:23.126865 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:39:23.126865 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:39:23.126865 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:39:23.126865 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 04:39:23.126865 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:23.126865 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 266/521] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 04:39:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:23.127422 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55541cbb-6d49-4a08-be1d-bdefa590bd73 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:23.148038 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5f97e-a4be-461b-a457-6f9194e6d308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:23.148791 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5f97e-a4be-461b-a457-6f9194e6d308 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:23.149075 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5f97e-a4be-461b-a457-6f9194e6d308 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:23.149342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f5f97e-a4be-461b-a457-6f9194e6d308 None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:23.150117 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f5f97e-a4be-461b-a457-6f9194e6d308 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:23.150421 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f5f97e-a4be-461b-a457-6f9194e6d308 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:23.151829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f5f97e-a4be-461b-a457-6f9194e6d308 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:23.164364 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 256/522] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:23.165021 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5f97e-a4be-461b-a457-6f9194e6d308 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:23.244429 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55541cbb-6d49-4a08-be1d-bdefa590bd73 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:23.275879 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f5f97e-a4be-461b-a457-6f9194e6d308 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:23.287830 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dd83c-95c0-4352-85e5-f5047d4e7d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:23.288499 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dd83c-95c0-4352-85e5-f5047d4e7d69 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:23.288896 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dd83c-95c0-4352-85e5-f5047d4e7d69 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:23.289169 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67dd83c-95c0-4352-85e5-f5047d4e7d69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:23.297158 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67dd83c-95c0-4352-85e5-f5047d4e7d69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:23.298825 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67dd83c-95c0-4352-85e5-f5047d4e7d69 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:23.312759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-c67dd83c-95c0-4352-85e5-f5047d4e7d69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:23.312759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:23.312759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:23.312759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:23.312759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:23.312759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:23.312759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:23.312759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:23.312759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:23.312759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:23.312759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:23.312759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:23.312759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:39:23.312759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:39:23.312759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:39:23.313837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:39:23.313837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:23.313837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:23.313837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:23.313837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:23.313837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:23.313837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:23.313837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:23.313837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:23.313837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:23.313837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:23.313837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:23.313837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:23.313837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:23.313837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:23.313837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:23.313837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:23.314725 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:39:23.314725 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:39:23.314725 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:39:23.314725 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:39:23.314725 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:39:23.314725 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:39:23.314725 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:23.314725 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:23.314725 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 267/523] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:23.315234 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dd83c-95c0-4352-85e5-f5047d4e7d69 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:23.323081 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61261821-3f32-49fa-a5d0-ec228735f532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:23.323734 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61261821-3f32-49fa-a5d0-ec228735f532 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:23.324024 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61261821-3f32-49fa-a5d0-ec228735f532 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:23.324299 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61261821-3f32-49fa-a5d0-ec228735f532 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:23.328386 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:23.355572 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:23.408125 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61261821-3f32-49fa-a5d0-ec228735f532 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:23.409776 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61261821-3f32-49fa-a5d0-ec228735f532 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:23.436044 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67dd83c-95c0-4352-85e5-f5047d4e7d69 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:23.477289 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8b314-f4db-467f-9744-db2f45e6fd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:23.477934 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8b314-f4db-467f-9744-db2f45e6fd9c None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:23.478241 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8b314-f4db-467f-9744-db2f45e6fd9c None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:23.478507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8b314-f4db-467f-9744-db2f45e6fd9c None admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:23.479315 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8b314-f4db-467f-9744-db2f45e6fd9c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:23.479615 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8b314-f4db-467f-9744-db2f45e6fd9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:23.481292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8b314-f4db-467f-9744-db2f45e6fd9c None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:23.506191 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 268/524] 10.222.0.39 () {56 vars in 1139 bytes} [Tue Jul 26 04:39:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:23.506971 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8b314-f4db-467f-9744-db2f45e6fd9c None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:23.532418 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 257/525] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:39:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:23.532418 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61261821-3f32-49fa-a5d0-ec228735f532 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:23.571414 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:23.603142 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:23.616687 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8b314-f4db-467f-9744-db2f45e6fd9c None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:23.646857 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61261821-3f32-49fa-a5d0-ec228735f532 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:23.654530 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc1c07-2709-4f51-9c17-62f97e298b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:23.655589 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc1c07-2709-4f51-9c17-62f97e298b06 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:23.655888 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc1c07-2709-4f51-9c17-62f97e298b06 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:23.656165 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc1c07-2709-4f51-9c17-62f97e298b06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:23.664880 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc1c07-2709-4f51-9c17-62f97e298b06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:23.666378 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc1c07-2709-4f51-9c17-62f97e298b06 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:23.678311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-c8cc1c07-2709-4f51-9c17-62f97e298b06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:23.678311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:23.678311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:23.678311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:23.678311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:23.678311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:23.678311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:23.678311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:23.678311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:23.678311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:23.678311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:23.678311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:23.678311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:39:23.678311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:39:23.678311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:39:23.679176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:39:23.679176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:23.679176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:23.679176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:23.679176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:23.679176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:23.679176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:23.679176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:23.679176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:23.679176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:23.679176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:23.679176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:23.679176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:23.679176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:23.679176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:23.679176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:23.679176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:23.680033 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:39:23.680033 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:39:23.680033 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:39:23.680033 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:39:23.680033 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:39:23.680033 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:39:23.680033 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:23.680033 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:23.680033 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 269/526] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:23.680501 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc1c07-2709-4f51-9c17-62f97e298b06 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:23.688428 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e5e92-7702-44b8-8d2e-90070a8bd34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:23.689086 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e5e92-7702-44b8-8d2e-90070a8bd34e None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:23.689369 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e5e92-7702-44b8-8d2e-90070a8bd34e None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:23.690146 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e5e92-7702-44b8-8d2e-90070a8bd34e None admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:23.690928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e5e92-7702-44b8-8d2e-90070a8bd34e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:23.691261 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e5e92-7702-44b8-8d2e-90070a8bd34e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:23.693184 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e5e92-7702-44b8-8d2e-90070a8bd34e None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:23.713508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 258/527] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:39:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:23.714416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e5e92-7702-44b8-8d2e-90070a8bd34e None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:23.805026 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc1c07-2709-4f51-9c17-62f97e298b06 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:23.814787 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:23.822615 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e5e92-7702-44b8-8d2e-90070a8bd34e None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:23.840024 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc40e9-1ae1-4a0a-b64b-a49b61355e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:23.840658 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc40e9-1ae1-4a0a-b64b-a49b61355e85 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:23.840939 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc40e9-1ae1-4a0a-b64b-a49b61355e85 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:23.841210 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc40e9-1ae1-4a0a-b64b-a49b61355e85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:23.857351 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c8983-0187-46c7-bdee-e5b9c83682b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:23.858042 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c8983-0187-46c7-bdee-e5b9c83682b6 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:23.858327 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c8983-0187-46c7-bdee-e5b9c83682b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:23.858600 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c8983-0187-46c7-bdee-e5b9c83682b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:23.865054 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:23.871303 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c8983-0187-46c7-bdee-e5b9c83682b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:23.873064 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c8983-0187-46c7-bdee-e5b9c83682b6 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:23.890313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-9c1c8983-0187-46c7-bdee-e5b9c83682b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:23.890313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:23.890313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:23.890313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:23.890313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:23.890313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:23.890313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:23.890313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:23.890313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:23.890313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:23.890313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:23.890313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:23.890313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:23.890313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:23.890313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:23.891253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:23.891253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:23.891253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:23.891253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:23.891253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:23.891253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:23.891253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:23.891253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:23.891253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:23.891253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:23.891253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:23.891253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:23.891253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:23.891253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:23.891253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:23.891253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:23.891253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:23.892101 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:23.892101 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:23.892101 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:23.892101 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:23.892745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 259/528] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:23.893738 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c8983-0187-46c7-bdee-e5b9c83682b6 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:23.917582 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc40e9-1ae1-4a0a-b64b-a49b61355e85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:23.919111 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc40e9-1ae1-4a0a-b64b-a49b61355e85 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:23.997280 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c8983-0187-46c7-bdee-e5b9c83682b6 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:24.027089 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 270/529] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:39:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:24.027780 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc40e9-1ae1-4a0a-b64b-a49b61355e85 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:24.035568 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee7db4-5670-424b-9820-211ec87468b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:24.036208 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee7db4-5670-424b-9820-211ec87468b4 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:24.036490 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee7db4-5670-424b-9820-211ec87468b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:24.036762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee7db4-5670-424b-9820-211ec87468b4 None admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:24.037524 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee7db4-5670-424b-9820-211ec87468b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:24.037830 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee7db4-5670-424b-9820-211ec87468b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:24.039342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee7db4-5670-424b-9820-211ec87468b4 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:24.052197 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 260/530] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:39:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:24.052964 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee7db4-5670-424b-9820-211ec87468b4 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:24.065404 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:24.091883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:24.142825 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc40e9-1ae1-4a0a-b64b-a49b61355e85 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:24.163637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee7db4-5670-424b-9820-211ec87468b4 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:24.186776 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085dd54c-1f03-42b1-a013-a06138c4497c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:24.187323 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dd54c-1f03-42b1-a013-a06138c4497c None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:24.187600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dd54c-1f03-42b1-a013-a06138c4497c None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:24.187868 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085dd54c-1f03-42b1-a013-a06138c4497c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:24.188665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085dd54c-1f03-42b1-a013-a06138c4497c None admin] RBAC: Adding query filter params (role.id=a22f1a3785a746048e38205d1996764b, scope.project.id=c4d7c29a2b144df6afa96fd6894254a4, user.id=7cfbf2c03eb740ed8b72c4825cffc341) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:24.188973 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085dd54c-1f03-42b1-a013-a06138c4497c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:24.190549 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085dd54c-1f03-42b1-a013-a06138c4497c None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:24.202022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 271/531] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:39:24 2022] GET /identity/v3/role_assignments?user.id=7cfbf2c03eb740ed8b72c4825cffc341&scope.project.id=c4d7c29a2b144df6afa96fd6894254a4&role.id=a22f1a3785a746048e38205d1996764b => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:24.202022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085dd54c-1f03-42b1-a013-a06138c4497c None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:24.231054 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589e059-5680-4d49-9748-22cf3528bfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:24.231934 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589e059-5680-4d49-9748-22cf3528bfcb None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:24.232329 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589e059-5680-4d49-9748-22cf3528bfcb None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:24.232779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589e059-5680-4d49-9748-22cf3528bfcb None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:24.233924 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589e059-5680-4d49-9748-22cf3528bfcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:24.234517 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589e059-5680-4d49-9748-22cf3528bfcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:24.236951 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589e059-5680-4d49-9748-22cf3528bfcb None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:24.251645 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 261/532] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:24.257040 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589e059-5680-4d49-9748-22cf3528bfcb None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:24.338861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085dd54c-1f03-42b1-a013-a06138c4497c None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:24.361322 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:24.370670 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:24.397783 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff940b5-5304-4273-a0b8-97f8e09d08f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:24.399529 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff940b5-5304-4273-a0b8-97f8e09d08f0 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:24.400006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff940b5-5304-4273-a0b8-97f8e09d08f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:24.400722 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff940b5-5304-4273-a0b8-97f8e09d08f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:24.417147 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff940b5-5304-4273-a0b8-97f8e09d08f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:24.419360 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff940b5-5304-4273-a0b8-97f8e09d08f0 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:24.419507 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589e059-5680-4d49-9748-22cf3528bfcb None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:24.437542 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-cff940b5-5304-4273-a0b8-97f8e09d08f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:24.437542 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:24.437542 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:24.437542 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:24.437542 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:24.437542 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:24.437542 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:24.437542 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:24.437542 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:24.437542 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:24.437542 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:24.437542 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:24.437542 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:24.437542 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:24.437542 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:24.439042 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:24.439042 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:24.439042 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:24.439042 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:24.439042 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:24.439042 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:24.439042 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:24.439042 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:24.439042 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:24.439042 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:24.439042 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:24.439042 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:24.439042 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:24.439042 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:24.439042 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:24.439042 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:24.439042 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:24.440698 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:24.440698 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:24.440698 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:24.440698 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:24.440698 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 272/533] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:24.441962 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff940b5-5304-4273-a0b8-97f8e09d08f0 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:24.471522 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d098ee-f058-4bd9-9908-12a56b8c43f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:24.472195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d098ee-f058-4bd9-9908-12a56b8c43f0 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:24.472465 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d098ee-f058-4bd9-9908-12a56b8c43f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:24.472701 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d098ee-f058-4bd9-9908-12a56b8c43f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:24.473501 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d098ee-f058-4bd9-9908-12a56b8c43f0 None admin] RBAC: Adding query filter params (role.id=a22f1a3785a746048e38205d1996764b, scope.project.id=c4d7c29a2b144df6afa96fd6894254a4, user.id=ae8593e125da4b208dd100608aa2b462) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:24.473807 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d098ee-f058-4bd9-9908-12a56b8c43f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:24.475324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d098ee-f058-4bd9-9908-12a56b8c43f0 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:24.481549 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 262/534] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:39:24 2022] GET /identity/v3/role_assignments?user.id=ae8593e125da4b208dd100608aa2b462&scope.project.id=c4d7c29a2b144df6afa96fd6894254a4&role.id=a22f1a3785a746048e38205d1996764b => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:24.482300 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d098ee-f058-4bd9-9908-12a56b8c43f0 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:24.602553 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d098ee-f058-4bd9-9908-12a56b8c43f0 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:24.630318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff940b5-5304-4273-a0b8-97f8e09d08f0 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:24.637478 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:24.649930 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138cd8c4-1451-4a4b-a3b0-c963dc635080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:24.650644 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138cd8c4-1451-4a4b-a3b0-c963dc635080 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:24.650861 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138cd8c4-1451-4a4b-a3b0-c963dc635080 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:24.651129 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138cd8c4-1451-4a4b-a3b0-c963dc635080 None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:24.651844 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138cd8c4-1451-4a4b-a3b0-c963dc635080 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:24.652146 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138cd8c4-1451-4a4b-a3b0-c963dc635080 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:24.653575 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138cd8c4-1451-4a4b-a3b0-c963dc635080 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:24.676116 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 263/535] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:24.679982 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecad46d-925c-4f70-8cf9-f94a49468a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:24.680961 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecad46d-925c-4f70-8cf9-f94a49468a42 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:24.681467 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecad46d-925c-4f70-8cf9-f94a49468a42 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:24.681965 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecad46d-925c-4f70-8cf9-f94a49468a42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:24.687374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138cd8c4-1451-4a4b-a3b0-c963dc635080 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:24.691137 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecad46d-925c-4f70-8cf9-f94a49468a42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:24.692900 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecad46d-925c-4f70-8cf9-f94a49468a42 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:24.706921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-eecad46d-925c-4f70-8cf9-f94a49468a42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:24.706921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:24.706921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:24.706921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:24.706921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:24.706921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:24.706921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:24.706921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:24.706921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:24.706921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:24.706921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:24.706921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:24.706921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:39:24.706921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:39:24.706921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:39:24.708044 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:39:24.708044 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:24.708044 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:24.708044 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:24.708044 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:24.708044 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:24.708044 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:24.708044 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:24.708044 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:24.708044 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:24.708044 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:24.708044 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:24.708044 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:24.708044 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:24.708044 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:24.708044 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:24.708044 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:24.708990 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:39:24.708990 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:39:24.708990 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:39:24.708990 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:39:24.708990 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:39:24.708990 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:39:24.708990 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:24.708990 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:24.710106 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 273/536] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:24.716004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecad46d-925c-4f70-8cf9-f94a49468a42 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:24.752306 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:24.875623 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecad46d-925c-4f70-8cf9-f94a49468a42 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:24.892930 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138cd8c4-1451-4a4b-a3b0-c963dc635080 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:24.929514 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0f9dc-66ba-4e05-9825-c2cbbc2933e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:24.929514 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0f9dc-66ba-4e05-9825-c2cbbc2933e7 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:24.929514 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0f9dc-66ba-4e05-9825-c2cbbc2933e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:24.929514 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a0f9dc-66ba-4e05-9825-c2cbbc2933e7 None admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:24.929932 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0f9dc-66ba-4e05-9825-c2cbbc2933e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:24.929932 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0f9dc-66ba-4e05-9825-c2cbbc2933e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:24.930291 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a0f9dc-66ba-4e05-9825-c2cbbc2933e7 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:24.953373 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 274/537] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:39:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:39:24.958955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0f9dc-66ba-4e05-9825-c2cbbc2933e7 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:24.975216 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7718ce-8da0-4f03-8854-a8b90b1d34fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:24.978565 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7718ce-8da0-4f03-8854-a8b90b1d34fa None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:24.979015 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7718ce-8da0-4f03-8854-a8b90b1d34fa None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:24.979468 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7718ce-8da0-4f03-8854-a8b90b1d34fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:24.996006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7718ce-8da0-4f03-8854-a8b90b1d34fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:24.999389 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7718ce-8da0-4f03-8854-a8b90b1d34fa None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:25.026690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-3f7718ce-8da0-4f03-8854-a8b90b1d34fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:25.026690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:25.026690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:25.026690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:25.026690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:25.026690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:25.026690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:25.026690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:25.026690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:25.026690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:25.026690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:25.026690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:25.026690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:39:25.026690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:39:25.026690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:39:25.027796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:39:25.027796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:25.027796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:25.027796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:25.027796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:25.027796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:25.027796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:25.027796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:25.027796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:25.027796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:25.027796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:25.027796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:25.027796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:25.027796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:25.027796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:25.027796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:25.027796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:25.028837 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:39:25.028837 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:39:25.028837 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:39:25.028837 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:39:25.028837 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:39:25.028837 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:39:25.028837 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:25.028837 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:25.032992 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 264/538] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:39:25.043012 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7718ce-8da0-4f03-8854-a8b90b1d34fa None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:25.096482 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:25.110906 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a0f9dc-66ba-4e05-9825-c2cbbc2933e7 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:25.142386 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:25.147596 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d5ad54-37be-481e-98d3-1b9c28e3d797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:25.148357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5ad54-37be-481e-98d3-1b9c28e3d797 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:25.148637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5ad54-37be-481e-98d3-1b9c28e3d797 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:25.148900 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5ad54-37be-481e-98d3-1b9c28e3d797 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:25.149701 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d5ad54-37be-481e-98d3-1b9c28e3d797 None admin] RBAC: Adding query filter params (role.id=a22f1a3785a746048e38205d1996764b, scope.project.id=c4d7c29a2b144df6afa96fd6894254a4, user.id=9bb16e4960af4c03bc274dea6bea2e1a) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:25.150126 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d5ad54-37be-481e-98d3-1b9c28e3d797 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:25.151606 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d5ad54-37be-481e-98d3-1b9c28e3d797 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:25.157945 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 275/539] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:39:24 2022] GET /identity/v3/role_assignments?user.id=9bb16e4960af4c03bc274dea6bea2e1a&scope.project.id=c4d7c29a2b144df6afa96fd6894254a4&role.id=a22f1a3785a746048e38205d1996764b => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:25.172735 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031c81a-a642-4124-8fa8-5d69b2dfdcec None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:25.173020 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031c81a-a642-4124-8fa8-5d69b2dfdcec None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:25.173297 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031c81a-a642-4124-8fa8-5d69b2dfdcec None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:25.175000 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 276/540] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:39:25.180813 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f1e88-ab2b-473b-a379-dee8282b69cf None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:25.181098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f1e88-ab2b-473b-a379-dee8282b69cf None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:25.181376 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f1e88-ab2b-473b-a379-dee8282b69cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:25.200893 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-e72f1e88-ab2b-473b-a379-dee8282b69cf None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:25.202242 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-e72f1e88-ab2b-473b-a379-dee8282b69cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:25.210921 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7718ce-8da0-4f03-8854-a8b90b1d34fa None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:25.255423 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4264ac2-a59b-46a9-8b52-a10b45150e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:25.256440 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4264ac2-a59b-46a9-8b52-a10b45150e99 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:25.256898 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4264ac2-a59b-46a9-8b52-a10b45150e99 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:25.257355 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4264ac2-a59b-46a9-8b52-a10b45150e99 None admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:25.258289 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4264ac2-a59b-46a9-8b52-a10b45150e99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:25.258727 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4264ac2-a59b-46a9-8b52-a10b45150e99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:25.260357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4264ac2-a59b-46a9-8b52-a10b45150e99 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:25.279878 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 265/541] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:39:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:25.286389 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4264ac2-a59b-46a9-8b52-a10b45150e99 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:25.349061 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 277/542] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 26 04:39:25.381320 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f1e88-ab2b-473b-a379-dee8282b69cf None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:25.456538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4264ac2-a59b-46a9-8b52-a10b45150e99 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:25.471781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:25.482969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:25.498931 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880f482-eca0-46f9-9667-4ae0a953366a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:25.499605 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880f482-eca0-46f9-9667-4ae0a953366a None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:25.499889 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880f482-eca0-46f9-9667-4ae0a953366a None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:25.500162 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880f482-eca0-46f9-9667-4ae0a953366a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:25.501057 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880f482-eca0-46f9-9667-4ae0a953366a None admin] RBAC: Adding query filter params (role.id=a22f1a3785a746048e38205d1996764b, scope.project.id=c4d7c29a2b144df6afa96fd6894254a4, user.id=74fee029d5214ce18b4b9ddc2df72a23) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:25.501367 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880f482-eca0-46f9-9667-4ae0a953366a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:25.502860 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880f482-eca0-46f9-9667-4ae0a953366a None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:25.509593 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 266/543] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:39:25 2022] GET /identity/v3/role_assignments?user.id=74fee029d5214ce18b4b9ddc2df72a23&scope.project.id=c4d7c29a2b144df6afa96fd6894254a4&role.id=a22f1a3785a746048e38205d1996764b => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:39:25.518011 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f1e88-ab2b-473b-a379-dee8282b69cf None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:25.568012 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78d8da-d26f-4842-8462-a1c5693ccd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:25.569117 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78d8da-d26f-4842-8462-a1c5693ccd4d None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:25.569609 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78d8da-d26f-4842-8462-a1c5693ccd4d None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:25.570130 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf78d8da-d26f-4842-8462-a1c5693ccd4d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:25.593365 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf78d8da-d26f-4842-8462-a1c5693ccd4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:25.598969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-bf78d8da-d26f-4842-8462-a1c5693ccd4d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:25.598969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:25.598969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:25.598969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:25.598969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:25.598969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:25.598969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:25.598969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:25.598969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:25.598969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:25.598969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:25.598969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:25.598969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:25.598969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:25.598969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:25.598969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:25.599872 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:25.599872 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:25.599872 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:25.599872 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:25.599872 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:25.599872 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:25.599872 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:25.599872 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:25.599872 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:25.599872 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:25.599872 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:25.599872 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:25.599872 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:25.599872 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:25.599872 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:25.599872 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:25.600690 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:25.600690 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:25.600690 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:25.600690 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:25.600690 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:25.600690 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:25.600690 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:25.600690 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:25.600690 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:25.600690 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:25.600690 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:25.600690 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:25.603360 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 278/544] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 04:39:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:39:25.609147 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880f482-eca0-46f9-9667-4ae0a953366a None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:25.762246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880f482-eca0-46f9-9667-4ae0a953366a None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:25.810759 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733aa61c-c09c-4362-b4be-305cc118c3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:25.811832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733aa61c-c09c-4362-b4be-305cc118c3d6 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:25.812312 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733aa61c-c09c-4362-b4be-305cc118c3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:25.812781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733aa61c-c09c-4362-b4be-305cc118c3d6 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:25.813711 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733aa61c-c09c-4362-b4be-305cc118c3d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:25.814242 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733aa61c-c09c-4362-b4be-305cc118c3d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:25.815866 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733aa61c-c09c-4362-b4be-305cc118c3d6 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:25.829798 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 267/545] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 04:39:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:25.835652 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78d8da-d26f-4842-8462-a1c5693ccd4d None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:25.970401 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf78d8da-d26f-4842-8462-a1c5693ccd4d None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:26.020623 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf82805-d00b-4248-bde5-2a3242a69389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:26.021657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf82805-d00b-4248-bde5-2a3242a69389 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:26.022160 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf82805-d00b-4248-bde5-2a3242a69389 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:26.022633 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf82805-d00b-4248-bde5-2a3242a69389 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:26.039264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf82805-d00b-4248-bde5-2a3242a69389 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:26.041078 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf82805-d00b-4248-bde5-2a3242a69389 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:26.043161 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:26.061208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-caf82805-d00b-4248-bde5-2a3242a69389 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:26.061208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:26.061208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:26.061208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:26.061208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:26.061208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:26.061208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:26.061208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:26.061208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:26.061208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:26.061208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:26.061208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:26.061208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:26.061208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:26.061208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:26.062186 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:26.062186 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:26.062186 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:26.062186 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:26.062186 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:26.062186 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:26.062186 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:26.062186 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:26.062186 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:26.062186 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:26.062186 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:26.062186 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:26.062186 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:26.062186 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:26.062186 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:26.062186 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:26.062186 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:26.063049 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:26.063049 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:26.063049 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:26.063049 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:26.064962 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 279/546] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:26.070916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733aa61c-c09c-4362-b4be-305cc118c3d6 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:26.121802 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:26.203514 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733aa61c-c09c-4362-b4be-305cc118c3d6 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:26.250112 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45c045-cc6e-4cfb-a92b-553b4547a8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:26.250753 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45c045-cc6e-4cfb-a92b-553b4547a8ed None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:26.251031 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45c045-cc6e-4cfb-a92b-553b4547a8ed None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:26.251302 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45c045-cc6e-4cfb-a92b-553b4547a8ed None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:26.252002 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45c045-cc6e-4cfb-a92b-553b4547a8ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:26.252310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45c045-cc6e-4cfb-a92b-553b4547a8ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:26.253762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45c045-cc6e-4cfb-a92b-553b4547a8ed None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:26.271759 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 268/547] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:26.277423 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf82805-d00b-4248-bde5-2a3242a69389 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:26.412117 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf82805-d00b-4248-bde5-2a3242a69389 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:26.461517 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688dbdfc-75d9-45d4-b21f-0e413f9ec03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:26.462206 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688dbdfc-75d9-45d4-b21f-0e413f9ec03c None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:26.462489 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688dbdfc-75d9-45d4-b21f-0e413f9ec03c None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:26.462763 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688dbdfc-75d9-45d4-b21f-0e413f9ec03c None admin] PATH_INFO: `/v3/users/swift` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:26.471205 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688dbdfc-75d9-45d4-b21f-0e413f9ec03c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:26.472770 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688dbdfc-75d9-45d4-b21f-0e413f9ec03c None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:26.490095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-688dbdfc-75d9-45d4-b21f-0e413f9ec03c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 04:39:26.490095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:26.490095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:26.490095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:26.490095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:26.490095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:26.490095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:26.490095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:26.490095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:26.490095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:26.490095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:26.490095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:26.490095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:39:26.490095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:39:26.490095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:39:26.490095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:39:26.491144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:26.491144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:26.491144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:39:26.491144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:26.491144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:39:26.491144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:26.491144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:26.491144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:26.491144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:26.491144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:26.491144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:26.491144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:26.491144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:26.491144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:26.491144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:26.491144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:26.491144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:26.491144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:26.492574 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:26.492574 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:26.492574 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:39:26.492574 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:39:26.492574 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:39:26.492574 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:39:26.492574 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:39:26.492574 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:39:26.492574 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 04:39:26.492574 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:26.496000 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 280/548] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:39:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:26.497388 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45c045-cc6e-4cfb-a92b-553b4547a8ed None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:26.613486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:26.618756 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45c045-cc6e-4cfb-a92b-553b4547a8ed None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:26.661863 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6aff4-1c8c-46e3-8061-c0ab67950acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:26.662527 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6aff4-1c8c-46e3-8061-c0ab67950acc None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:26.662805 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6aff4-1c8c-46e3-8061-c0ab67950acc None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:26.663073 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6aff4-1c8c-46e3-8061-c0ab67950acc None admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:26.663884 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6aff4-1c8c-46e3-8061-c0ab67950acc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:26.664212 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6aff4-1c8c-46e3-8061-c0ab67950acc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:26.665646 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6aff4-1c8c-46e3-8061-c0ab67950acc None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:26.693843 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 269/549] 10.222.0.39 () {56 vars in 1135 bytes} [Tue Jul 26 04:39:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:26.699757 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688dbdfc-75d9-45d4-b21f-0e413f9ec03c None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:26.766490 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:26.811063 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688dbdfc-75d9-45d4-b21f-0e413f9ec03c None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:26.832205 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e1cfb-4b0e-4f21-870a-facb4dff3f37 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:26.832722 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e1cfb-4b0e-4f21-870a-facb4dff3f37 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:26.832722 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4e1cfb-4b0e-4f21-870a-facb4dff3f37 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:26.834405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 270/550] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:39:26.839435 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683a3d0-dfb6-4e53-aeb8-e5f72e9fd225 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:26.839835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683a3d0-dfb6-4e53-aeb8-e5f72e9fd225 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:26.840317 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683a3d0-dfb6-4e53-aeb8-e5f72e9fd225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:26.859255 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257123a6-54c7-4a3a-947c-8862c706867f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:26.860035 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257123a6-54c7-4a3a-947c-8862c706867f None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:26.860322 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257123a6-54c7-4a3a-947c-8862c706867f None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:26.860496 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-c683a3d0-dfb6-4e53-aeb8-e5f72e9fd225 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:26.860595 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257123a6-54c7-4a3a-947c-8862c706867f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:26.861736 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-c683a3d0-dfb6-4e53-aeb8-e5f72e9fd225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:26.942026 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 271/551] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:26.963829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683a3d0-dfb6-4e53-aeb8-e5f72e9fd225 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:26.987013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257123a6-54c7-4a3a-947c-8862c706867f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:26.989935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257123a6-54c7-4a3a-947c-8862c706867f None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:27.063043 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:27.066195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:27.077690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683a3d0-dfb6-4e53-aeb8-e5f72e9fd225 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:27.113059 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 281/552] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:39:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:27.118031 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8510b-70e4-4c45-9a3d-31a900b9a10d None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:27.118031 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8510b-70e4-4c45-9a3d-31a900b9a10d None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:27.118031 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8510b-70e4-4c45-9a3d-31a900b9a10d None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:27.120362 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 282/553] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:27.120755 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2237bfc-a57e-4245-a58b-931d0bfadb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:27.121147 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8510b-70e4-4c45-9a3d-31a900b9a10d None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:27.121715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2237bfc-a57e-4245-a58b-931d0bfadb2b None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:27.122168 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2237bfc-a57e-4245-a58b-931d0bfadb2b None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:27.122581 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2237bfc-a57e-4245-a58b-931d0bfadb2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:27.135464 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2237bfc-a57e-4245-a58b-931d0bfadb2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:27.144214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-c2237bfc-a57e-4245-a58b-931d0bfadb2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:27.144214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:27.144214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:27.144214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:27.144214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:27.144214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:27.144214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:27.144214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:27.144214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:27.144214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:27.144214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:27.144214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:27.144214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:27.144214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:27.144214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:27.144214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:27.145509 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:27.145509 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:27.145509 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:27.145509 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:27.145509 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:27.145509 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:27.145509 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:27.145509 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:27.145509 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:27.145509 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:27.145509 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:27.145509 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:27.145509 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:27.145509 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:27.145509 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:27.145509 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:27.146712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:27.146712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:27.146712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:27.146712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:27.146712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:27.146712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:27.146712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:27.146712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:27.146712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:27.146712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:27.146712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:27.146712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:27.147368 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 272/554] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 04:39:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:27.148562 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789f3ae-12ed-4337-aa36-f63848ef82a6 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:27.148801 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789f3ae-12ed-4337-aa36-f63848ef82a6 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:27.149077 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789f3ae-12ed-4337-aa36-f63848ef82a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:27.169387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-8789f3ae-12ed-4337-aa36-f63848ef82a6 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:27.171087 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-8789f3ae-12ed-4337-aa36-f63848ef82a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:27.236989 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8510b-70e4-4c45-9a3d-31a900b9a10d None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:27.290325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 273/555] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:27.291585 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789f3ae-12ed-4337-aa36-f63848ef82a6 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:27.308315 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c31bf4-fedd-4c78-bd16-64bdf3b1a224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:27.308992 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c31bf4-fedd-4c78-bd16-64bdf3b1a224 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:27.309272 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c31bf4-fedd-4c78-bd16-64bdf3b1a224 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:27.309539 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c31bf4-fedd-4c78-bd16-64bdf3b1a224 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:27.321279 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c31bf4-fedd-4c78-bd16-64bdf3b1a224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:27.323134 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c31bf4-fedd-4c78-bd16-64bdf3b1a224 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:27.339311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-d3c31bf4-fedd-4c78-bd16-64bdf3b1a224 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:27.339311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:27.339311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:27.339311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:27.339311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:27.339311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:27.339311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:27.339311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:27.339311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:27.339311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:27.339311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:27.339311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:27.339311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:27.339311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:27.339311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:27.340331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:27.340331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:27.340331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:27.340331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:27.340331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:27.340331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:27.340331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:27.340331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:27.340331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:27.340331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:27.340331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:27.340331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:27.340331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:27.340331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:27.340331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:27.340331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:27.340331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:27.341207 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:27.341207 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:27.341207 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:27.341207 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:27.345509 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 283/556] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:27.346439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c31bf4-fedd-4c78-bd16-64bdf3b1a224 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:27.356349 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:27.396947 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:27.428353 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789f3ae-12ed-4337-aa36-f63848ef82a6 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:27.462617 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c31bf4-fedd-4c78-bd16-64bdf3b1a224 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:27.479559 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a81d4-a1d0-4686-a730-09a77bbed7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:27.480742 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a81d4-a1d0-4686-a730-09a77bbed7a8 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:27.481600 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a81d4-a1d0-4686-a730-09a77bbed7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:27.482123 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a81d4-a1d0-4686-a730-09a77bbed7a8 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:27.483051 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a81d4-a1d0-4686-a730-09a77bbed7a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:27.483542 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a81d4-a1d0-4686-a730-09a77bbed7a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:27.485676 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8a81d4-a1d0-4686-a730-09a77bbed7a8 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:27.498688 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 274/557] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 04:39:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:27.500003 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a81d4-a1d0-4686-a730-09a77bbed7a8 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:27.500322 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a97fe-c2bc-457a-bd4b-cccb23a00b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:27.501052 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a97fe-c2bc-457a-bd4b-cccb23a00b05 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:27.501409 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a97fe-c2bc-457a-bd4b-cccb23a00b05 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:27.501808 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9a97fe-c2bc-457a-bd4b-cccb23a00b05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:27.514020 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9a97fe-c2bc-457a-bd4b-cccb23a00b05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:27.520373 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-6d9a97fe-c2bc-457a-bd4b-cccb23a00b05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:27.520373 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:27.520373 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:27.520373 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:27.520373 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:27.520373 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:27.520373 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:27.520373 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:27.520373 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:27.520373 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:27.520373 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:27.520373 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:27.520373 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:27.520373 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:27.520373 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:27.520373 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:27.521844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:27.521844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:27.521844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:27.521844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:27.521844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:27.521844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:27.521844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:27.521844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:27.521844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:27.521844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:27.521844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:27.521844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:27.521844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:27.521844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:27.521844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:27.521844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:27.523043 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:27.523043 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:27.523043 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:27.523043 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:27.523043 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:27.523043 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:27.523043 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:27.523043 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:27.523043 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:27.523043 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:27.523043 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:27.523043 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:27.526665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 284/558] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 04:39:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:27.527761 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a97fe-c2bc-457a-bd4b-cccb23a00b05 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:27.609835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:27.627298 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8a81d4-a1d0-4686-a730-09a77bbed7a8 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:27.649153 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9a97fe-c2bc-457a-bd4b-cccb23a00b05 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:27.662403 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28a98f-255c-416c-9416-42f397dcd1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:27.663044 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28a98f-255c-416c-9416-42f397dcd1be None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:27.663324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28a98f-255c-416c-9416-42f397dcd1be None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:27.663604 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28a98f-255c-416c-9416-42f397dcd1be None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:27.664292 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f28a98f-255c-416c-9416-42f397dcd1be None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:27.664598 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f28a98f-255c-416c-9416-42f397dcd1be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:27.666011 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f28a98f-255c-416c-9416-42f397dcd1be None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:27.673194 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:27.684424 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 275/559] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:27.685571 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28a98f-255c-416c-9416-42f397dcd1be None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:27.685701 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38aa141-6700-4d43-85ee-a4629377f4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:27.686260 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38aa141-6700-4d43-85ee-a4629377f4a0 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:27.686537 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38aa141-6700-4d43-85ee-a4629377f4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:27.686806 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38aa141-6700-4d43-85ee-a4629377f4a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:27.700734 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38aa141-6700-4d43-85ee-a4629377f4a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:27.703503 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38aa141-6700-4d43-85ee-a4629377f4a0 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:27.721999 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-f38aa141-6700-4d43-85ee-a4629377f4a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:27.721999 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:27.721999 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:27.721999 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:27.721999 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:27.721999 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:27.721999 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:27.721999 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:27.721999 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:27.721999 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:27.721999 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:27.721999 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:27.721999 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:27.721999 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:27.721999 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:27.722996 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:27.722996 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:27.722996 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:27.722996 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:27.722996 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:27.722996 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:27.722996 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:27.722996 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:27.722996 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:27.722996 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:27.722996 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:27.722996 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:27.722996 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:27.722996 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:27.722996 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:27.722996 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:27.722996 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:27.723916 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:27.723916 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:27.723916 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:27.723916 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:27.723916 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 285/560] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:27.724572 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a102d-3976-49cf-b4c5-af33525e5340 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:27.724857 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a102d-3976-49cf-b4c5-af33525e5340 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:27.725131 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a102d-3976-49cf-b4c5-af33525e5340 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:27.726708 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 286/561] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:27.727410 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a102d-3976-49cf-b4c5-af33525e5340 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:27.800071 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28a98f-255c-416c-9416-42f397dcd1be None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:27.837018 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a102d-3976-49cf-b4c5-af33525e5340 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:27.838073 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46131013-05dd-432a-89d2-6a7710863bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:27.838818 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46131013-05dd-432a-89d2-6a7710863bd4 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:27.839097 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46131013-05dd-432a-89d2-6a7710863bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:27.839486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46131013-05dd-432a-89d2-6a7710863bd4 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:27.840203 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46131013-05dd-432a-89d2-6a7710863bd4 None admin] RBAC: Adding query filter params (name=service) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:27.840514 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46131013-05dd-432a-89d2-6a7710863bd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:27.841924 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46131013-05dd-432a-89d2-6a7710863bd4 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:27.855575 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 276/562] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 04:39:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:27.855575 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46131013-05dd-432a-89d2-6a7710863bd4 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:27.860028 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:27.877501 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2a3a7-0838-40dd-80b4-9391e38bcb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:27.878290 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2a3a7-0838-40dd-80b4-9391e38bcb51 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:27.878638 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2a3a7-0838-40dd-80b4-9391e38bcb51 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:27.878908 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2a3a7-0838-40dd-80b4-9391e38bcb51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:27.885848 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2a3a7-0838-40dd-80b4-9391e38bcb51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:27.887345 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2a3a7-0838-40dd-80b4-9391e38bcb51 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:27.898786 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-fbc2a3a7-0838-40dd-80b4-9391e38bcb51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:27.898786 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:27.898786 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:27.898786 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:27.898786 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:27.898786 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:27.898786 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:27.898786 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:27.898786 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:27.898786 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:27.898786 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:27.898786 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:27.898786 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:39:27.898786 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:39:27.898786 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:39:27.899726 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:39:27.899726 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:27.899726 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:27.899726 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:27.899726 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:27.899726 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:27.899726 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:27.899726 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:27.899726 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:27.899726 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:27.899726 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:27.899726 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:27.899726 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:27.899726 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:27.899726 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:27.899726 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:27.899726 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:27.900644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:39:27.900644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:39:27.900644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:39:27.900644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:39:27.900644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:39:27.900644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:39:27.900644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:27.900644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:27.900644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 287/563] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:27.901131 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c3511-8241-45e7-9284-4e9dd00df217 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:27.901737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c3511-8241-45e7-9284-4e9dd00df217 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:27.901737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c3511-8241-45e7-9284-4e9dd00df217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:27.919660 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-aa4c3511-8241-45e7-9284-4e9dd00df217 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:27.920877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-aa4c3511-8241-45e7-9284-4e9dd00df217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:27.921602 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:27.963100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46131013-05dd-432a-89d2-6a7710863bd4 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:27.989665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 288/564] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:27.990657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c3511-8241-45e7-9284-4e9dd00df217 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:28.005372 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80660bf3-301d-44f8-90f1-0745836c3dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:28.006067 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80660bf3-301d-44f8-90f1-0745836c3dd4 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:28.006327 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80660bf3-301d-44f8-90f1-0745836c3dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:28.006602 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80660bf3-301d-44f8-90f1-0745836c3dd4 None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:28.007296 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80660bf3-301d-44f8-90f1-0745836c3dd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:28.007624 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80660bf3-301d-44f8-90f1-0745836c3dd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:28.008999 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80660bf3-301d-44f8-90f1-0745836c3dd4 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:28.021455 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 277/565] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:28.022318 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80660bf3-301d-44f8-90f1-0745836c3dd4 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:28.090802 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c3511-8241-45e7-9284-4e9dd00df217 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:28.099854 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:28.123272 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80660bf3-301d-44f8-90f1-0745836c3dd4 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:28.126260 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc0f29-c41c-448f-beac-8f8540b4bd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:28.126920 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc0f29-c41c-448f-beac-8f8540b4bd11 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:28.127197 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc0f29-c41c-448f-beac-8f8540b4bd11 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:28.127465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc0f29-c41c-448f-beac-8f8540b4bd11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:28.138033 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc0f29-c41c-448f-beac-8f8540b4bd11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:28.139546 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc0f29-c41c-448f-beac-8f8540b4bd11 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:28.143180 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:28.156038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-febc0f29-c41c-448f-beac-8f8540b4bd11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:28.156038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:28.156038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:28.156038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:28.156038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:28.156038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:28.156038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:28.156038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:28.156038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:28.156038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:28.156038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:28.156038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:28.156038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:28.156038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:28.156038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:28.157139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:28.157139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:28.157139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:28.157139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:28.157139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:28.157139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:28.157139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:28.157139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:28.157139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:28.157139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:28.157139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:28.157139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:28.157139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:28.157139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:28.157139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:28.157139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:28.157139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:28.163165 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:28.163165 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:28.163165 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:28.163165 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:28.163165 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 289/566] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:28.163165 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec620a2-8386-4dc8-b1e0-0db8c15338f7 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:28.163504 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60268504-cba7-431b-ae39-4c5107a3129d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:28.163603 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec620a2-8386-4dc8-b1e0-0db8c15338f7 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:28.163603 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec620a2-8386-4dc8-b1e0-0db8c15338f7 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:28.163728 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60268504-cba7-431b-ae39-4c5107a3129d None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:28.163728 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60268504-cba7-431b-ae39-4c5107a3129d None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:28.163728 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60268504-cba7-431b-ae39-4c5107a3129d None admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:28.163909 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 290/567] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:28.163977 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60268504-cba7-431b-ae39-4c5107a3129d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:28.163977 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60268504-cba7-431b-ae39-4c5107a3129d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:28.164098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec620a2-8386-4dc8-b1e0-0db8c15338f7 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:28.164173 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60268504-cba7-431b-ae39-4c5107a3129d None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:28.174937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 278/568] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:39:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:28.175949 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60268504-cba7-431b-ae39-4c5107a3129d None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:28.267536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec620a2-8386-4dc8-b1e0-0db8c15338f7 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:28.282021 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60268504-cba7-431b-ae39-4c5107a3129d None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:28.301990 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857c5a1-31d4-4b39-b0e5-b37fc2fea3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:28.302640 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857c5a1-31d4-4b39-b0e5-b37fc2fea3c1 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:28.302913 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857c5a1-31d4-4b39-b0e5-b37fc2fea3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:28.303180 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857c5a1-31d4-4b39-b0e5-b37fc2fea3c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:28.313240 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857c5a1-31d4-4b39-b0e5-b37fc2fea3c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:28.315797 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6dac9b-c759-492a-8a19-28dbd2660cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:28.316484 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6dac9b-c759-492a-8a19-28dbd2660cca None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:28.316764 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6dac9b-c759-492a-8a19-28dbd2660cca None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:28.317032 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6dac9b-c759-492a-8a19-28dbd2660cca None admin] PATH_INFO: `/v3/users/glance` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:28.318692 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-c857c5a1-31d4-4b39-b0e5-b37fc2fea3c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:28.318692 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:28.318692 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:28.318692 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:28.318692 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:28.318692 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:28.318692 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:28.318692 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:28.318692 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:28.318692 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:28.318692 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:28.318692 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:28.318692 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:28.318692 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:28.318692 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:28.318692 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:28.319787 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:28.319787 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:28.319787 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:28.319787 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:28.319787 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:28.319787 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:28.319787 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:28.319787 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:28.319787 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:28.319787 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:28.319787 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:28.319787 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:28.319787 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:28.319787 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:28.319787 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:28.319787 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:28.320820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:28.320820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:28.320820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:28.320820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:28.320820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:28.320820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:28.320820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:28.320820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:28.320820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:28.320820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:28.320820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:28.320820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:28.320820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 291/569] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 04:39:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:28.322402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d4517-b33c-432d-bab9-e4f90f607f16 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:28.322402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d4517-b33c-432d-bab9-e4f90f607f16 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:28.322402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d4517-b33c-432d-bab9-e4f90f607f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:28.329549 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6dac9b-c759-492a-8a19-28dbd2660cca None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:28.331057 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6dac9b-c759-492a-8a19-28dbd2660cca None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:28.339883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-e58d4517-b33c-432d-bab9-e4f90f607f16 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:28.341175 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-e58d4517-b33c-432d-bab9-e4f90f607f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:28.343316 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-eb6dac9b-c759-492a-8a19-28dbd2660cca None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 04:39:28.343316 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:28.343316 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:28.343316 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:28.343316 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:28.343316 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:28.343316 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:28.343316 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:28.343316 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:28.343316 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:28.343316 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:28.343316 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:28.343316 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:39:28.343316 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:39:28.343316 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:39:28.343316 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:39:28.344550 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:28.344550 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:28.344550 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:39:28.344550 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:28.344550 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:39:28.344550 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:28.344550 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:28.344550 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:28.344550 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:28.344550 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:28.344550 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:28.344550 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:28.344550 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:28.344550 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:28.344550 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:28.344550 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:28.344550 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:28.344550 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:28.345486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:28.345486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:28.345486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:39:28.345486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:39:28.345486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:39:28.345486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:39:28.345486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:39:28.345486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:39:28.345486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 04:39:28.345486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:28.345486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 279/570] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:39:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:28.345486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6dac9b-c759-492a-8a19-28dbd2660cca None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:28.361232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:28.386519 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:28.412874 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 292/571] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:28.413717 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d4517-b33c-432d-bab9-e4f90f607f16 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:28.455872 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6dac9b-c759-492a-8a19-28dbd2660cca None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:28.488141 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4c57a-e6b8-4e25-82d7-31dd2bfd48d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:28.488758 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4c57a-e6b8-4e25-82d7-31dd2bfd48d4 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:28.489044 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4c57a-e6b8-4e25-82d7-31dd2bfd48d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:28.489298 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4c57a-e6b8-4e25-82d7-31dd2bfd48d4 None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:28.489995 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4c57a-e6b8-4e25-82d7-31dd2bfd48d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:28.490309 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4c57a-e6b8-4e25-82d7-31dd2bfd48d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:28.491696 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4c57a-e6b8-4e25-82d7-31dd2bfd48d4 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:28.504283 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 280/572] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:28.505172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4c57a-e6b8-4e25-82d7-31dd2bfd48d4 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:28.516468 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d4517-b33c-432d-bab9-e4f90f607f16 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:28.553193 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e195a-fe82-4546-84c1-4644914e2108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:28.553835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e195a-fe82-4546-84c1-4644914e2108 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:28.554126 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e195a-fe82-4546-84c1-4644914e2108 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:28.554405 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e195a-fe82-4546-84c1-4644914e2108 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:28.555214 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e195a-fe82-4546-84c1-4644914e2108 None admin] RBAC: Adding query filter params (role.id=a22f1a3785a746048e38205d1996764b, scope.project.id=c4d7c29a2b144df6afa96fd6894254a4, user.id=0e089e39e9de419b9e2fb1d7fc2d245a) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:28.555525 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e195a-fe82-4546-84c1-4644914e2108 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:28.557019 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e195a-fe82-4546-84c1-4644914e2108 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:28.562948 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 293/573] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:39:28 2022] GET /identity/v3/role_assignments?user.id=0e089e39e9de419b9e2fb1d7fc2d245a&scope.project.id=c4d7c29a2b144df6afa96fd6894254a4&role.id=a22f1a3785a746048e38205d1996764b => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:28.563806 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e195a-fe82-4546-84c1-4644914e2108 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:28.583952 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:28.651253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:28.654390 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4c57a-e6b8-4e25-82d7-31dd2bfd48d4 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:28.693892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e195a-fe82-4546-84c1-4644914e2108 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:28.700214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10509be1-5afe-4e8b-8d5b-f31daefeb92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:28.700856 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10509be1-5afe-4e8b-8d5b-f31daefeb92c None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:28.701136 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10509be1-5afe-4e8b-8d5b-f31daefeb92c None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:28.701407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10509be1-5afe-4e8b-8d5b-f31daefeb92c None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:28.702172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10509be1-5afe-4e8b-8d5b-f31daefeb92c None admin] RBAC: Adding query filter params (name=service) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:28.702479 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10509be1-5afe-4e8b-8d5b-f31daefeb92c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:28.703940 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10509be1-5afe-4e8b-8d5b-f31daefeb92c None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:28.719037 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 281/574] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 04:39:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:28.719037 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10509be1-5afe-4e8b-8d5b-f31daefeb92c None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:28.739521 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593aa60-0551-4382-b963-8232fbcbcaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:28.740295 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593aa60-0551-4382-b963-8232fbcbcaf4 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:28.740679 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593aa60-0551-4382-b963-8232fbcbcaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:28.741069 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593aa60-0551-4382-b963-8232fbcbcaf4 None admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:28.742067 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593aa60-0551-4382-b963-8232fbcbcaf4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:28.742465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593aa60-0551-4382-b963-8232fbcbcaf4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:28.744023 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593aa60-0551-4382-b963-8232fbcbcaf4 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:28.763119 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 294/575] 10.222.0.39 () {56 vars in 1137 bytes} [Tue Jul 26 04:39:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:28.768596 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593aa60-0551-4382-b963-8232fbcbcaf4 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:28.844782 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10509be1-5afe-4e8b-8d5b-f31daefeb92c None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:28.852924 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:28.882872 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23736a27-ea59-41ef-b7e5-e8b96d6f8d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:28.883640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23736a27-ea59-41ef-b7e5-e8b96d6f8d1d None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:28.883993 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23736a27-ea59-41ef-b7e5-e8b96d6f8d1d None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:28.884341 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23736a27-ea59-41ef-b7e5-e8b96d6f8d1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:28.889517 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593aa60-0551-4382-b963-8232fbcbcaf4 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:28.895667 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23736a27-ea59-41ef-b7e5-e8b96d6f8d1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:28.901199 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-23736a27-ea59-41ef-b7e5-e8b96d6f8d1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:28.901199 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:28.901199 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:28.901199 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:28.901199 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:28.901199 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:28.901199 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:28.901199 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:28.901199 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:28.901199 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:28.901199 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:28.901199 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:28.901199 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:28.901199 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:28.901199 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:28.901199 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:28.902463 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:28.902463 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:28.902463 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:28.902463 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:28.902463 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:28.902463 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:28.902463 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:28.902463 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:28.902463 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:28.902463 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:28.902463 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:28.902463 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:28.902463 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:28.902463 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:28.902463 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:28.902463 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:28.903535 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:28.903535 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:28.903535 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:28.903535 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:28.903535 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:28.903535 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:28.903535 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:28.903535 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:28.903535 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:28.903535 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:28.903535 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:28.903535 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:28.909059 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 282/576] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 04:39:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:28.909887 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23736a27-ea59-41ef-b7e5-e8b96d6f8d1d None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:28.929570 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a6b64-70ae-4542-8b66-be07109bc73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:28.930416 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a6b64-70ae-4542-8b66-be07109bc73f None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:28.930794 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a6b64-70ae-4542-8b66-be07109bc73f None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:28.931162 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a6b64-70ae-4542-8b66-be07109bc73f None admin] PATH_INFO: `/v3/users/nova` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:28.935022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:28.938906 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a6b64-70ae-4542-8b66-be07109bc73f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:28.940449 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004a6b64-70ae-4542-8b66-be07109bc73f None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:28.952740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-004a6b64-70ae-4542-8b66-be07109bc73f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 04:39:28.952740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:28.952740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:28.952740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:28.952740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:28.952740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:28.952740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:28.952740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:28.952740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:28.952740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:28.952740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:28.952740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:28.952740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:39:28.952740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:39:28.952740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:39:28.952740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:39:28.953927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:28.953927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:28.953927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:39:28.953927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:28.953927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:39:28.953927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:28.953927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:28.953927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:28.953927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:28.953927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:28.953927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:28.953927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:28.953927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:28.953927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:28.953927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:28.953927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:28.953927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:28.953927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:28.954958 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:28.954958 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:28.954958 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:39:28.954958 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:39:28.954958 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:39:28.954958 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:39:28.954958 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:39:28.954958 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:39:28.954958 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 04:39:28.954958 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:28.954958 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 295/577] 10.222.0.39 () {56 vars in 1093 bytes} [Tue Jul 26 04:39:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:28.955561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a6b64-70ae-4542-8b66-be07109bc73f None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:29.028922 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23736a27-ea59-41ef-b7e5-e8b96d6f8d1d None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:29.065901 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e4f95-379c-4ff4-92f9-20f09c5debdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:29.066694 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e4f95-379c-4ff4-92f9-20f09c5debdb None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:29.066982 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a6b64-70ae-4542-8b66-be07109bc73f None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:29.067444 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e4f95-379c-4ff4-92f9-20f09c5debdb None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:29.067444 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e4f95-379c-4ff4-92f9-20f09c5debdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:29.078971 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e4f95-379c-4ff4-92f9-20f09c5debdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:29.080528 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e4f95-379c-4ff4-92f9-20f09c5debdb None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:29.095157 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-486e4f95-379c-4ff4-92f9-20f09c5debdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:29.095157 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:29.095157 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:29.095157 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:29.095157 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:29.095157 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:29.095157 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:29.095157 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:29.095157 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:29.095157 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:29.095157 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:29.095157 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:29.095157 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:29.095157 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:29.095157 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:29.096100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:29.096100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:29.096100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:29.096100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:29.096100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:29.096100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:29.096100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:29.096100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:29.096100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:29.096100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:29.096100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:29.096100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:29.096100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:29.096100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:29.096100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:29.096100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:29.096100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:29.097038 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:29.097038 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:29.097038 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:29.097038 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:29.097038 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 283/578] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:29.097343 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e4f95-379c-4ff4-92f9-20f09c5debdb None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:29.105755 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:29.112384 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f48944-dd2d-4d4a-8a91-66377ae55904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:29.113032 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f48944-dd2d-4d4a-8a91-66377ae55904 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:29.113323 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f48944-dd2d-4d4a-8a91-66377ae55904 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:29.113792 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f48944-dd2d-4d4a-8a91-66377ae55904 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:29.125858 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f48944-dd2d-4d4a-8a91-66377ae55904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:29.127370 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f48944-dd2d-4d4a-8a91-66377ae55904 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:29.143013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-39f48944-dd2d-4d4a-8a91-66377ae55904 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:29.143013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:29.143013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:29.143013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:29.143013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:29.143013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:29.143013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:29.143013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:29.143013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:29.143013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:29.143013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:29.143013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:29.143013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:29.143013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:29.143013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:29.144364 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:29.144364 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:29.144364 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:29.144364 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:29.144364 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:29.144364 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:29.144364 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:29.144364 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:29.144364 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:29.144364 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:29.144364 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:29.144364 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:29.144364 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:29.144364 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:29.144364 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:29.144364 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:29.144364 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:29.145596 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:29.145596 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:29.145596 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:29.145596 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:29.148850 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 296/579] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:29.149702 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f48944-dd2d-4d4a-8a91-66377ae55904 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:29.182651 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:29.214997 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e4f95-379c-4ff4-92f9-20f09c5debdb None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:29.250829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2142a8-5772-467b-b48a-6282aa6e6d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:29.251456 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2142a8-5772-467b-b48a-6282aa6e6d1b None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:29.251740 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2142a8-5772-467b-b48a-6282aa6e6d1b None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:29.252003 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2142a8-5772-467b-b48a-6282aa6e6d1b None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:29.252719 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2142a8-5772-467b-b48a-6282aa6e6d1b None admin] RBAC: Adding query filter params (name=service) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:29.253028 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2142a8-5772-467b-b48a-6282aa6e6d1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:29.254641 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2142a8-5772-467b-b48a-6282aa6e6d1b None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:29.255442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f48944-dd2d-4d4a-8a91-66377ae55904 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:29.266460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 284/580] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 04:39:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:29.266460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2142a8-5772-467b-b48a-6282aa6e6d1b None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:29.297074 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666300c7-6830-430f-92d8-eb7a924eccfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:29.297706 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666300c7-6830-430f-92d8-eb7a924eccfc None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:29.297997 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666300c7-6830-430f-92d8-eb7a924eccfc None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:29.298286 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666300c7-6830-430f-92d8-eb7a924eccfc None admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:29.299082 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666300c7-6830-430f-92d8-eb7a924eccfc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:29.299388 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666300c7-6830-430f-92d8-eb7a924eccfc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:29.300976 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666300c7-6830-430f-92d8-eb7a924eccfc None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:29.319371 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 297/581] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Jul 26 04:39:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:29.324958 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666300c7-6830-430f-92d8-eb7a924eccfc None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:29.372926 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:29.373654 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2142a8-5772-467b-b48a-6282aa6e6d1b None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:29.409189 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5571c2f-aa68-4e2f-831a-cc44ab055c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:29.410040 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5571c2f-aa68-4e2f-831a-cc44ab055c68 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:29.410418 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5571c2f-aa68-4e2f-831a-cc44ab055c68 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:29.410787 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5571c2f-aa68-4e2f-831a-cc44ab055c68 None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:29.411628 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5571c2f-aa68-4e2f-831a-cc44ab055c68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:29.412061 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5571c2f-aa68-4e2f-831a-cc44ab055c68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:29.413606 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5571c2f-aa68-4e2f-831a-cc44ab055c68 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:29.415952 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:29.430622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 285/582] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:29.430622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5571c2f-aa68-4e2f-831a-cc44ab055c68 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:29.448315 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666300c7-6830-430f-92d8-eb7a924eccfc None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:29.492819 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48444e3f-8eb0-45e3-8fe2-c08ca7989f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:29.493457 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48444e3f-8eb0-45e3-8fe2-c08ca7989f69 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:29.493753 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48444e3f-8eb0-45e3-8fe2-c08ca7989f69 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:29.494013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48444e3f-8eb0-45e3-8fe2-c08ca7989f69 None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:29.494722 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48444e3f-8eb0-45e3-8fe2-c08ca7989f69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:29.495027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48444e3f-8eb0-45e3-8fe2-c08ca7989f69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:29.496412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48444e3f-8eb0-45e3-8fe2-c08ca7989f69 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:29.508943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 298/583] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:29.514188 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48444e3f-8eb0-45e3-8fe2-c08ca7989f69 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:29.544078 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5571c2f-aa68-4e2f-831a-cc44ab055c68 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:29.581798 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1925262-133e-4bd3-a5f6-3316b510a5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:29.582562 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1925262-133e-4bd3-a5f6-3316b510a5cb None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:29.582841 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1925262-133e-4bd3-a5f6-3316b510a5cb None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:29.583120 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1925262-133e-4bd3-a5f6-3316b510a5cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:29.594028 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1925262-133e-4bd3-a5f6-3316b510a5cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:29.595485 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1925262-133e-4bd3-a5f6-3316b510a5cb None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:29.610835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-c1925262-133e-4bd3-a5f6-3316b510a5cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:29.610835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:29.610835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:29.610835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:29.610835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:29.610835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:29.610835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:29.610835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:29.610835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:29.610835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:29.610835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:29.610835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:29.610835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:29.610835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:29.610835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:29.611821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:29.611821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:29.611821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:29.611821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:29.611821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:29.611821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:29.611821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:29.611821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:29.611821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:29.611821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:29.611821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:29.611821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:29.611821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:29.611821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:29.611821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:29.611821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:29.611821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:29.612832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:29.612832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:29.612832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:29.612832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:29.612832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 286/584] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:29.613106 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1925262-133e-4bd3-a5f6-3316b510a5cb None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:29.633257 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48444e3f-8eb0-45e3-8fe2-c08ca7989f69 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:29.634902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:29.672764 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98b95d-ec50-436e-89dc-f8595f06ef6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:29.673429 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98b95d-ec50-436e-89dc-f8595f06ef6a None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:29.673717 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98b95d-ec50-436e-89dc-f8595f06ef6a None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:29.673994 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98b95d-ec50-436e-89dc-f8595f06ef6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:29.678214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:29.688406 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea98b95d-ec50-436e-89dc-f8595f06ef6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:29.690849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea98b95d-ec50-436e-89dc-f8595f06ef6a None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:29.709317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-ea98b95d-ec50-436e-89dc-f8595f06ef6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:29.709317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:29.709317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:29.709317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:29.709317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:29.709317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:29.709317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:29.709317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:29.709317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:29.709317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:29.709317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:29.709317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:29.709317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:29.709317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:29.709317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:29.710338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:29.710338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:29.710338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:29.710338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:29.710338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:29.710338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:29.710338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:29.710338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:29.710338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:29.710338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:29.710338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:29.710338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:29.710338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:29.710338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:29.710338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:29.710338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:29.710338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:29.711477 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:29.711477 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:29.711477 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:29.711477 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:29.713034 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 299/585] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:29.714169 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98b95d-ec50-436e-89dc-f8595f06ef6a None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:29.739688 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1925262-133e-4bd3-a5f6-3316b510a5cb None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:29.776025 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50c5c9-cdfa-4a53-b049-43f79ee3372a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:29.776671 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50c5c9-cdfa-4a53-b049-43f79ee3372a None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:29.776961 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50c5c9-cdfa-4a53-b049-43f79ee3372a None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:29.777215 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50c5c9-cdfa-4a53-b049-43f79ee3372a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:29.786217 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50c5c9-cdfa-4a53-b049-43f79ee3372a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:29.787698 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50c5c9-cdfa-4a53-b049-43f79ee3372a None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:29.799362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-2f50c5c9-cdfa-4a53-b049-43f79ee3372a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 04:39:29.799362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:29.799362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:29.799362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:29.799362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:29.799362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:29.799362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:29.799362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:29.799362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:29.799362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:29.799362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:29.799362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:29.799362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:39:29.799362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:39:29.799362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:39:29.799362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:39:29.800379 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:29.800379 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:29.800379 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:39:29.800379 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:29.800379 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:39:29.800379 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:29.800379 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:29.800379 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:29.800379 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:29.800379 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:29.800379 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:29.800379 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:29.800379 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:29.800379 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:29.800379 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:29.800379 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:29.800379 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:29.800379 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:29.806354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:29.806354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:29.806354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:39:29.806354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:39:29.806354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:39:29.806354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:39:29.806354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:39:29.806354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:39:29.806354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 04:39:29.806354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:29.806354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 287/586] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:39:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:29.806354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50c5c9-cdfa-4a53-b049-43f79ee3372a None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:29.828840 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98b95d-ec50-436e-89dc-f8595f06ef6a None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:29.865202 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa40935-5eb2-4c05-bf5b-870040cb6786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:29.865865 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa40935-5eb2-4c05-bf5b-870040cb6786 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:29.866177 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa40935-5eb2-4c05-bf5b-870040cb6786 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:29.866449 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa40935-5eb2-4c05-bf5b-870040cb6786 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:29.873758 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa40935-5eb2-4c05-bf5b-870040cb6786 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:29.875313 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa40935-5eb2-4c05-bf5b-870040cb6786 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:29.887327 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-faa40935-5eb2-4c05-bf5b-870040cb6786 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:29.887327 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:29.887327 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:29.887327 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:29.887327 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:29.887327 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:29.887327 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:29.887327 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:29.887327 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:29.887327 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:29.887327 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:29.887327 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:29.887327 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:39:29.887327 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:39:29.887327 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:39:29.888412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:39:29.888412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:29.888412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:29.888412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:29.888412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:29.888412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:29.888412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:29.888412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:29.888412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:29.888412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:29.888412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:29.888412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:29.888412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:29.888412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:29.888412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:29.888412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:29.888412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:29.889436 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:39:29.889436 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:39:29.889436 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:39:29.889436 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:39:29.889436 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:39:29.889436 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:39:29.889436 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:29.889436 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:29.889436 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 300/587] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:29.890071 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa40935-5eb2-4c05-bf5b-870040cb6786 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:29.909616 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:29.933583 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50c5c9-cdfa-4a53-b049-43f79ee3372a None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:29.943493 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:29.975066 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66541a90-a649-40ec-9eec-cf15c12a2a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:29.975714 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66541a90-a649-40ec-9eec-cf15c12a2a28 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:29.976046 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66541a90-a649-40ec-9eec-cf15c12a2a28 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:29.976289 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66541a90-a649-40ec-9eec-cf15c12a2a28 None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:29.977028 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66541a90-a649-40ec-9eec-cf15c12a2a28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:29.977332 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66541a90-a649-40ec-9eec-cf15c12a2a28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:29.979257 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66541a90-a649-40ec-9eec-cf15c12a2a28 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:29.997858 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 288/588] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:29.997858 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66541a90-a649-40ec-9eec-cf15c12a2a28 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:30.009841 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa40935-5eb2-4c05-bf5b-870040cb6786 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:30.046157 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861b70e-aae8-4aec-afdc-ccbae36545e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:30.046935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861b70e-aae8-4aec-afdc-ccbae36545e7 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:30.047288 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861b70e-aae8-4aec-afdc-ccbae36545e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:30.047636 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3861b70e-aae8-4aec-afdc-ccbae36545e7 None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:30.048411 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861b70e-aae8-4aec-afdc-ccbae36545e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:30.048788 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861b70e-aae8-4aec-afdc-ccbae36545e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:30.050267 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3861b70e-aae8-4aec-afdc-ccbae36545e7 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:30.063458 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 301/589] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:30.064299 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861b70e-aae8-4aec-afdc-ccbae36545e7 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:30.111948 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66541a90-a649-40ec-9eec-cf15c12a2a28 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:30.140921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:30.149724 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b527ab-1b90-4904-b55e-1582272a86be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:30.150778 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b527ab-1b90-4904-b55e-1582272a86be None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:30.150778 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b527ab-1b90-4904-b55e-1582272a86be None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:30.151039 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b527ab-1b90-4904-b55e-1582272a86be None admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:30.151889 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b527ab-1b90-4904-b55e-1582272a86be None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:30.152167 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b527ab-1b90-4904-b55e-1582272a86be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:30.153623 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b527ab-1b90-4904-b55e-1582272a86be None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:30.172272 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3861b70e-aae8-4aec-afdc-ccbae36545e7 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:30.177767 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 289/590] 10.222.0.39 () {56 vars in 1137 bytes} [Tue Jul 26 04:39:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:30.177767 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b527ab-1b90-4904-b55e-1582272a86be None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:30.206559 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:30.215774 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d837b-ac90-4556-ac1c-8088b04a44dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:30.216511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d837b-ac90-4556-ac1c-8088b04a44dc None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:30.216804 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d837b-ac90-4556-ac1c-8088b04a44dc None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:30.217077 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d837b-ac90-4556-ac1c-8088b04a44dc None admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:30.217842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d837b-ac90-4556-ac1c-8088b04a44dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:30.218181 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d837b-ac90-4556-ac1c-8088b04a44dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:30.219647 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d837b-ac90-4556-ac1c-8088b04a44dc None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:30.231959 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 302/591] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:39:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:30.232851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d837b-ac90-4556-ac1c-8088b04a44dc None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:30.300657 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b527ab-1b90-4904-b55e-1582272a86be None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:30.338648 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f99fcef-22b9-4a92-abd2-dbc5770599d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:30.339477 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99fcef-22b9-4a92-abd2-dbc5770599d3 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:30.339931 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99fcef-22b9-4a92-abd2-dbc5770599d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:30.340215 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99fcef-22b9-4a92-abd2-dbc5770599d3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:30.347756 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f99fcef-22b9-4a92-abd2-dbc5770599d3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:30.348404 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d837b-ac90-4556-ac1c-8088b04a44dc None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:30.349494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f99fcef-22b9-4a92-abd2-dbc5770599d3 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:30.361767 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-2f99fcef-22b9-4a92-abd2-dbc5770599d3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 04:39:30.361767 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:30.361767 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:30.361767 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:30.361767 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:30.361767 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:30.361767 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:30.361767 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:30.361767 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:30.361767 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:30.361767 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:30.361767 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:30.361767 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:39:30.361767 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:39:30.361767 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:39:30.361767 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:39:30.363111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:30.363111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:30.363111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:39:30.363111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:30.363111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:39:30.363111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:30.363111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:30.363111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:30.363111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:30.363111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:30.363111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:30.363111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:30.363111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:30.363111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:30.363111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:30.363111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:30.363111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:30.363111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:30.364302 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:30.364302 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:30.364302 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:39:30.364302 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:39:30.364302 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:39:30.364302 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:39:30.364302 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:39:30.364302 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:39:30.364302 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 04:39:30.364302 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:30.364900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 290/592] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 04:39:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:30.365489 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f99fcef-22b9-4a92-abd2-dbc5770599d3 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:30.391113 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e780f1-56b6-478f-9b76-9b945ff7732b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:30.391901 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e780f1-56b6-478f-9b76-9b945ff7732b None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:30.392189 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e780f1-56b6-478f-9b76-9b945ff7732b None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:30.392465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e780f1-56b6-478f-9b76-9b945ff7732b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:30.394784 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:30.400944 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e780f1-56b6-478f-9b76-9b945ff7732b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:30.402986 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e780f1-56b6-478f-9b76-9b945ff7732b None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:30.415746 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-40e780f1-56b6-478f-9b76-9b945ff7732b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:30.415746 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:30.415746 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:30.415746 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:30.415746 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:30.415746 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:30.415746 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:30.415746 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:30.415746 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:30.415746 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:30.415746 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:30.415746 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:30.415746 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:39:30.415746 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:39:30.415746 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:39:30.416905 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:39:30.416905 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:30.416905 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:30.416905 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:30.416905 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:30.416905 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:30.416905 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:30.416905 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:30.416905 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:30.416905 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:30.416905 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:30.416905 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:30.416905 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:30.416905 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:30.416905 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:30.416905 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:30.416905 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:30.418059 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:39:30.418059 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:39:30.418059 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:39:30.418059 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:39:30.418059 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:39:30.418059 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:39:30.418059 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:30.418059 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:30.423870 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 303/593] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:30.423870 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e780f1-56b6-478f-9b76-9b945ff7732b None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:30.470222 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:30.490517 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f99fcef-22b9-4a92-abd2-dbc5770599d3 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:30.529459 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e780f1-56b6-478f-9b76-9b945ff7732b None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:30.530554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d479be-33a0-4572-94c8-b03d3fdad93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:30.531221 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d479be-33a0-4572-94c8-b03d3fdad93f None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:30.531501 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d479be-33a0-4572-94c8-b03d3fdad93f None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:30.532510 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d479be-33a0-4572-94c8-b03d3fdad93f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:30.543806 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d479be-33a0-4572-94c8-b03d3fdad93f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:30.545309 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d479be-33a0-4572-94c8-b03d3fdad93f None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:30.559581 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-33d479be-33a0-4572-94c8-b03d3fdad93f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:30.559581 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:30.559581 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:30.559581 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:30.559581 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:30.559581 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:30.559581 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:30.559581 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:30.559581 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:30.559581 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:30.559581 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:30.559581 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:30.559581 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:30.559581 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:30.559581 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:30.560677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:30.560677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:30.560677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:30.560677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:30.560677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:30.560677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:30.560677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:30.560677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:30.560677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:30.560677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:30.560677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:30.560677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:30.560677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:30.560677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:30.560677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:30.560677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:30.560677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:30.561783 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:30.561783 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:30.561783 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:30.561783 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:30.561783 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 291/594] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:30.561783 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d479be-33a0-4572-94c8-b03d3fdad93f None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:30.569488 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914eea5-1b1f-4533-a07e-61d188395546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:30.570213 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914eea5-1b1f-4533-a07e-61d188395546 None admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:30.570497 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914eea5-1b1f-4533-a07e-61d188395546 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:30.570776 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914eea5-1b1f-4533-a07e-61d188395546 None admin] PATH_INFO: `/v3/projects/c4d7c29a2b144df6afa96fd6894254a4/users/7cfbf2c03eb740ed8b72c4825cffc341/roles/a22f1a3785a746048e38205d1996764b` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:30.586190 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914eea5-1b1f-4533-a07e-61d188395546 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4d7c29a2b144df6afa96fd6894254a4, user_id=7cfbf2c03eb740ed8b72c4825cffc341, role_id=a22f1a3785a746048e38205d1996764b)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:30.587696 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914eea5-1b1f-4533-a07e-61d188395546 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:30.601779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 304/595] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 04:39:30 2022] PUT /identity/v3/projects/c4d7c29a2b144df6afa96fd6894254a4/users/7cfbf2c03eb740ed8b72c4825cffc341/roles/a22f1a3785a746048e38205d1996764b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:39:30.602683 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914eea5-1b1f-4533-a07e-61d188395546 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:30.656993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:30.675145 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d479be-33a0-4572-94c8-b03d3fdad93f None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:30.712437 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5e0b4-b72b-4819-9e47-b35b4eb0f8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:30.713126 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5e0b4-b72b-4819-9e47-b35b4eb0f8e5 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:30.713367 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5e0b4-b72b-4819-9e47-b35b4eb0f8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:30.713643 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5e0b4-b72b-4819-9e47-b35b4eb0f8e5 None admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:30.714491 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5e0b4-b72b-4819-9e47-b35b4eb0f8e5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:30.714828 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5e0b4-b72b-4819-9e47-b35b4eb0f8e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:30.716339 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5e0b4-b72b-4819-9e47-b35b4eb0f8e5 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:30.723673 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914eea5-1b1f-4533-a07e-61d188395546 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:30.726005 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:30.737175 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 292/596] 10.222.0.39 () {56 vars in 1139 bytes} [Tue Jul 26 04:39:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:30.738715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbd36a-b245-4faf-8183-0bcdd8dd2966 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:30.739007 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbd36a-b245-4faf-8183-0bcdd8dd2966 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:30.739288 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cbd36a-b245-4faf-8183-0bcdd8dd2966 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:30.744951 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 293/597] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:30.744951 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbd36a-b245-4faf-8183-0bcdd8dd2966 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:30.780404 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ddc1a-4636-421c-a062-c0eb15f57eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:30.781173 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ddc1a-4636-421c-a062-c0eb15f57eed None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:30.781347 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ddc1a-4636-421c-a062-c0eb15f57eed None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:30.781624 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ddc1a-4636-421c-a062-c0eb15f57eed None admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:30.782829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ddc1a-4636-421c-a062-c0eb15f57eed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:30.782829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ddc1a-4636-421c-a062-c0eb15f57eed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:30.784343 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905ddc1a-4636-421c-a062-c0eb15f57eed None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:30.797189 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 305/598] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:39:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:30.798035 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ddc1a-4636-421c-a062-c0eb15f57eed None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:30.866133 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cbd36a-b245-4faf-8183-0bcdd8dd2966 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:30.902629 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298e3e3-289f-4e8e-888d-33a92c7de99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:30.903268 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298e3e3-289f-4e8e-888d-33a92c7de99f None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:30.903553 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298e3e3-289f-4e8e-888d-33a92c7de99f None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:30.903824 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298e3e3-289f-4e8e-888d-33a92c7de99f None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:30.904510 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298e3e3-289f-4e8e-888d-33a92c7de99f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:30.904831 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298e3e3-289f-4e8e-888d-33a92c7de99f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:30.906224 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298e3e3-289f-4e8e-888d-33a92c7de99f None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:30.908108 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ddc1a-4636-421c-a062-c0eb15f57eed None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:30.911691 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:30.922838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 294/599] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:30.922838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10271c3-f139-4d9e-95dd-1fd5124d2de3 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:30.922838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10271c3-f139-4d9e-95dd-1fd5124d2de3 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:30.922838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10271c3-f139-4d9e-95dd-1fd5124d2de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:30.938659 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-f10271c3-f139-4d9e-95dd-1fd5124d2de3 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:30.939858 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-f10271c3-f139-4d9e-95dd-1fd5124d2de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:30.952961 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afbf485-5a5f-4747-bcc5-bf3785001d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:30.953731 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbf485-5a5f-4747-bcc5-bf3785001d58 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:30.954017 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbf485-5a5f-4747-bcc5-bf3785001d58 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:30.954616 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbf485-5a5f-4747-bcc5-bf3785001d58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:30.966554 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afbf485-5a5f-4747-bcc5-bf3785001d58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:30.968138 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afbf485-5a5f-4747-bcc5-bf3785001d58 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:30.985259 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-8afbf485-5a5f-4747-bcc5-bf3785001d58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:30.985259 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:30.985259 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:30.985259 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:30.985259 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:30.985259 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:30.985259 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:30.985259 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:30.985259 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:30.985259 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:30.985259 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:30.985259 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:30.985259 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:30.985259 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:30.985259 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:30.986455 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:30.986455 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:30.986455 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:30.986455 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:30.986455 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:30.986455 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:30.986455 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:30.986455 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:30.986455 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:30.986455 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:30.986455 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:30.986455 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:30.986455 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:30.986455 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:30.986455 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:30.986455 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:30.986455 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:30.987379 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:30.987379 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:30.987379 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:30.987379 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:30.987379 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 306/600] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:30.987379 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afbf485-5a5f-4747-bcc5-bf3785001d58 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:30.996889 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:31.030005 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 295/601] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:31.030005 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10271c3-f139-4d9e-95dd-1fd5124d2de3 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:31.093860 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afbf485-5a5f-4747-bcc5-bf3785001d58 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:31.129479 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7306e26-89aa-4765-a0bb-88959df78c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:31.130201 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7306e26-89aa-4765-a0bb-88959df78c9f None admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:31.130486 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7306e26-89aa-4765-a0bb-88959df78c9f None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:31.130762 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7306e26-89aa-4765-a0bb-88959df78c9f None admin] PATH_INFO: `/v3/projects/c4d7c29a2b144df6afa96fd6894254a4/users/ae8593e125da4b208dd100608aa2b462/roles/a22f1a3785a746048e38205d1996764b` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:31.145778 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10271c3-f139-4d9e-95dd-1fd5124d2de3 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:31.146498 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7306e26-89aa-4765-a0bb-88959df78c9f None admin] RBAC: Authorizing `identity:create_grant(project_id=c4d7c29a2b144df6afa96fd6894254a4, user_id=ae8593e125da4b208dd100608aa2b462, role_id=a22f1a3785a746048e38205d1996764b)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:31.147986 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7306e26-89aa-4765-a0bb-88959df78c9f None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:31.174028 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 307/602] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 04:39:30 2022] PUT /identity/v3/projects/c4d7c29a2b144df6afa96fd6894254a4/users/ae8593e125da4b208dd100608aa2b462/roles/a22f1a3785a746048e38205d1996764b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:39:31.174028 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7306e26-89aa-4765-a0bb-88959df78c9f None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:31.176577 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:31.201561 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bde44-6752-4d69-9040-e89f326d6b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:31.202644 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bde44-6752-4d69-9040-e89f326d6b1f None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:31.202987 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bde44-6752-4d69-9040-e89f326d6b1f None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:31.203323 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bde44-6752-4d69-9040-e89f326d6b1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:31.213418 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bde44-6752-4d69-9040-e89f326d6b1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:31.215807 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bde44-6752-4d69-9040-e89f326d6b1f None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:31.231881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-819bde44-6752-4d69-9040-e89f326d6b1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:31.231881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:31.231881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:31.231881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:31.231881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:31.231881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:31.231881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:31.231881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:31.231881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:31.231881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:31.231881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:31.231881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:31.231881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:39:31.231881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:39:31.231881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:39:31.233006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:39:31.233006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:31.233006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:31.233006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:31.233006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:31.233006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:31.233006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:31.233006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:31.233006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:31.233006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:31.233006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:31.233006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:31.233006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:31.233006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:31.233006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:31.233006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:31.233006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:31.233911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:39:31.233911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:39:31.233911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:39:31.233911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:39:31.233911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:39:31.233911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:39:31.233911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:31.233911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:31.234381 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 296/603] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:31.235206 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bde44-6752-4d69-9040-e89f326d6b1f None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:31.296975 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7306e26-89aa-4765-a0bb-88959df78c9f None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:31.315221 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:31.345109 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a675c0-dae4-49b1-aee8-daf5cbe65208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:31.346121 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a675c0-dae4-49b1-aee8-daf5cbe65208 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:31.346549 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a675c0-dae4-49b1-aee8-daf5cbe65208 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:31.347043 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a675c0-dae4-49b1-aee8-daf5cbe65208 None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:31.347903 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a675c0-dae4-49b1-aee8-daf5cbe65208 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:31.348372 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a675c0-dae4-49b1-aee8-daf5cbe65208 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:31.350178 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a675c0-dae4-49b1-aee8-daf5cbe65208 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:31.364979 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 308/604] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:31.366006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a675c0-dae4-49b1-aee8-daf5cbe65208 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:31.384138 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bde44-6752-4d69-9040-e89f326d6b1f None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:31.427030 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b3a0d-68cd-413d-9faa-e580abd370c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:31.427699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b3a0d-68cd-413d-9faa-e580abd370c6 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:31.427982 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b3a0d-68cd-413d-9faa-e580abd370c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:31.428257 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b3a0d-68cd-413d-9faa-e580abd370c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:31.440042 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b3a0d-68cd-413d-9faa-e580abd370c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:31.445939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-0e9b3a0d-68cd-413d-9faa-e580abd370c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:31.445939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:31.445939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:31.445939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:31.445939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:31.445939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:31.445939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:31.445939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:31.445939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:31.445939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:31.445939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:31.445939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:31.445939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:31.445939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:31.445939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:31.445939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:31.447313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:31.447313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:31.447313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:31.447313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:31.447313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:31.447313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:31.447313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:31.447313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:31.447313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:31.447313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:31.447313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:31.447313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:31.447313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:31.447313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:31.447313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:31.447313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:31.448152 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:31.448152 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:31.448152 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:31.448152 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:31.448152 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:31.448152 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:31.448152 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:31.448152 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:31.448152 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:31.448152 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:31.448152 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:31.448152 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:31.452737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 297/605] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 04:39:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:31.453745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b3a0d-68cd-413d-9faa-e580abd370c6 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:31.465404 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:31.513447 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a675c0-dae4-49b1-aee8-daf5cbe65208 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:31.562249 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa650288-1296-4fab-9276-8ea79328bf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:31.563451 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa650288-1296-4fab-9276-8ea79328bf32 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:31.563904 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa650288-1296-4fab-9276-8ea79328bf32 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:31.564348 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa650288-1296-4fab-9276-8ea79328bf32 None admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:31.564651 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b3a0d-68cd-413d-9faa-e580abd370c6 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:31.565529 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa650288-1296-4fab-9276-8ea79328bf32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:31.566338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa650288-1296-4fab-9276-8ea79328bf32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:31.569227 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa650288-1296-4fab-9276-8ea79328bf32 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:31.573761 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:31.588019 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 309/606] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:39:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:31.589193 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa650288-1296-4fab-9276-8ea79328bf32 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:31.609172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3077b6-5507-485d-860c-6db6307acaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:31.609931 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3077b6-5507-485d-860c-6db6307acaa5 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:31.610324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3077b6-5507-485d-860c-6db6307acaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:31.610666 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3077b6-5507-485d-860c-6db6307acaa5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:31.622004 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3077b6-5507-485d-860c-6db6307acaa5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:31.624023 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3077b6-5507-485d-860c-6db6307acaa5 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:31.637552 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-5b3077b6-5507-485d-860c-6db6307acaa5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:31.637552 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:31.637552 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:31.637552 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:31.637552 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:31.637552 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:31.637552 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:31.637552 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:31.637552 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:31.637552 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:31.637552 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:31.637552 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:31.637552 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:39:31.637552 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:39:31.637552 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:39:31.638564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:39:31.638564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:31.638564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:31.638564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:31.638564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:31.638564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:31.638564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:31.638564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:31.638564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:31.638564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:31.638564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:31.638564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:31.638564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:31.638564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:31.638564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:31.638564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:31.638564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:31.639460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:39:31.639460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:39:31.639460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:39:31.639460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:39:31.639460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:39:31.639460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:39:31.639460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:31.639460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:31.642208 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 298/607] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:31.643255 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3077b6-5507-485d-860c-6db6307acaa5 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:31.711517 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa650288-1296-4fab-9276-8ea79328bf32 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:31.742712 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:31.755408 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8688ec-0161-49fb-8c57-bd4f2ce94542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:31.756307 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8688ec-0161-49fb-8c57-bd4f2ce94542 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:31.757182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8688ec-0161-49fb-8c57-bd4f2ce94542 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:31.757732 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8688ec-0161-49fb-8c57-bd4f2ce94542 None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:31.758722 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8688ec-0161-49fb-8c57-bd4f2ce94542 None admin] RBAC: Adding query filter params (name=service) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:31.759174 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8688ec-0161-49fb-8c57-bd4f2ce94542 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:31.760844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8688ec-0161-49fb-8c57-bd4f2ce94542 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:31.770847 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 310/608] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 04:39:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:31.771612 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3077b6-5507-485d-860c-6db6307acaa5 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:31.772250 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8688ec-0161-49fb-8c57-bd4f2ce94542 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:31.814249 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff520f7-2976-454b-9796-ccd966ca38ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:31.814851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff520f7-2976-454b-9796-ccd966ca38ab None admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:31.815134 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff520f7-2976-454b-9796-ccd966ca38ab None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:31.815412 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff520f7-2976-454b-9796-ccd966ca38ab None admin] PATH_INFO: `/v3/projects/c4d7c29a2b144df6afa96fd6894254a4/users/9bb16e4960af4c03bc274dea6bea2e1a/roles/a22f1a3785a746048e38205d1996764b` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:31.834934 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff520f7-2976-454b-9796-ccd966ca38ab None admin] RBAC: Authorizing `identity:create_grant(project_id=c4d7c29a2b144df6afa96fd6894254a4, user_id=9bb16e4960af4c03bc274dea6bea2e1a, role_id=a22f1a3785a746048e38205d1996764b)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:31.836706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff520f7-2976-454b-9796-ccd966ca38ab None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:31.866370 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 299/609] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 04:39:31 2022] PUT /identity/v3/projects/c4d7c29a2b144df6afa96fd6894254a4/users/9bb16e4960af4c03bc274dea6bea2e1a/roles/a22f1a3785a746048e38205d1996764b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:39:31.867346 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff520f7-2976-454b-9796-ccd966ca38ab None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:31.894137 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:31.895593 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8688ec-0161-49fb-8c57-bd4f2ce94542 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:31.975836 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d27e74-ea25-49d0-aef0-8dae2a747c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:31.976915 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d27e74-ea25-49d0-aef0-8dae2a747c5f None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:31.977520 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d27e74-ea25-49d0-aef0-8dae2a747c5f None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:31.978765 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d27e74-ea25-49d0-aef0-8dae2a747c5f None admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:31.979820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d27e74-ea25-49d0-aef0-8dae2a747c5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:31.980233 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d27e74-ea25-49d0-aef0-8dae2a747c5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:31.981877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d27e74-ea25-49d0-aef0-8dae2a747c5f None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:31.998189 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 311/610] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:39:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:32.005556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d27e74-ea25-49d0-aef0-8dae2a747c5f None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:32.089022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff520f7-2976-454b-9796-ccd966ca38ab None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:32.101388 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:32.136319 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d0318-b92f-4b0f-9681-3a9cb2d98a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:32.136995 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d0318-b92f-4b0f-9681-3a9cb2d98a1d None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:32.137273 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d0318-b92f-4b0f-9681-3a9cb2d98a1d None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:32.137541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d0318-b92f-4b0f-9681-3a9cb2d98a1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:32.161878 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d0318-b92f-4b0f-9681-3a9cb2d98a1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:32.163648 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d0318-b92f-4b0f-9681-3a9cb2d98a1d None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:32.178142 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d27e74-ea25-49d0-aef0-8dae2a747c5f None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:32.195532 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-4b2d0318-b92f-4b0f-9681-3a9cb2d98a1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:32.195532 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:32.195532 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:32.195532 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:32.195532 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:32.195532 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:32.195532 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:32.195532 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:32.195532 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:32.195532 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:32.195532 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:32.195532 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:32.195532 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:32.195532 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:32.195532 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:32.196900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:32.196900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:32.196900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:32.196900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:32.196900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:32.196900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:32.196900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:32.196900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:32.196900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:32.196900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:32.196900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:32.196900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:32.196900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:32.196900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:32.196900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:32.196900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:32.196900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:32.197779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:32.197779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:32.197779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:32.197779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:32.197779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 300/611] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:32.207009 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d0318-b92f-4b0f-9681-3a9cb2d98a1d None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:32.228767 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4db22c-2a6a-40bb-882b-f37cfd5e1d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:32.229558 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4db22c-2a6a-40bb-882b-f37cfd5e1d76 None admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:32.229844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4db22c-2a6a-40bb-882b-f37cfd5e1d76 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:32.230180 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4db22c-2a6a-40bb-882b-f37cfd5e1d76 None admin] PATH_INFO: `/v3/projects/c4d7c29a2b144df6afa96fd6894254a4/users/74fee029d5214ce18b4b9ddc2df72a23/roles/a22f1a3785a746048e38205d1996764b` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:32.262152 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4db22c-2a6a-40bb-882b-f37cfd5e1d76 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4d7c29a2b144df6afa96fd6894254a4, user_id=74fee029d5214ce18b4b9ddc2df72a23, role_id=a22f1a3785a746048e38205d1996764b)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:32.266579 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4db22c-2a6a-40bb-882b-f37cfd5e1d76 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:32.295998 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:32.309857 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 312/612] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 04:39:32 2022] PUT /identity/v3/projects/c4d7c29a2b144df6afa96fd6894254a4/users/74fee029d5214ce18b4b9ddc2df72a23/roles/a22f1a3785a746048e38205d1996764b => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:39:32.339230 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d0318-b92f-4b0f-9681-3a9cb2d98a1d None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:32.376945 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d3c1c-1d07-4723-8a88-f70f04c5fede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:32.377890 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d3c1c-1d07-4723-8a88-f70f04c5fede None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:32.378418 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d3c1c-1d07-4723-8a88-f70f04c5fede None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:32.378832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d3c1c-1d07-4723-8a88-f70f04c5fede None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:32.379756 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d3c1c-1d07-4723-8a88-f70f04c5fede None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:32.380227 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d3c1c-1d07-4723-8a88-f70f04c5fede None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:32.381791 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d3c1c-1d07-4723-8a88-f70f04c5fede None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:32.409607 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 301/613] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:32.411162 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4db22c-2a6a-40bb-882b-f37cfd5e1d76 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:32.559345 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4db22c-2a6a-40bb-882b-f37cfd5e1d76 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:32.562330 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:32.600588 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42e67ca-ddc6-4c04-84e3-a3dc13242d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:32.601165 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e67ca-ddc6-4c04-84e3-a3dc13242d38 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:32.601441 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e67ca-ddc6-4c04-84e3-a3dc13242d38 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:32.601711 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e67ca-ddc6-4c04-84e3-a3dc13242d38 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:32.609719 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e67ca-ddc6-4c04-84e3-a3dc13242d38 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:32.611250 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42e67ca-ddc6-4c04-84e3-a3dc13242d38 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:32.626936 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-a42e67ca-ddc6-4c04-84e3-a3dc13242d38 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 04:39:32.626936 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:32.626936 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:32.626936 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:32.626936 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:32.626936 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:32.626936 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:32.626936 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:32.626936 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:32.626936 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:32.626936 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:32.626936 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:32.626936 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:39:32.626936 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:39:32.626936 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:39:32.626936 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:39:32.627927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:32.627927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:32.627927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:39:32.627927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:32.627927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:39:32.627927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:32.627927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:32.627927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:32.627927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:32.627927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:32.627927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:32.627927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:32.627927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:32.627927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:32.627927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:32.627927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:32.627927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:32.627927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:32.628919 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:32.628919 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:32.628919 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:39:32.628919 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:39:32.628919 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:39:32.628919 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:39:32.628919 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:39:32.628919 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:39:32.628919 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 04:39:32.628919 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:32.628919 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 313/614] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:39:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:32.635423 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d3c1c-1d07-4723-8a88-f70f04c5fede None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:32.758402 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d3c1c-1d07-4723-8a88-f70f04c5fede None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:32.796300 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:32.800294 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832c18c-dcd1-4792-92c1-6818c9ea34c3 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:32.800657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832c18c-dcd1-4792-92c1-6818c9ea34c3 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:32.800938 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832c18c-dcd1-4792-92c1-6818c9ea34c3 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:32.802700 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 314/615] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:39:32.807429 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d3783-8acc-4509-bf42-e5cf8d6144ea None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:32.807822 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d3783-8acc-4509-bf42-e5cf8d6144ea None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:32.808299 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d3783-8acc-4509-bf42-e5cf8d6144ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:32.811703 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc1e25-af5e-4514-add7-e9958feb45b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:32.812339 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc1e25-af5e-4514-add7-e9958feb45b0 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:32.812619 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc1e25-af5e-4514-add7-e9958feb45b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:32.812888 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc1e25-af5e-4514-add7-e9958feb45b0 None admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:32.813686 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc1e25-af5e-4514-add7-e9958feb45b0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:32.814013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc1e25-af5e-4514-add7-e9958feb45b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:32.815500 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdc1e25-af5e-4514-add7-e9958feb45b0 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:32.830141 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-886d3783-8acc-4509-bf42-e5cf8d6144ea None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:32.832117 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-886d3783-8acc-4509-bf42-e5cf8d6144ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:32.845650 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 302/616] 10.222.0.39 () {56 vars in 1135 bytes} [Tue Jul 26 04:39:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:32.852213 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc1e25-af5e-4514-add7-e9958feb45b0 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:32.938106 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 315/617] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:32.978912 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d3783-8acc-4509-bf42-e5cf8d6144ea None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:33.046432 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdc1e25-af5e-4514-add7-e9958feb45b0 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:33.087956 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17552403-c706-461c-b8c2-bb91b23ec3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:33.088611 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17552403-c706-461c-b8c2-bb91b23ec3df None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:33.088890 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17552403-c706-461c-b8c2-bb91b23ec3df None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:33.089162 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17552403-c706-461c-b8c2-bb91b23ec3df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:33.100028 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17552403-c706-461c-b8c2-bb91b23ec3df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:33.101488 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17552403-c706-461c-b8c2-bb91b23ec3df None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:33.117735 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-17552403-c706-461c-b8c2-bb91b23ec3df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:33.117735 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:33.117735 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:33.117735 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:33.117735 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:33.117735 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:33.117735 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:33.117735 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:33.117735 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:33.117735 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:33.117735 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:33.117735 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:33.117735 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:33.117735 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:33.117735 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:33.118663 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:33.118663 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:33.118663 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:33.118663 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:33.118663 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:33.118663 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:33.118663 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:33.118663 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:33.118663 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:33.118663 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:33.118663 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:33.118663 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:33.118663 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:33.118663 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:33.118663 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:33.118663 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:33.118663 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:33.119568 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:33.119568 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:33.119568 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:33.119568 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:33.119568 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 303/618] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:39:33.125051 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17552403-c706-461c-b8c2-bb91b23ec3df None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:33.170525 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:33.192393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:33.217343 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d3783-8acc-4509-bf42-e5cf8d6144ea None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:33.284904 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17552403-c706-461c-b8c2-bb91b23ec3df None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:33.293177 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de062e93-3099-4b50-b75a-edf12eedba09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:33.293848 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de062e93-3099-4b50-b75a-edf12eedba09 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:33.294159 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de062e93-3099-4b50-b75a-edf12eedba09 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:33.294452 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de062e93-3099-4b50-b75a-edf12eedba09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:33.317256 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de062e93-3099-4b50-b75a-edf12eedba09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:33.327544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-de062e93-3099-4b50-b75a-edf12eedba09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:33.327544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:33.327544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:33.327544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:33.327544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:33.327544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:33.327544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:33.327544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:33.327544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:33.327544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:33.327544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:33.327544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:33.327544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:33.327544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:33.327544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:33.327544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:33.328575 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:33.328575 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:33.328575 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:33.328575 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:33.328575 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:33.328575 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:33.328575 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:33.328575 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:33.328575 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:33.328575 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:33.328575 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:33.328575 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:33.328575 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:33.328575 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:33.328575 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:33.328575 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:33.329559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:33.329559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:33.329559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:33.329559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:33.329559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:33.329559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:33.329559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:33.329559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:33.329559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:33.329559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:33.329559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:33.329559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:33.329559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 316/619] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 04:39:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:39:33.335943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de062e93-3099-4b50-b75a-edf12eedba09 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:33.338225 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6af6ca-59ae-4a22-a8f9-0c9c80c4b167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:33.338870 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6af6ca-59ae-4a22-a8f9-0c9c80c4b167 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:33.339145 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6af6ca-59ae-4a22-a8f9-0c9c80c4b167 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:33.339415 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6af6ca-59ae-4a22-a8f9-0c9c80c4b167 None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:33.340121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6af6ca-59ae-4a22-a8f9-0c9c80c4b167 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:33.340421 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6af6ca-59ae-4a22-a8f9-0c9c80c4b167 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:33.341827 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6af6ca-59ae-4a22-a8f9-0c9c80c4b167 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:33.375027 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 304/620] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:39:33.391705 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6af6ca-59ae-4a22-a8f9-0c9c80c4b167 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:33.474955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de062e93-3099-4b50-b75a-edf12eedba09 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:33.518851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d57137-f589-43d5-b843-c6a64fed4a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:33.519470 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d57137-f589-43d5-b843-c6a64fed4a25 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:33.519752 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d57137-f589-43d5-b843-c6a64fed4a25 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:33.520027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d57137-f589-43d5-b843-c6a64fed4a25 None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:33.520761 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d57137-f589-43d5-b843-c6a64fed4a25 None admin] RBAC: Adding query filter params (name=service) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:33.521067 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d57137-f589-43d5-b843-c6a64fed4a25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:33.522522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d57137-f589-43d5-b843-c6a64fed4a25 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:33.538168 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 317/621] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 04:39:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:33.543615 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d57137-f589-43d5-b843-c6a64fed4a25 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:33.556249 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:33.560693 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:33.566007 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6af6ca-59ae-4a22-a8f9-0c9c80c4b167 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:33.627361 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dacd2b-bac9-497d-8f3c-4c5c1ad92f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:33.627996 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dacd2b-bac9-497d-8f3c-4c5c1ad92f88 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:33.628283 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dacd2b-bac9-497d-8f3c-4c5c1ad92f88 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:33.628554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dacd2b-bac9-497d-8f3c-4c5c1ad92f88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:33.636298 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dacd2b-bac9-497d-8f3c-4c5c1ad92f88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:33.637901 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dacd2b-bac9-497d-8f3c-4c5c1ad92f88 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:33.650452 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-70dacd2b-bac9-497d-8f3c-4c5c1ad92f88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:33.650452 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:33.650452 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:33.650452 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:33.650452 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:33.650452 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:33.650452 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:33.650452 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:33.650452 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:33.650452 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:33.650452 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:33.650452 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:33.650452 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:39:33.650452 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:39:33.650452 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:39:33.651407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:39:33.651407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:33.651407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:33.651407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:33.651407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:33.651407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:33.651407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:33.651407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:33.651407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:33.651407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:33.651407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:33.651407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:33.651407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:33.651407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:33.651407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:33.651407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:33.651407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:33.652700 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:39:33.652700 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:39:33.652700 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:39:33.652700 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:39:33.652700 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:39:33.652700 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:39:33.652700 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:33.652700 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:33.652700 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 305/622] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:39:33.653218 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3026b-7cea-4ae2-9ca8-b340aa689cc2 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:33.653503 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3026b-7cea-4ae2-9ca8-b340aa689cc2 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:33.654640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3026b-7cea-4ae2-9ca8-b340aa689cc2 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:33.659490 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 306/623] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:33.660306 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3026b-7cea-4ae2-9ca8-b340aa689cc2 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:33.677800 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d57137-f589-43d5-b843-c6a64fed4a25 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:33.713158 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e9901c-e948-46c5-87ae-473d84f0a39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:33.713813 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9901c-e948-46c5-87ae-473d84f0a39d None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:33.714125 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9901c-e948-46c5-87ae-473d84f0a39d None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:33.714400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e9901c-e948-46c5-87ae-473d84f0a39d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:33.726559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e9901c-e948-46c5-87ae-473d84f0a39d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:33.728127 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e9901c-e948-46c5-87ae-473d84f0a39d None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:33.743767 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-59e9901c-e948-46c5-87ae-473d84f0a39d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:33.743767 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:33.743767 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:33.743767 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:33.743767 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:33.743767 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:33.743767 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:33.743767 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:33.743767 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:33.743767 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:33.743767 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:33.743767 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:33.743767 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:33.743767 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:33.743767 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:33.744776 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:33.744776 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:33.744776 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:33.744776 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:33.744776 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:33.744776 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:33.744776 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:33.744776 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:33.744776 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:33.744776 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:33.744776 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:33.744776 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:33.744776 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:33.744776 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:33.744776 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:33.744776 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:33.744776 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:33.746751 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:33.746751 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:33.746751 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:33.746751 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:33.746751 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 318/624] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:39:33.746751 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694abc17-55fe-4e71-9277-026e87c2cf52 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:33.747622 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694abc17-55fe-4e71-9277-026e87c2cf52 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:33.747622 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694abc17-55fe-4e71-9277-026e87c2cf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:33.771458 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-694abc17-55fe-4e71-9277-026e87c2cf52 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:33.771804 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3026b-7cea-4ae2-9ca8-b340aa689cc2 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:33.772683 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-694abc17-55fe-4e71-9277-026e87c2cf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:33.811241 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205f6e8-10b4-4ad5-ad84-ae76caca6706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:33.811879 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205f6e8-10b4-4ad5-ad84-ae76caca6706 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:33.812158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205f6e8-10b4-4ad5-ad84-ae76caca6706 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:33.812433 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b205f6e8-10b4-4ad5-ad84-ae76caca6706 None admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:33.813185 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205f6e8-10b4-4ad5-ad84-ae76caca6706 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:33.813544 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205f6e8-10b4-4ad5-ad84-ae76caca6706 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:33.815095 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b205f6e8-10b4-4ad5-ad84-ae76caca6706 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:33.829310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 307/625] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:39:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:33.830202 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205f6e8-10b4-4ad5-ad84-ae76caca6706 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:33.835004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:33.854001 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 319/626] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:33.854001 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694abc17-55fe-4e71-9277-026e87c2cf52 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:33.861340 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:33.967928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b205f6e8-10b4-4ad5-ad84-ae76caca6706 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:33.971432 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694abc17-55fe-4e71-9277-026e87c2cf52 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:34.006079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c7843-b215-4400-b4e0-851b19f99d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:34.007532 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c7843-b215-4400-b4e0-851b19f99d77 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:34.008165 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c7843-b215-4400-b4e0-851b19f99d77 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:34.008776 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c7843-b215-4400-b4e0-851b19f99d77 None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:34.009996 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f993fa-2f77-4dbb-ad6b-00ea997cb7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:34.010262 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c7843-b215-4400-b4e0-851b19f99d77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:34.010689 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f993fa-2f77-4dbb-ad6b-00ea997cb7c5 None admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:34.010867 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c7843-b215-4400-b4e0-851b19f99d77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:34.010978 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f993fa-2f77-4dbb-ad6b-00ea997cb7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:34.011231 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f993fa-2f77-4dbb-ad6b-00ea997cb7c5 None admin] PATH_INFO: `/v3/projects/c4d7c29a2b144df6afa96fd6894254a4/users/0e089e39e9de419b9e2fb1d7fc2d245a/roles/a22f1a3785a746048e38205d1996764b` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:34.012756 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c7843-b215-4400-b4e0-851b19f99d77 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:34.026195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 308/627] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:34.026754 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f993fa-2f77-4dbb-ad6b-00ea997cb7c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4d7c29a2b144df6afa96fd6894254a4, user_id=0e089e39e9de419b9e2fb1d7fc2d245a, role_id=a22f1a3785a746048e38205d1996764b)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:34.027574 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c7843-b215-4400-b4e0-851b19f99d77 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:34.028300 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f993fa-2f77-4dbb-ad6b-00ea997cb7c5 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:34.043233 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 320/628] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 04:39:33 2022] PUT /identity/v3/projects/c4d7c29a2b144df6afa96fd6894254a4/users/0e089e39e9de419b9e2fb1d7fc2d245a/roles/a22f1a3785a746048e38205d1996764b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:39:34.044163 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f993fa-2f77-4dbb-ad6b-00ea997cb7c5 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:34.097186 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:34.127382 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:34.153905 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c7843-b215-4400-b4e0-851b19f99d77 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:34.200297 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a19ad3-58d4-4151-b283-47ac4780addc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:34.203686 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a19ad3-58d4-4151-b283-47ac4780addc None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:34.204697 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a19ad3-58d4-4151-b283-47ac4780addc None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:34.206455 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a19ad3-58d4-4151-b283-47ac4780addc None admin] PATH_INFO: `/v3/roles/service` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:34.214826 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f993fa-2f77-4dbb-ad6b-00ea997cb7c5 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:34.233860 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a19ad3-58d4-4151-b283-47ac4780addc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:34.240360 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-e7a19ad3-58d4-4151-b283-47ac4780addc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:34.240360 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:34.240360 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:34.240360 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:34.240360 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:34.240360 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:34.240360 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:34.240360 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:34.240360 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:34.240360 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:34.240360 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:34.240360 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:34.240360 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:34.240360 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:34.240360 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:34.240360 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:34.241498 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:34.241498 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:34.241498 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:34.241498 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:34.241498 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:34.241498 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:34.241498 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:34.241498 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:34.241498 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:34.241498 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:34.241498 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:34.241498 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:34.241498 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:34.241498 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:34.241498 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:34.241498 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:34.242449 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:34.242449 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:34.242449 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:34.242449 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:34.242449 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:34.242449 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:34.242449 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:34.242449 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:34.242449 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:34.242449 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:34.242449 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:34.242449 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:34.245393 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 309/629] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 04:39:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:34.251629 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a19ad3-58d4-4151-b283-47ac4780addc None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:34.314780 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a91290-83f4-405d-ab39-41c3e9088b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:34.315530 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a91290-83f4-405d-ab39-41c3e9088b23 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:34.315810 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a91290-83f4-405d-ab39-41c3e9088b23 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:34.316080 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a91290-83f4-405d-ab39-41c3e9088b23 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:34.324545 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a91290-83f4-405d-ab39-41c3e9088b23 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:34.326005 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a91290-83f4-405d-ab39-41c3e9088b23 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:34.347456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-50a91290-83f4-405d-ab39-41c3e9088b23 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 26 04:39:34.347456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:34.347456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:34.347456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:34.347456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:34.347456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:34.347456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:34.347456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:34.347456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:34.347456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:34.347456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:34.347456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:34.347456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:39:34.347456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:39:34.347456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:39:34.347456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:39:34.348481 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:34.348481 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:34.348481 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:39:34.348481 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:34.348481 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:39:34.348481 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:34.348481 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:34.348481 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:34.348481 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:34.348481 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:34.348481 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:34.348481 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:34.348481 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:34.348481 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:34.348481 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:34.348481 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:34.348481 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:34.348481 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:34.349450 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:34.349450 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:34.349450 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:39:34.349450 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:39:34.349450 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:39:34.349450 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:39:34.349450 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:39:34.349450 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:39:34.349450 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 26 04:39:34.349450 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:34.349450 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 321/630] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:39:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:34.359037 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a91290-83f4-405d-ab39-41c3e9088b23 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:34.373454 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a19ad3-58d4-4151-b283-47ac4780addc None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:34.411567 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e2980-34bf-46c5-be36-378ce29722a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:34.412607 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e2980-34bf-46c5-be36-378ce29722a0 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:34.413127 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e2980-34bf-46c5-be36-378ce29722a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:34.413703 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e2980-34bf-46c5-be36-378ce29722a0 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:34.414760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e2980-34bf-46c5-be36-378ce29722a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:34.415284 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e2980-34bf-46c5-be36-378ce29722a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:34.417018 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e2980-34bf-46c5-be36-378ce29722a0 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:34.423060 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:34.428117 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 310/631] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 04:39:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:39:34.429715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abadaa3-6408-4c61-b71d-b9aee749c52b None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:34.434514 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abadaa3-6408-4c61-b71d-b9aee749c52b None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:34.434862 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abadaa3-6408-4c61-b71d-b9aee749c52b None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:34.436284 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 311/632] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:34.440747 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abadaa3-6408-4c61-b71d-b9aee749c52b None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:34.477670 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a91290-83f4-405d-ab39-41c3e9088b23 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:34.479289 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:34.513273 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf4600-80b4-4a21-b18b-779bab9ac318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:34.513819 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf4600-80b4-4a21-b18b-779bab9ac318 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:34.514160 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf4600-80b4-4a21-b18b-779bab9ac318 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:34.514503 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf4600-80b4-4a21-b18b-779bab9ac318 None admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:34.515228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf4600-80b4-4a21-b18b-779bab9ac318 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:34.515533 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf4600-80b4-4a21-b18b-779bab9ac318 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:34.517062 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf4600-80b4-4a21-b18b-779bab9ac318 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:34.540112 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 322/633] 10.222.0.39 () {56 vars in 1137 bytes} [Tue Jul 26 04:39:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:34.541508 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb9f0e-34f3-4ffe-9a54-7f381367a416 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:34.541794 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb9f0e-34f3-4ffe-9a54-7f381367a416 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:34.542093 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb9f0e-34f3-4ffe-9a54-7f381367a416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:34.560928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abadaa3-6408-4c61-b71d-b9aee749c52b None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:34.566380 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-09fb9f0e-34f3-4ffe-9a54-7f381367a416 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:34.567614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-09fb9f0e-34f3-4ffe-9a54-7f381367a416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:34.599017 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b9847-ae4d-47de-a7af-7a83e3eacd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:34.600073 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b9847-ae4d-47de-a7af-7a83e3eacd27 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:34.600559 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b9847-ae4d-47de-a7af-7a83e3eacd27 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:34.601029 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b9847-ae4d-47de-a7af-7a83e3eacd27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:34.612914 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b9847-ae4d-47de-a7af-7a83e3eacd27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:34.614874 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b9847-ae4d-47de-a7af-7a83e3eacd27 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:34.631115 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-6b6b9847-ae4d-47de-a7af-7a83e3eacd27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:34.631115 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:34.631115 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:34.631115 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:34.631115 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:34.631115 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:34.631115 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:34.631115 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:34.631115 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:34.631115 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:34.631115 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:34.631115 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:34.631115 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:34.631115 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:34.631115 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:34.632079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:34.632079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:34.632079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:34.632079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:34.632079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:34.632079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:34.632079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:34.632079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:34.632079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:34.632079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:34.632079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:34.632079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:34.632079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:34.632079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:34.632079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:34.632079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:34.632079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:34.632979 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:34.632979 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:34.632979 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:34.632979 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:34.639613 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 312/634] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:34.639613 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b9847-ae4d-47de-a7af-7a83e3eacd27 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:34.644842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 323/635] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:34.648338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb9f0e-34f3-4ffe-9a54-7f381367a416 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:34.713931 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:34.765294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b9847-ae4d-47de-a7af-7a83e3eacd27 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:34.780863 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:34.794912 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb9f0e-34f3-4ffe-9a54-7f381367a416 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:34.803771 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbceb2a9-9bca-42ab-8071-2f602438c1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:34.804400 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbceb2a9-9bca-42ab-8071-2f602438c1dc None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:34.804673 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbceb2a9-9bca-42ab-8071-2f602438c1dc None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:34.804940 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbceb2a9-9bca-42ab-8071-2f602438c1dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:34.846767 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08a229-2669-4734-90ad-3bf85b501b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:34.847788 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08a229-2669-4734-90ad-3bf85b501b80 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:34.848828 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08a229-2669-4734-90ad-3bf85b501b80 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:34.849333 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08a229-2669-4734-90ad-3bf85b501b80 None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:34.850277 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08a229-2669-4734-90ad-3bf85b501b80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:34.850808 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08a229-2669-4734-90ad-3bf85b501b80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:34.853286 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c08a229-2669-4734-90ad-3bf85b501b80 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:34.874402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 324/636] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:34.877016 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08a229-2669-4734-90ad-3bf85b501b80 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:34.885592 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbceb2a9-9bca-42ab-8071-2f602438c1dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:34.887111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbceb2a9-9bca-42ab-8071-2f602438c1dc None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:34.940872 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:34.988919 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c08a229-2669-4734-90ad-3bf85b501b80 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:35.002195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 313/637] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:39:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:35.003124 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbceb2a9-9bca-42ab-8071-2f602438c1dc None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:35.028213 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fd506-1d16-4f56-9a5a-6758f701aa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:35.028793 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fd506-1d16-4f56-9a5a-6758f701aa7e None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:35.029068 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fd506-1d16-4f56-9a5a-6758f701aa7e None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:35.029412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fd506-1d16-4f56-9a5a-6758f701aa7e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:35.039528 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fd506-1d16-4f56-9a5a-6758f701aa7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:35.044822 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-8e6fd506-1d16-4f56-9a5a-6758f701aa7e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:35.044822 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:35.044822 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:35.044822 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:35.044822 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:35.044822 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:35.044822 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:35.044822 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:35.044822 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:35.044822 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:35.044822 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:35.044822 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:35.044822 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:35.044822 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:35.044822 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:35.044822 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:35.045764 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:35.045764 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:35.045764 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:35.045764 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:35.045764 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:35.045764 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:35.045764 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:35.045764 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:35.045764 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:35.045764 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:35.045764 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:35.045764 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:35.045764 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:35.045764 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:35.045764 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:35.045764 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:35.047229 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:35.047229 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:35.047229 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:35.047229 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:35.047229 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:35.047229 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:35.047229 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:35.047229 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:35.047229 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:35.047229 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:35.047229 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:35.047229 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:35.047229 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 325/638] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 04:39:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:35.047229 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f370eb-efa4-44c0-96ab-178ce317f8d3 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:35.048072 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f370eb-efa4-44c0-96ab-178ce317f8d3 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:35.048072 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f370eb-efa4-44c0-96ab-178ce317f8d3 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:35.052938 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 326/639] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:35.053708 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f370eb-efa4-44c0-96ab-178ce317f8d3 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:35.067340 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:35.117357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbceb2a9-9bca-42ab-8071-2f602438c1dc None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:35.153968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037286a-7250-4864-9be2-b7ef9322d9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:35.154941 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037286a-7250-4864-9be2-b7ef9322d9b6 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:35.155048 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037286a-7250-4864-9be2-b7ef9322d9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:35.155288 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037286a-7250-4864-9be2-b7ef9322d9b6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:35.158465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f370eb-efa4-44c0-96ab-178ce317f8d3 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:35.162980 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037286a-7250-4864-9be2-b7ef9322d9b6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:35.164574 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037286a-7250-4864-9be2-b7ef9322d9b6 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:35.177541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-1037286a-7250-4864-9be2-b7ef9322d9b6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 04:39:35.177541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:35.177541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:35.177541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:35.177541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:35.177541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:35.177541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:35.177541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:35.177541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:35.177541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:35.177541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:35.177541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:35.177541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:39:35.177541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:39:35.177541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:39:35.177541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:39:35.178718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:35.178718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:35.178718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:39:35.178718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:35.178718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:39:35.178718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:35.178718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:35.178718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:35.178718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:35.178718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:35.178718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:35.178718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:35.178718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:35.178718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:35.178718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:35.178718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:35.178718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:35.178718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:35.179891 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:35.179891 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:35.179891 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:39:35.179891 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:39:35.179891 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:39:35.179891 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:39:35.179891 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:39:35.179891 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:39:35.179891 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 04:39:35.179891 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:35.182121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 314/640] 10.222.0.39 () {56 vars in 1093 bytes} [Tue Jul 26 04:39:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:35.183139 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037286a-7250-4864-9be2-b7ef9322d9b6 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:35.197750 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49a9c5-c117-493f-ad8e-7d46a413e109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:35.198443 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49a9c5-c117-493f-ad8e-7d46a413e109 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:35.198723 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49a9c5-c117-493f-ad8e-7d46a413e109 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:35.198995 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49a9c5-c117-493f-ad8e-7d46a413e109 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:35.202192 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:35.209531 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49a9c5-c117-493f-ad8e-7d46a413e109 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:35.211019 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e49a9c5-c117-493f-ad8e-7d46a413e109 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:35.224982 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-5e49a9c5-c117-493f-ad8e-7d46a413e109 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:35.224982 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:35.224982 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:35.224982 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:35.224982 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:35.224982 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:35.224982 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:35.224982 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:35.224982 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:35.224982 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:35.224982 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:35.224982 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:35.224982 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:35.224982 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:35.224982 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:35.226439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:35.226439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:35.226439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:35.226439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:35.226439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:35.226439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:35.226439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:35.226439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:35.226439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:35.226439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:35.226439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:35.226439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:35.226439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:35.226439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:35.226439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:35.226439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:35.226439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:35.227383 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:35.227383 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:35.227383 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:35.227383 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:35.227383 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 327/641] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:35.228130 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e636d-9b45-4d6c-a9cb-002d2f9f45fd None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:35.228130 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e636d-9b45-4d6c-a9cb-002d2f9f45fd None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:35.228282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e636d-9b45-4d6c-a9cb-002d2f9f45fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:35.246543 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-6d6e636d-9b45-4d6c-a9cb-002d2f9f45fd None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:35.247759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-6d6e636d-9b45-4d6c-a9cb-002d2f9f45fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:35.299086 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037286a-7250-4864-9be2-b7ef9322d9b6 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:35.318671 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:35.341999 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 328/642] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:35.341999 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e636d-9b45-4d6c-a9cb-002d2f9f45fd None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:35.345797 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50d3fa-88ec-4c16-90c3-f5948c3dc946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:35.346626 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50d3fa-88ec-4c16-90c3-f5948c3dc946 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:35.346975 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50d3fa-88ec-4c16-90c3-f5948c3dc946 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:35.347315 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50d3fa-88ec-4c16-90c3-f5948c3dc946 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:35.348106 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a50d3fa-88ec-4c16-90c3-f5948c3dc946 None admin] RBAC: Adding query filter params (name=service) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:35.348688 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a50d3fa-88ec-4c16-90c3-f5948c3dc946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:35.350223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a50d3fa-88ec-4c16-90c3-f5948c3dc946 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:35.365779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 315/643] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 04:39:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:35.365779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50d3fa-88ec-4c16-90c3-f5948c3dc946 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:35.443392 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:35.444494 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e636d-9b45-4d6c-a9cb-002d2f9f45fd None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:35.472142 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50d3fa-88ec-4c16-90c3-f5948c3dc946 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:35.480181 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb04d27-2ed7-4be1-b863-a77a53606737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:35.480931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb04d27-2ed7-4be1-b863-a77a53606737 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:35.481306 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb04d27-2ed7-4be1-b863-a77a53606737 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:35.481674 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb04d27-2ed7-4be1-b863-a77a53606737 None admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:35.482604 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb04d27-2ed7-4be1-b863-a77a53606737 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:35.483025 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb04d27-2ed7-4be1-b863-a77a53606737 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:35.484582 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb04d27-2ed7-4be1-b863-a77a53606737 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:35.502939 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 329/644] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Jul 26 04:39:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:35.503966 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb04d27-2ed7-4be1-b863-a77a53606737 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:35.512937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4288a9-fddd-4aa6-806f-761eed577208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:35.513763 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4288a9-fddd-4aa6-806f-761eed577208 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:35.514166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4288a9-fddd-4aa6-806f-761eed577208 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:35.514536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4288a9-fddd-4aa6-806f-761eed577208 None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:35.515502 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4288a9-fddd-4aa6-806f-761eed577208 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:35.515832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4288a9-fddd-4aa6-806f-761eed577208 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:35.517421 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4288a9-fddd-4aa6-806f-761eed577208 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:35.535110 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 316/645] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:35.535110 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4288a9-fddd-4aa6-806f-761eed577208 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:35.561719 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:35.613659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb04d27-2ed7-4be1-b863-a77a53606737 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:35.640032 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4288a9-fddd-4aa6-806f-761eed577208 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:35.650279 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08f041-f446-4521-ad4a-7ba66e31fe58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:35.651127 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08f041-f446-4521-ad4a-7ba66e31fe58 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:35.651419 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08f041-f446-4521-ad4a-7ba66e31fe58 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:35.651685 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08f041-f446-4521-ad4a-7ba66e31fe58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:35.662113 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08f041-f446-4521-ad4a-7ba66e31fe58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:35.666973 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-cc08f041-f446-4521-ad4a-7ba66e31fe58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:35.666973 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:35.666973 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:35.666973 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:35.666973 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:35.666973 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:35.666973 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:35.666973 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:35.666973 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:35.666973 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:35.666973 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:35.666973 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:35.666973 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:35.666973 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:35.666973 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:35.666973 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:35.667902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:35.667902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:35.667902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:35.667902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:35.667902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:35.667902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:35.667902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:35.667902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:35.667902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:35.667902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:35.667902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:35.667902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:35.667902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:35.667902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:35.667902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:35.667902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:35.668883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:35.668883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:35.668883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:35.668883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:35.668883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:35.668883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:35.668883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:35.668883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:35.668883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:35.668883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:35.668883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:35.668883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:35.668883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 330/646] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 04:39:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:35.669851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08f041-f446-4521-ad4a-7ba66e31fe58 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:35.687950 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde08ce9-6245-4a51-b52d-9a644b9c8597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:35.688953 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde08ce9-6245-4a51-b52d-9a644b9c8597 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:35.689294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde08ce9-6245-4a51-b52d-9a644b9c8597 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:35.689767 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde08ce9-6245-4a51-b52d-9a644b9c8597 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:35.692428 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:35.703452 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde08ce9-6245-4a51-b52d-9a644b9c8597 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:35.705143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde08ce9-6245-4a51-b52d-9a644b9c8597 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:35.721247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-bde08ce9-6245-4a51-b52d-9a644b9c8597 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:35.721247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:35.721247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:35.721247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:35.721247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:35.721247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:35.721247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:35.721247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:35.721247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:35.721247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:35.721247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:35.721247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:35.721247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:35.721247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:35.721247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:35.722294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:35.722294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:35.722294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:35.722294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:35.722294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:35.722294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:35.722294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:35.722294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:35.722294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:35.722294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:35.722294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:35.722294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:35.722294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:35.722294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:35.722294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:35.722294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:35.722294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:35.723186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:35.723186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:35.723186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:35.723186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:35.723186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 317/647] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:35.723494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde08ce9-6245-4a51-b52d-9a644b9c8597 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:35.786304 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08f041-f446-4521-ad4a-7ba66e31fe58 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:35.798343 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:35.826987 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d642a6-b65b-4b8a-9811-452452f62212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:35.827616 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d642a6-b65b-4b8a-9811-452452f62212 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:35.827896 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d642a6-b65b-4b8a-9811-452452f62212 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:35.828179 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d642a6-b65b-4b8a-9811-452452f62212 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:35.830381 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde08ce9-6245-4a51-b52d-9a644b9c8597 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:35.865370 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79aeea-c708-4372-a5e4-339f0dc5ad5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:35.866040 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79aeea-c708-4372-a5e4-339f0dc5ad5f None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:35.866319 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79aeea-c708-4372-a5e4-339f0dc5ad5f None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:35.866584 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79aeea-c708-4372-a5e4-339f0dc5ad5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:35.873480 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79aeea-c708-4372-a5e4-339f0dc5ad5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:35.874956 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79aeea-c708-4372-a5e4-339f0dc5ad5f None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:35.886846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-8b79aeea-c708-4372-a5e4-339f0dc5ad5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:35.886846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:35.886846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:35.886846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:35.886846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:35.886846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:35.886846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:35.886846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:35.886846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:35.886846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:35.886846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:35.886846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:35.886846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:39:35.886846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:39:35.886846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:39:35.887811 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:39:35.887811 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:35.887811 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:35.887811 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:35.887811 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:35.887811 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:35.887811 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:35.887811 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:35.887811 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:35.887811 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:35.887811 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:35.887811 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:35.887811 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:35.887811 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:35.887811 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:35.887811 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:35.887811 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:35.888715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:39:35.888715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:39:35.888715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:39:35.888715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:39:35.888715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:39:35.888715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:39:35.888715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:35.888715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:35.892724 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 318/648] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:35.893603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79aeea-c708-4372-a5e4-339f0dc5ad5f None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:35.901491 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d642a6-b65b-4b8a-9811-452452f62212 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:35.903459 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d642a6-b65b-4b8a-9811-452452f62212 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:35.943099 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:36.002610 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79aeea-c708-4372-a5e4-339f0dc5ad5f None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:36.007363 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 331/649] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:39:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:36.008314 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d642a6-b65b-4b8a-9811-452452f62212 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:36.026841 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:36.045697 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6797336-794c-4e99-9075-106df78ba49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:36.046295 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6797336-794c-4e99-9075-106df78ba49d None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:36.046574 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6797336-794c-4e99-9075-106df78ba49d None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:36.046850 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6797336-794c-4e99-9075-106df78ba49d None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:36.047581 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6797336-794c-4e99-9075-106df78ba49d None admin] RBAC: Adding query filter params (name=service) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:36.047880 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6797336-794c-4e99-9075-106df78ba49d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:36.049273 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6797336-794c-4e99-9075-106df78ba49d None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:36.062726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 319/650] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 04:39:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:36.062726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6797336-794c-4e99-9075-106df78ba49d None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:36.125943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d642a6-b65b-4b8a-9811-452452f62212 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:36.160870 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed116bb-a927-4639-a03c-8ab9055f55cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:36.161500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed116bb-a927-4639-a03c-8ab9055f55cc None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:36.161618 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6797336-794c-4e99-9075-106df78ba49d None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:36.162073 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed116bb-a927-4639-a03c-8ab9055f55cc None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:36.162073 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed116bb-a927-4639-a03c-8ab9055f55cc None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:36.162758 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed116bb-a927-4639-a03c-8ab9055f55cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:36.163068 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed116bb-a927-4639-a03c-8ab9055f55cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:36.164490 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed116bb-a927-4639-a03c-8ab9055f55cc None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:36.171076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:36.178050 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 332/651] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:36.178050 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed116bb-a927-4639-a03c-8ab9055f55cc None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:36.204602 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c0444-06ed-4c41-936c-6b6a4f46ab10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:36.205234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c0444-06ed-4c41-936c-6b6a4f46ab10 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:36.205514 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c0444-06ed-4c41-936c-6b6a4f46ab10 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:36.205873 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c0444-06ed-4c41-936c-6b6a4f46ab10 None admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:36.206660 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c0444-06ed-4c41-936c-6b6a4f46ab10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:36.206973 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c0444-06ed-4c41-936c-6b6a4f46ab10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:36.208417 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c0444-06ed-4c41-936c-6b6a4f46ab10 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:36.220420 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 320/652] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:39:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:36.221217 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c0444-06ed-4c41-936c-6b6a4f46ab10 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:36.254038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:36.286917 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed116bb-a927-4639-a03c-8ab9055f55cc None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:36.321376 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834be16-2108-4bc4-889a-aa2aefeaf502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:36.321952 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834be16-2108-4bc4-889a-aa2aefeaf502 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:36.322265 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834be16-2108-4bc4-889a-aa2aefeaf502 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:36.322363 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c0444-06ed-4c41-936c-6b6a4f46ab10 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:36.322530 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834be16-2108-4bc4-889a-aa2aefeaf502 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:36.332969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834be16-2108-4bc4-889a-aa2aefeaf502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:36.334491 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834be16-2108-4bc4-889a-aa2aefeaf502 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:36.356136 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181aede-e905-42d9-b0a5-f31d77521a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:36.356779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181aede-e905-42d9-b0a5-f31d77521a5a None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:36.357056 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181aede-e905-42d9-b0a5-f31d77521a5a None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:36.357323 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181aede-e905-42d9-b0a5-f31d77521a5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:36.363456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-c834be16-2108-4bc4-889a-aa2aefeaf502 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:36.363456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:36.363456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:36.363456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:36.363456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:36.363456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:36.363456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:36.363456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:36.363456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:36.363456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:36.363456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:36.363456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:36.363456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:36.363456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:36.363456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:36.364511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:36.364511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:36.364511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:36.364511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:36.364511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:36.364511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:36.364511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:36.364511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:36.364511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:36.364511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:36.364511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:36.364511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:36.364511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:36.364511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:36.364511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:36.364511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:36.364511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:36.365737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:36.365737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:36.365737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:36.365737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:36.365737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 333/653] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:36.366252 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5888c-3419-4e0f-a82f-b7cbf22297c6 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:36.366533 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5888c-3419-4e0f-a82f-b7cbf22297c6 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:36.366834 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5888c-3419-4e0f-a82f-b7cbf22297c6 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:36.370108 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 334/654] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:36.370242 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5888c-3419-4e0f-a82f-b7cbf22297c6 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:36.371152 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181aede-e905-42d9-b0a5-f31d77521a5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:36.372852 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181aede-e905-42d9-b0a5-f31d77521a5a None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:36.389261 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-d181aede-e905-42d9-b0a5-f31d77521a5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:36.389261 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:36.389261 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:36.389261 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:36.389261 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:36.389261 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:36.389261 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:36.389261 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:36.389261 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:36.389261 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:36.389261 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:36.389261 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:36.389261 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:36.389261 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:36.389261 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:36.390520 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:36.390520 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:36.390520 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:36.390520 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:36.390520 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:36.390520 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:36.390520 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:36.390520 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:36.390520 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:36.390520 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:36.390520 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:36.390520 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:36.390520 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:36.390520 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:36.390520 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:36.390520 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:36.390520 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:36.391423 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:36.391423 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:36.391423 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:36.391423 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:36.391423 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 321/655] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:36.391717 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181aede-e905-42d9-b0a5-f31d77521a5a None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:36.416114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:36.480371 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5888c-3419-4e0f-a82f-b7cbf22297c6 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:36.494849 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181aede-e905-42d9-b0a5-f31d77521a5a None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:36.502645 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:36.515121 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107bd33-a82d-48bd-8edb-f37b640f6b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:36.515772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107bd33-a82d-48bd-8edb-f37b640f6b9c None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:36.516047 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107bd33-a82d-48bd-8edb-f37b640f6b9c None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:36.516317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107bd33-a82d-48bd-8edb-f37b640f6b9c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:36.524175 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107bd33-a82d-48bd-8edb-f37b640f6b9c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:36.525635 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107bd33-a82d-48bd-8edb-f37b640f6b9c None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:36.528348 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad750d7-6b95-4fe6-826a-4abe62d8af6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:36.528973 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad750d7-6b95-4fe6-826a-4abe62d8af6d None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:36.529261 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad750d7-6b95-4fe6-826a-4abe62d8af6d None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:36.529502 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad750d7-6b95-4fe6-826a-4abe62d8af6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:36.530323 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad750d7-6b95-4fe6-826a-4abe62d8af6d None admin] RBAC: Adding query filter params (role.id=a22f1a3785a746048e38205d1996764b, scope.project.id=c4d7c29a2b144df6afa96fd6894254a4, user.id=7cfbf2c03eb740ed8b72c4825cffc341) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:36.530632 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad750d7-6b95-4fe6-826a-4abe62d8af6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:36.532064 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad750d7-6b95-4fe6-826a-4abe62d8af6d None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:36.537004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-e107bd33-a82d-48bd-8edb-f37b640f6b9c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 04:39:36.537004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:36.537004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:36.537004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:36.537004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:36.537004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:36.537004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:36.537004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:36.537004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:36.537004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:36.537004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:36.537004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:36.537004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:39:36.537004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:39:36.537004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:39:36.537004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:39:36.549103 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:36.549103 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:36.549103 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:39:36.549103 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:36.549103 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:39:36.549103 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:36.549103 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:36.549103 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:36.549103 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:36.549103 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:36.549103 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:36.549103 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:36.549103 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:36.549103 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:36.549103 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:36.549103 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:36.549103 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:36.549103 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:36.550507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:36.550507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:36.550507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:39:36.550507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:39:36.550507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:39:36.550507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:39:36.550507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:39:36.550507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:39:36.550507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 04:39:36.550507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:36.551174 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 322/656] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:39:36 2022] GET /identity/v3/role_assignments?user.id=7cfbf2c03eb740ed8b72c4825cffc341&scope.project.id=c4d7c29a2b144df6afa96fd6894254a4&role.id=a22f1a3785a746048e38205d1996764b => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:36.551274 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 335/657] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:39:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:36.551360 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad750d7-6b95-4fe6-826a-4abe62d8af6d None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:36.551451 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea7083-1502-4c50-ab88-76076aeb0419 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:36.551451 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea7083-1502-4c50-ab88-76076aeb0419 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:36.551451 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea7083-1502-4c50-ab88-76076aeb0419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:36.571970 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-80ea7083-1502-4c50-ab88-76076aeb0419 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:36.573394 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-80ea7083-1502-4c50-ab88-76076aeb0419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:36.636284 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:36.654348 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad750d7-6b95-4fe6-826a-4abe62d8af6d None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:36.659057 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 336/658] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:36.660162 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea7083-1502-4c50-ab88-76076aeb0419 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:36.701325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0e0f8-4adc-488c-bfb9-30c574c31617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:36.702258 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0e0f8-4adc-488c-bfb9-30c574c31617 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:36.702603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0e0f8-4adc-488c-bfb9-30c574c31617 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:36.702884 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0e0f8-4adc-488c-bfb9-30c574c31617 None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:36.703649 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0e0f8-4adc-488c-bfb9-30c574c31617 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:36.703960 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0e0f8-4adc-488c-bfb9-30c574c31617 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:36.705996 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0e0f8-4adc-488c-bfb9-30c574c31617 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:36.719997 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 323/659] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:36.720924 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0e0f8-4adc-488c-bfb9-30c574c31617 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:36.793232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea7083-1502-4c50-ab88-76076aeb0419 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:36.807121 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:36.830344 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498724db-7022-4f12-9173-bb8a5f38ca49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:36.831143 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498724db-7022-4f12-9173-bb8a5f38ca49 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:36.831264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498724db-7022-4f12-9173-bb8a5f38ca49 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:36.831462 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498724db-7022-4f12-9173-bb8a5f38ca49 None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:36.832175 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498724db-7022-4f12-9173-bb8a5f38ca49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:36.832483 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498724db-7022-4f12-9173-bb8a5f38ca49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:36.833881 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498724db-7022-4f12-9173-bb8a5f38ca49 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:36.846460 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 337/660] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:36.847308 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498724db-7022-4f12-9173-bb8a5f38ca49 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:36.853091 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0e0f8-4adc-488c-bfb9-30c574c31617 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:36.892767 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c329bbe-850b-4cfa-82d0-eb85017a92c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:36.893679 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c329bbe-850b-4cfa-82d0-eb85017a92c6 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:36.893679 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c329bbe-850b-4cfa-82d0-eb85017a92c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:36.893997 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c329bbe-850b-4cfa-82d0-eb85017a92c6 None admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:36.894789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c329bbe-850b-4cfa-82d0-eb85017a92c6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:36.895099 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c329bbe-850b-4cfa-82d0-eb85017a92c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:36.896586 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c329bbe-850b-4cfa-82d0-eb85017a92c6 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:36.919727 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 324/661] 10.222.0.39 () {56 vars in 1137 bytes} [Tue Jul 26 04:39:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:36.920632 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c329bbe-850b-4cfa-82d0-eb85017a92c6 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:36.923494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:36.958478 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498724db-7022-4f12-9173-bb8a5f38ca49 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:36.996850 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75b0f2-cf70-4b7d-89a3-008e8a30366b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:36.998014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75b0f2-cf70-4b7d-89a3-008e8a30366b None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:36.998533 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75b0f2-cf70-4b7d-89a3-008e8a30366b None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:36.998904 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75b0f2-cf70-4b7d-89a3-008e8a30366b None admin] PATH_INFO: `/v3/roles/service` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:37.009688 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75b0f2-cf70-4b7d-89a3-008e8a30366b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:37.015799 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-6e75b0f2-cf70-4b7d-89a3-008e8a30366b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:37.015799 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:37.015799 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:37.015799 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:37.015799 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:37.015799 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:37.015799 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:37.015799 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:37.015799 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:37.015799 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:37.015799 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:37.015799 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:37.015799 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:37.015799 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:37.015799 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:37.015799 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:37.016748 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:37.016748 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:37.016748 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:37.016748 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:37.016748 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:37.016748 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:37.016748 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:37.016748 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:37.016748 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:37.016748 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:37.016748 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:37.016748 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:37.016748 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:37.016748 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:37.016748 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:37.016748 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:37.017578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:37.017578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:37.017578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:37.017578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:37.017578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:37.017578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:37.017578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:37.017578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:37.017578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:37.017578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:37.017578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:37.017578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:37.022465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 338/662] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 04:39:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:37.023355 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75b0f2-cf70-4b7d-89a3-008e8a30366b None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:37.031594 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c329bbe-850b-4cfa-82d0-eb85017a92c6 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:37.055745 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:37.071955 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813cce3-1266-41e3-b369-04a3ae62d644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:37.072609 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813cce3-1266-41e3-b369-04a3ae62d644 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:37.072897 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813cce3-1266-41e3-b369-04a3ae62d644 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:37.073174 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813cce3-1266-41e3-b369-04a3ae62d644 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:37.080412 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813cce3-1266-41e3-b369-04a3ae62d644 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:37.082276 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813cce3-1266-41e3-b369-04a3ae62d644 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:37.093760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-2813cce3-1266-41e3-b369-04a3ae62d644 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:37.093760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:37.093760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:37.093760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:37.093760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:37.093760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:37.093760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:37.093760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:37.093760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:37.093760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:37.093760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:37.093760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:37.093760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:39:37.093760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:39:37.093760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:39:37.094866 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:39:37.094866 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:37.094866 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:37.094866 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:37.094866 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:37.094866 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:37.094866 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:37.094866 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:37.094866 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:37.094866 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:37.094866 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:37.094866 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:37.094866 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:37.094866 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:37.094866 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:37.094866 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:37.094866 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:37.095895 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:39:37.095895 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:39:37.095895 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:39:37.095895 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:39:37.095895 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:39:37.095895 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:39:37.095895 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:37.095895 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:37.095895 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 325/663] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:37.095895 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813cce3-1266-41e3-b369-04a3ae62d644 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:37.131353 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75b0f2-cf70-4b7d-89a3-008e8a30366b None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:37.167748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:37.170119 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f364c1-eaeb-4973-972e-929e84b256a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:37.170692 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f364c1-eaeb-4973-972e-929e84b256a7 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:37.171085 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f364c1-eaeb-4973-972e-929e84b256a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:37.171384 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f364c1-eaeb-4973-972e-929e84b256a7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:37.180133 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f364c1-eaeb-4973-972e-929e84b256a7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:37.181728 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f364c1-eaeb-4973-972e-929e84b256a7 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:37.193084 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-61f364c1-eaeb-4973-972e-929e84b256a7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 04:39:37.193084 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:37.193084 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:37.193084 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:37.193084 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:37.193084 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:37.193084 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:37.193084 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:37.193084 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:37.193084 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:37.193084 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:37.193084 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:37.193084 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:39:37.193084 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:39:37.193084 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:39:37.193084 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:39:37.194324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:37.194324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:37.194324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:39:37.194324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:37.194324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:39:37.194324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:37.194324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:37.194324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:37.194324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:37.194324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:37.194324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:37.194324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:37.194324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:37.194324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:37.194324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:37.194324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:37.194324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:37.194324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:37.195320 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:37.195320 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:37.195320 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:39:37.195320 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:39:37.195320 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:39:37.195320 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:39:37.195320 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:39:37.195320 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:39:37.195320 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 26 04:39:37.195320 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:37.195320 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 339/664] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 04:39:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:37.195320 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f364c1-eaeb-4973-972e-929e84b256a7 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:37.215705 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813cce3-1266-41e3-b369-04a3ae62d644 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:37.251056 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421b676-0aae-4b66-935d-026127234ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:37.251677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421b676-0aae-4b66-935d-026127234ef9 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:37.251963 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421b676-0aae-4b66-935d-026127234ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:37.252237 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421b676-0aae-4b66-935d-026127234ef9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:37.308754 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:37.319702 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f364c1-eaeb-4973-972e-929e84b256a7 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:37.327847 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421b676-0aae-4b66-935d-026127234ef9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:37.329342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421b676-0aae-4b66-935d-026127234ef9 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:37.355541 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf1042-99d5-4e86-9b69-9888ce5463b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:37.356205 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf1042-99d5-4e86-9b69-9888ce5463b1 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:37.356422 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf1042-99d5-4e86-9b69-9888ce5463b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:37.356671 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf1042-99d5-4e86-9b69-9888ce5463b1 None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:37.357429 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf1042-99d5-4e86-9b69-9888ce5463b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:37.357732 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf1042-99d5-4e86-9b69-9888ce5463b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:37.359168 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf1042-99d5-4e86-9b69-9888ce5463b1 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:37.367851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 340/665] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 04:39:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:37.372982 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf1042-99d5-4e86-9b69-9888ce5463b1 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:37.396837 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:37.446168 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 326/666] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:39:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:37.448071 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421b676-0aae-4b66-935d-026127234ef9 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:37.478185 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf1042-99d5-4e86-9b69-9888ce5463b1 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:37.512437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b10bc-f638-4ccc-86ef-1f897cfe8b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:37.513073 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b10bc-f638-4ccc-86ef-1f897cfe8b35 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:37.513353 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b10bc-f638-4ccc-86ef-1f897cfe8b35 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:37.513618 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b10bc-f638-4ccc-86ef-1f897cfe8b35 None admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:37.514406 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b10bc-f638-4ccc-86ef-1f897cfe8b35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:37.514717 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b10bc-f638-4ccc-86ef-1f897cfe8b35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:37.516175 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b10bc-f638-4ccc-86ef-1f897cfe8b35 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:37.527923 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 341/667] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:39:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:37.528714 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b10bc-f638-4ccc-86ef-1f897cfe8b35 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:37.543937 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:37.568111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421b676-0aae-4b66-935d-026127234ef9 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:37.602649 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b46d44-bad3-40da-a109-fe5c0446e152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:37.603272 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b46d44-bad3-40da-a109-fe5c0446e152 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:37.603552 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b46d44-bad3-40da-a109-fe5c0446e152 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:37.603822 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b46d44-bad3-40da-a109-fe5c0446e152 None admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:37.604608 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b46d44-bad3-40da-a109-fe5c0446e152 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:37.604911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b46d44-bad3-40da-a109-fe5c0446e152 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:37.606429 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b46d44-bad3-40da-a109-fe5c0446e152 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:37.624563 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 327/668] 10.222.0.39 () {56 vars in 1139 bytes} [Tue Jul 26 04:39:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:37.625431 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b46d44-bad3-40da-a109-fe5c0446e152 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:37.639599 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b10bc-f638-4ccc-86ef-1f897cfe8b35 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:37.648143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:37.678152 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d4380-3ac2-422f-afa4-26c47ca3c66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:37.678919 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d4380-3ac2-422f-afa4-26c47ca3c66e None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:37.679137 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d4380-3ac2-422f-afa4-26c47ca3c66e None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:37.679406 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d4380-3ac2-422f-afa4-26c47ca3c66e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:37.689686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d4380-3ac2-422f-afa4-26c47ca3c66e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:37.691265 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d4380-3ac2-422f-afa4-26c47ca3c66e None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:37.707374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-e18d4380-3ac2-422f-afa4-26c47ca3c66e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:37.707374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:37.707374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:37.707374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:37.707374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:37.707374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:37.707374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:37.707374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:37.707374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:37.707374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:37.707374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:37.707374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:37.707374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:37.707374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:37.707374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:37.708404 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:37.708404 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:37.708404 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:37.708404 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:37.708404 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:37.708404 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:37.708404 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:37.708404 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:37.708404 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:37.708404 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:37.708404 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:37.708404 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:37.708404 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:37.708404 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:37.708404 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:37.708404 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:37.708404 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:37.714501 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:37.714501 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:37.714501 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:37.714501 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:37.714501 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 342/669] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:37.714501 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d4380-3ac2-422f-afa4-26c47ca3c66e None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:37.734456 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b46d44-bad3-40da-a109-fe5c0446e152 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:37.772021 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784b842-6e5c-41e9-ad97-903373b9d69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:37.772556 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784b842-6e5c-41e9-ad97-903373b9d69f None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:37.772855 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784b842-6e5c-41e9-ad97-903373b9d69f None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:37.773119 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3784b842-6e5c-41e9-ad97-903373b9d69f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:37.781414 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:37.786370 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784b842-6e5c-41e9-ad97-903373b9d69f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:37.787951 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3784b842-6e5c-41e9-ad97-903373b9d69f None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:37.804082 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-3784b842-6e5c-41e9-ad97-903373b9d69f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:37.804082 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:37.804082 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:37.804082 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:37.804082 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:37.804082 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:37.804082 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:37.804082 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:37.804082 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:37.804082 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:37.804082 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:37.804082 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:37.804082 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:37.804082 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:37.804082 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:37.805177 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:37.805177 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:37.805177 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:37.805177 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:37.805177 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:37.805177 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:37.805177 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:37.805177 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:37.805177 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:37.805177 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:37.805177 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:37.805177 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:37.805177 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:37.805177 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:37.805177 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:37.805177 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:37.805177 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:37.806138 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:37.806138 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:37.806138 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:37.806138 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:37.806138 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 328/670] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:37.806438 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784b842-6e5c-41e9-ad97-903373b9d69f None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:37.822060 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d4380-3ac2-422f-afa4-26c47ca3c66e None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:37.860668 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af46d2-eff9-4a88-be0f-05aaf128e9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:37.861088 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af46d2-eff9-4a88-be0f-05aaf128e9c9 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:37.861367 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af46d2-eff9-4a88-be0f-05aaf128e9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:37.861636 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af46d2-eff9-4a88-be0f-05aaf128e9c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:37.862550 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af46d2-eff9-4a88-be0f-05aaf128e9c9 None admin] RBAC: Adding query filter params (role.id=a22f1a3785a746048e38205d1996764b, scope.project.id=c4d7c29a2b144df6afa96fd6894254a4, user.id=ae8593e125da4b208dd100608aa2b462) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:37.862858 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af46d2-eff9-4a88-be0f-05aaf128e9c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:37.864380 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af46d2-eff9-4a88-be0f-05aaf128e9c9 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:37.870437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 343/671] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:39:37 2022] GET /identity/v3/role_assignments?user.id=ae8593e125da4b208dd100608aa2b462&scope.project.id=c4d7c29a2b144df6afa96fd6894254a4&role.id=a22f1a3785a746048e38205d1996764b => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:37.871036 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af46d2-eff9-4a88-be0f-05aaf128e9c9 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:37.891488 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:37.934789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3784b842-6e5c-41e9-ad97-903373b9d69f None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:37.989827 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b2d6e-9712-4771-9e9b-aa298a134a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:37.992564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b2d6e-9712-4771-9e9b-aa298a134a33 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:37.993707 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b2d6e-9712-4771-9e9b-aa298a134a33 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:37.994469 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b2d6e-9712-4771-9e9b-aa298a134a33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:37.998834 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af46d2-eff9-4a88-be0f-05aaf128e9c9 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:38.034283 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:38.043926 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737da003-5347-4ba7-9aa5-702a053b2d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:38.044866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737da003-5347-4ba7-9aa5-702a053b2d2c None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:38.045320 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737da003-5347-4ba7-9aa5-702a053b2d2c None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:38.045763 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737da003-5347-4ba7-9aa5-702a053b2d2c None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:38.046671 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737da003-5347-4ba7-9aa5-702a053b2d2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:38.047704 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737da003-5347-4ba7-9aa5-702a053b2d2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:38.049795 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737da003-5347-4ba7-9aa5-702a053b2d2c None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:38.067238 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 344/672] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:38.072986 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737da003-5347-4ba7-9aa5-702a053b2d2c None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:38.082817 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b2d6e-9712-4771-9e9b-aa298a134a33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:38.085285 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b2d6e-9712-4771-9e9b-aa298a134a33 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:38.173174 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:38.186505 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737da003-5347-4ba7-9aa5-702a053b2d2c None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:38.215680 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 329/673] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:39:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:38.216983 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b2d6e-9712-4771-9e9b-aa298a134a33 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:38.223005 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa768f-2bee-4952-a94b-ebac9712552c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:38.223716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa768f-2bee-4952-a94b-ebac9712552c None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:38.224065 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa768f-2bee-4952-a94b-ebac9712552c None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:38.224406 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa768f-2bee-4952-a94b-ebac9712552c None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:38.225173 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa768f-2bee-4952-a94b-ebac9712552c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:38.225545 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa768f-2bee-4952-a94b-ebac9712552c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:38.227064 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa768f-2bee-4952-a94b-ebac9712552c None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:38.245579 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 345/674] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:38.246732 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa768f-2bee-4952-a94b-ebac9712552c None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:38.317564 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:38.343027 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b2d6e-9712-4771-9e9b-aa298a134a33 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:38.383054 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa768f-2bee-4952-a94b-ebac9712552c None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:38.392771 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c82021-d33f-4126-8f37-169a5dc03aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:38.394194 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c82021-d33f-4126-8f37-169a5dc03aac None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:38.394685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c82021-d33f-4126-8f37-169a5dc03aac None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:38.395137 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c82021-d33f-4126-8f37-169a5dc03aac None admin] PATH_INFO: `/v3/users/swift` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:38.402935 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c82021-d33f-4126-8f37-169a5dc03aac None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:38.404628 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c82021-d33f-4126-8f37-169a5dc03aac None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:38.417617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-f7c82021-d33f-4126-8f37-169a5dc03aac None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 04:39:38.417617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:38.417617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:38.417617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:38.417617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:38.417617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:38.417617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:38.417617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:38.417617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:38.417617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:38.417617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:38.417617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:38.417617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:39:38.417617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:39:38.417617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:39:38.417617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:39:38.418676 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:38.418676 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:38.418676 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:39:38.418676 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:38.418676 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:39:38.418676 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:38.418676 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:38.418676 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:38.418676 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:38.418676 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:38.418676 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:38.418676 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:38.418676 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:38.418676 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:38.418676 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:38.418676 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:38.418676 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:38.418676 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:38.419633 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:38.419633 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:38.419633 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:39:38.419633 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:39:38.419633 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:39:38.419633 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:39:38.419633 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:39:38.419633 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:39:38.419633 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 04:39:38.419633 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:38.421351 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 330/675] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:39:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:38.422066 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c82021-d33f-4126-8f37-169a5dc03aac None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:38.425435 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f4b1d-db11-432d-b192-9a3afe4620d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:38.426333 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f4b1d-db11-432d-b192-9a3afe4620d7 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:38.426823 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f4b1d-db11-432d-b192-9a3afe4620d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:38.427274 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f4b1d-db11-432d-b192-9a3afe4620d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:38.442250 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f4b1d-db11-432d-b192-9a3afe4620d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:38.444573 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f4b1d-db11-432d-b192-9a3afe4620d7 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:38.468056 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:38.470968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-823f4b1d-db11-432d-b192-9a3afe4620d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:38.470968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:38.470968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:38.470968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:38.470968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:38.470968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:38.470968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:38.470968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:38.470968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:38.470968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:38.470968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:38.470968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:38.470968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:38.470968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:38.470968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:38.471935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:38.471935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:38.471935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:38.471935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:38.471935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:38.471935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:38.471935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:38.471935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:38.471935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:38.471935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:38.471935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:38.471935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:38.471935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:38.471935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:38.471935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:38.471935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:38.471935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:38.472846 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:38.472846 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:38.472846 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:38.472846 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:38.480355 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 346/676] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:38.482030 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f4b1d-db11-432d-b192-9a3afe4620d7 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:38.561226 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c82021-d33f-4126-8f37-169a5dc03aac None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:38.595406 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f4b1d-db11-432d-b192-9a3afe4620d7 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:38.597293 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:38.602724 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba31937-a57b-4874-afd8-3e1b4fbe845e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:38.603375 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba31937-a57b-4874-afd8-3e1b4fbe845e None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:38.603647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba31937-a57b-4874-afd8-3e1b4fbe845e None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:38.603922 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba31937-a57b-4874-afd8-3e1b4fbe845e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:38.610950 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba31937-a57b-4874-afd8-3e1b4fbe845e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:38.612574 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba31937-a57b-4874-afd8-3e1b4fbe845e None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:38.623770 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-2ba31937-a57b-4874-afd8-3e1b4fbe845e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:38.623770 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:38.623770 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:38.623770 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:38.623770 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:38.623770 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:38.623770 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:38.623770 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:38.623770 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:38.623770 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:38.623770 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:38.623770 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:38.623770 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:39:38.623770 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:39:38.623770 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:39:38.624659 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:39:38.624659 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:38.624659 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:38.624659 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:38.624659 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:38.624659 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:38.624659 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:38.624659 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:38.624659 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:38.624659 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:38.624659 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:38.624659 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:38.624659 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:38.624659 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:38.624659 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:38.624659 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:38.624659 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:38.625543 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:39:38.625543 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:39:38.625543 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:39:38.625543 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:39:38.625543 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:39:38.625543 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:39:38.625543 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:38.625543 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:38.625543 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 331/677] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:38.626065 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba31937-a57b-4874-afd8-3e1b4fbe845e None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:38.639905 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec863f6-ec1f-4355-810e-29d907153577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:38.640775 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec863f6-ec1f-4355-810e-29d907153577 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:38.640894 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec863f6-ec1f-4355-810e-29d907153577 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:38.641283 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec863f6-ec1f-4355-810e-29d907153577 None admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:38.642114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec863f6-ec1f-4355-810e-29d907153577 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:38.642560 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec863f6-ec1f-4355-810e-29d907153577 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:38.644162 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec863f6-ec1f-4355-810e-29d907153577 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:38.665573 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 347/678] 10.222.0.39 () {56 vars in 1135 bytes} [Tue Jul 26 04:39:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:38.667243 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9038df-54fa-46ef-857a-d44df6ec29f1 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:38.667749 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9038df-54fa-46ef-857a-d44df6ec29f1 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:38.668230 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9038df-54fa-46ef-857a-d44df6ec29f1 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:38.670162 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 348/679] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:38.671055 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9038df-54fa-46ef-857a-d44df6ec29f1 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:38.723336 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:38.734220 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba31937-a57b-4874-afd8-3e1b4fbe845e None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:38.772863 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c06a3a-1d8b-44dc-9f9c-c8b8edd86458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:38.773489 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c06a3a-1d8b-44dc-9f9c-c8b8edd86458 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:38.773888 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c06a3a-1d8b-44dc-9f9c-c8b8edd86458 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:38.774415 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c06a3a-1d8b-44dc-9f9c-c8b8edd86458 None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:38.775539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c06a3a-1d8b-44dc-9f9c-c8b8edd86458 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:38.776014 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c06a3a-1d8b-44dc-9f9c-c8b8edd86458 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:38.777386 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9038df-54fa-46ef-857a-d44df6ec29f1 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:38.777682 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c06a3a-1d8b-44dc-9f9c-c8b8edd86458 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:38.794958 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 332/680] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:38.800178 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c06a3a-1d8b-44dc-9f9c-c8b8edd86458 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:38.818236 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc97b1a-4bb6-4109-8bac-9a77831a82e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:38.818867 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc97b1a-4bb6-4109-8bac-9a77831a82e4 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:38.819175 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc97b1a-4bb6-4109-8bac-9a77831a82e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:38.819415 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc97b1a-4bb6-4109-8bac-9a77831a82e4 None admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:38.820198 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc97b1a-4bb6-4109-8bac-9a77831a82e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:38.820474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc97b1a-4bb6-4109-8bac-9a77831a82e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:38.822309 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc97b1a-4bb6-4109-8bac-9a77831a82e4 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:38.834511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 349/681] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:39:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:38.835669 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5119d14-7b20-46e1-85e4-d9b8da5c0215 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:38.835955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5119d14-7b20-46e1-85e4-d9b8da5c0215 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:38.836228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5119d14-7b20-46e1-85e4-d9b8da5c0215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:38.854866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-e5119d14-7b20-46e1-85e4-d9b8da5c0215 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:38.856168 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-e5119d14-7b20-46e1-85e4-d9b8da5c0215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:38.871536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:38.909095 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c06a3a-1d8b-44dc-9f9c-c8b8edd86458 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:38.930057 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 350/682] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:38.930057 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5119d14-7b20-46e1-85e4-d9b8da5c0215 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:38.957022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a151634-00a9-49e9-88f5-1be687713d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:38.957908 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a151634-00a9-49e9-88f5-1be687713d8c None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:38.958250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a151634-00a9-49e9-88f5-1be687713d8c None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:38.958493 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a151634-00a9-49e9-88f5-1be687713d8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:38.981664 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:39.031048 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5119d14-7b20-46e1-85e4-d9b8da5c0215 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:39.035300 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a151634-00a9-49e9-88f5-1be687713d8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:39.037008 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a151634-00a9-49e9-88f5-1be687713d8c None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:39.073632 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf365fd-dcd7-4364-a512-499c42c12bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:39.074303 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf365fd-dcd7-4364-a512-499c42c12bac None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:39.074583 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf365fd-dcd7-4364-a512-499c42c12bac None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:39.074853 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf365fd-dcd7-4364-a512-499c42c12bac None admin] PATH_INFO: `/v3/projects/service` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:39.082292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf365fd-dcd7-4364-a512-499c42c12bac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:39.083778 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf365fd-dcd7-4364-a512-499c42c12bac None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:39.095811 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-4bf365fd-dcd7-4364-a512-499c42c12bac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:39.095811 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:39.095811 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:39.095811 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:39.095811 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:39.095811 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:39.095811 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:39.095811 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:39.095811 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:39.095811 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:39.095811 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:39.095811 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:39.095811 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:39:39.095811 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:39:39.095811 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:39:39.097176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:39:39.097176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:39.097176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:39.097176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:39.097176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:39.097176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:39.097176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:39.097176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:39.097176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:39.097176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:39.097176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:39.097176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:39.097176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:39.097176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:39.097176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:39.097176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:39.097176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:39.098127 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:39:39.098127 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:39:39.098127 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:39:39.098127 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:39:39.098127 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:39:39.098127 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:39:39.098127 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:39.098127 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:39.098127 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 351/683] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:39.098127 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf365fd-dcd7-4364-a512-499c42c12bac None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:39.116402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:39.171762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 333/684] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:39:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:39.172862 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a151634-00a9-49e9-88f5-1be687713d8c None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:39.216932 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf365fd-dcd7-4364-a512-499c42c12bac None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:39.229307 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:39.252112 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a2d27-fc82-47e3-8299-483d30621881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:39.252692 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a2d27-fc82-47e3-8299-483d30621881 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:39.253092 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a2d27-fc82-47e3-8299-483d30621881 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:39.253370 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a2d27-fc82-47e3-8299-483d30621881 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:39.254200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a2d27-fc82-47e3-8299-483d30621881 None admin] RBAC: Adding query filter params (role.id=a22f1a3785a746048e38205d1996764b, scope.project.id=c4d7c29a2b144df6afa96fd6894254a4, user.id=9bb16e4960af4c03bc274dea6bea2e1a) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:39.254514 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a2d27-fc82-47e3-8299-483d30621881 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:39.255977 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a2d27-fc82-47e3-8299-483d30621881 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:39.270020 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 352/685] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:39:39 2022] GET /identity/v3/role_assignments?user.id=9bb16e4960af4c03bc274dea6bea2e1a&scope.project.id=c4d7c29a2b144df6afa96fd6894254a4&role.id=a22f1a3785a746048e38205d1996764b => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:39.270020 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a2d27-fc82-47e3-8299-483d30621881 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:39.293448 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a151634-00a9-49e9-88f5-1be687713d8c None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:39.333541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d46018-4001-4ae4-b295-93d7754ee509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:39.334412 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d46018-4001-4ae4-b295-93d7754ee509 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:39.334763 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d46018-4001-4ae4-b295-93d7754ee509 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:39.335108 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d46018-4001-4ae4-b295-93d7754ee509 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:39.349958 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d46018-4001-4ae4-b295-93d7754ee509 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:39.352180 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d46018-4001-4ae4-b295-93d7754ee509 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:39.369131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-85d46018-4001-4ae4-b295-93d7754ee509 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:39.369131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:39.369131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:39.369131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:39.369131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:39.369131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:39.369131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:39.369131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:39.369131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:39.369131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:39.369131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:39.369131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:39.369131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:39.369131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:39.369131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:39.370166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:39.370166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:39.370166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:39.370166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:39.370166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:39.370166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:39.370166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:39.370166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:39.370166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:39.370166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:39.370166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:39.370166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:39.370166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:39.370166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:39.370166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:39.370166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:39.370166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:39.371083 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:39.371083 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:39.371083 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:39.371083 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:39.373257 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 334/686] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:39.374330 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d46018-4001-4ae4-b295-93d7754ee509 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:39.386375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:39.398744 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a2d27-fc82-47e3-8299-483d30621881 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:39.439512 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787030dc-4e21-4d7a-842a-d8bf6fa6aafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:39.440393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787030dc-4e21-4d7a-842a-d8bf6fa6aafc None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:39.440771 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787030dc-4e21-4d7a-842a-d8bf6fa6aafc None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:39.441143 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787030dc-4e21-4d7a-842a-d8bf6fa6aafc None admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:39.442226 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787030dc-4e21-4d7a-842a-d8bf6fa6aafc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:39.442518 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787030dc-4e21-4d7a-842a-d8bf6fa6aafc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:39.444691 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787030dc-4e21-4d7a-842a-d8bf6fa6aafc None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:39.462014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 353/687] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:39:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:39.462014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787030dc-4e21-4d7a-842a-d8bf6fa6aafc None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:39.503430 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d46018-4001-4ae4-b295-93d7754ee509 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:39.507186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:39.542564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e3efc-b724-4cb2-a51a-fb5f2724dad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:39.543530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e3efc-b724-4cb2-a51a-fb5f2724dad0 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:39.544102 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e3efc-b724-4cb2-a51a-fb5f2724dad0 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:39.544569 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e3efc-b724-4cb2-a51a-fb5f2724dad0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:39.558342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e3efc-b724-4cb2-a51a-fb5f2724dad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:39.560630 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e3efc-b724-4cb2-a51a-fb5f2724dad0 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:39.572015 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787030dc-4e21-4d7a-842a-d8bf6fa6aafc None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:39.581128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-d09e3efc-b724-4cb2-a51a-fb5f2724dad0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:39.581128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:39.581128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:39.581128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:39.581128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:39.581128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:39.581128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:39.581128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:39.581128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:39.581128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:39.581128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:39.581128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:39.581128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:39.581128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:39.581128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:39.582122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:39.582122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:39.582122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:39.582122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:39.582122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:39.582122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:39.582122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:39.582122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:39.582122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:39.582122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:39.582122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:39.582122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:39.582122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:39.582122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:39.582122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:39.582122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:39.582122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:39.583059 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:39.583059 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:39.583059 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:39.583059 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:39.586073 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 335/688] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:39.586919 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e3efc-b724-4cb2-a51a-fb5f2724dad0 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:39.626747 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4e352-5ba6-4434-987c-58202685868f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:39.627458 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4e352-5ba6-4434-987c-58202685868f None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:39.627744 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4e352-5ba6-4434-987c-58202685868f None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:39.628023 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4e352-5ba6-4434-987c-58202685868f None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:39.628735 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4e352-5ba6-4434-987c-58202685868f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:39.629043 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4e352-5ba6-4434-987c-58202685868f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:39.631042 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4e352-5ba6-4434-987c-58202685868f None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:39.633110 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:39.649319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 354/689] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:39.650277 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4e352-5ba6-4434-987c-58202685868f None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:39.702714 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e3efc-b724-4cb2-a51a-fb5f2724dad0 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:39.751171 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64401c1c-4a88-4395-8c4f-953d26100341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:39.751801 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64401c1c-4a88-4395-8c4f-953d26100341 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:39.752085 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64401c1c-4a88-4395-8c4f-953d26100341 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:39.752425 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64401c1c-4a88-4395-8c4f-953d26100341 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:39.753854 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64401c1c-4a88-4395-8c4f-953d26100341 None admin] RBAC: Adding query filter params (role.id=a22f1a3785a746048e38205d1996764b, scope.project.id=c4d7c29a2b144df6afa96fd6894254a4, user.id=74fee029d5214ce18b4b9ddc2df72a23) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:39.754405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64401c1c-4a88-4395-8c4f-953d26100341 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:39.756554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64401c1c-4a88-4395-8c4f-953d26100341 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:39.764971 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4e352-5ba6-4434-987c-58202685868f None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:39.765201 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 336/690] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:39:39 2022] GET /identity/v3/role_assignments?user.id=74fee029d5214ce18b4b9ddc2df72a23&scope.project.id=c4d7c29a2b144df6afa96fd6894254a4&role.id=a22f1a3785a746048e38205d1996764b => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:39.765773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64401c1c-4a88-4395-8c4f-953d26100341 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:39.802346 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:39.806626 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08d6a3-053e-450b-9e89-88df1cd629dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:39.807271 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08d6a3-053e-450b-9e89-88df1cd629dd None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:39.807548 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08d6a3-053e-450b-9e89-88df1cd629dd None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:39.807820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08d6a3-053e-450b-9e89-88df1cd629dd None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:39.808536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08d6a3-053e-450b-9e89-88df1cd629dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:39.808847 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08d6a3-053e-450b-9e89-88df1cd629dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:39.810836 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08d6a3-053e-450b-9e89-88df1cd629dd None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:39.830097 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 355/691] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:39.834837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08d6a3-053e-450b-9e89-88df1cd629dd None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:39.912912 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64401c1c-4a88-4395-8c4f-953d26100341 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:39.915377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:39.970008 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebef69-25b6-484d-8b24-7b16c75edec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:39.970008 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebef69-25b6-484d-8b24-7b16c75edec1 None admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:39.970008 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebef69-25b6-484d-8b24-7b16c75edec1 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:39.970008 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebef69-25b6-484d-8b24-7b16c75edec1 None admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:39.970432 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebef69-25b6-484d-8b24-7b16c75edec1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:39.971096 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebef69-25b6-484d-8b24-7b16c75edec1 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:40.003447 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 337/692] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 04:39:39 2022] POST /identity/v3/users => generated 254 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:39:40.017017 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08d6a3-053e-450b-9e89-88df1cd629dd None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:40.058870 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669b0ae-a579-45a4-832f-82ded5eadb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:40.059552 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669b0ae-a579-45a4-832f-82ded5eadb4b None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:40.059834 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669b0ae-a579-45a4-832f-82ded5eadb4b None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:40.060168 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669b0ae-a579-45a4-832f-82ded5eadb4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:40.068516 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9669b0ae-a579-45a4-832f-82ded5eadb4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:40.070097 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9669b0ae-a579-45a4-832f-82ded5eadb4b None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:40.083637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-9669b0ae-a579-45a4-832f-82ded5eadb4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:40.083637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:40.083637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:40.083637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:40.083637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:40.083637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:40.083637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:40.083637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:40.083637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:40.083637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:40.083637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:40.083637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:40.083637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:39:40.083637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:39:40.083637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:39:40.084610 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:39:40.084610 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:40.084610 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:40.084610 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:40.084610 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:40.084610 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:40.084610 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:40.084610 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:40.084610 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:40.084610 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:40.084610 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:40.084610 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:40.084610 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:40.084610 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:40.084610 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:40.084610 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:40.084610 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:40.085511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:39:40.085511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:39:40.085511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:39:40.085511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:39:40.085511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:39:40.085511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:39:40.085511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:40.085511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:40.090194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 356/693] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:40.091733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebef69-25b6-484d-8b24-7b16c75edec1 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:40.106857 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1913487-c0dc-4701-abca-6cb412443597 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:40.107181 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1913487-c0dc-4701-abca-6cb412443597 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:40.107486 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1913487-c0dc-4701-abca-6cb412443597 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:40.109246 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 357/694] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:39:40.115981 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ce2ee-1547-49f8-abea-ce50fdbdcb88 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:40.116418 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ce2ee-1547-49f8-abea-ce50fdbdcb88 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:40.116797 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ce2ee-1547-49f8-abea-ce50fdbdcb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:40.136174 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-a18ce2ee-1547-49f8-abea-ce50fdbdcb88 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:40.137688 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-a18ce2ee-1547-49f8-abea-ce50fdbdcb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:40.194246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:40.222611 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebef69-25b6-484d-8b24-7b16c75edec1 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:40.226188 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 358/695] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:40.244699 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ce2ee-1547-49f8-abea-ce50fdbdcb88 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:40.259666 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2640c1-fc86-4266-a3c7-2f476c52f7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:40.261116 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2640c1-fc86-4266-a3c7-2f476c52f7fd None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:40.261639 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2640c1-fc86-4266-a3c7-2f476c52f7fd None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:40.262131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2640c1-fc86-4266-a3c7-2f476c52f7fd None admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:40.263091 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2640c1-fc86-4266-a3c7-2f476c52f7fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:40.263694 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2640c1-fc86-4266-a3c7-2f476c52f7fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:40.265539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2640c1-fc86-4266-a3c7-2f476c52f7fd None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:40.281098 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 338/696] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:39:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:40.291072 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2640c1-fc86-4266-a3c7-2f476c52f7fd None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:40.301928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:40.366406 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ce2ee-1547-49f8-abea-ce50fdbdcb88 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:40.408939 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ced1c6-260d-4190-8c0a-5df12b3f3c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:40.410573 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ced1c6-260d-4190-8c0a-5df12b3f3c45 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:40.411112 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ced1c6-260d-4190-8c0a-5df12b3f3c45 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:40.411616 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ced1c6-260d-4190-8c0a-5df12b3f3c45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:40.427922 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ced1c6-260d-4190-8c0a-5df12b3f3c45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:40.433544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-c4ced1c6-260d-4190-8c0a-5df12b3f3c45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:39:40.433544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:40.433544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:40.433544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:40.433544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:40.433544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:40.433544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:40.433544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:40.433544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:40.433544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:40.433544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:40.433544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:40.433544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:40.433544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:40.433544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:40.433544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:40.434648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:40.434648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:40.434648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:40.434648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:40.434648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:40.434648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:40.434648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:40.434648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:40.434648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:40.434648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:40.434648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:40.434648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:40.434648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:40.434648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:40.434648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:40.434648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:40.435513 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:40.435513 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:40.435513 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:40.435513 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:40.435513 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:40.435513 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:40.435513 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:40.435513 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:40.435513 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:40.435513 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:40.435513 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:39:40.435513 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:40.438565 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 359/697] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:39:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:40.444805 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ced1c6-260d-4190-8c0a-5df12b3f3c45 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:40.562096 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2640c1-fc86-4266-a3c7-2f476c52f7fd None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:40.606398 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ced1c6-260d-4190-8c0a-5df12b3f3c45 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:40.609733 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:40.625575 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf026c-1a7c-4ac4-ac38-9ea16eafeb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:40.628009 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf026c-1a7c-4ac4-ac38-9ea16eafeb54 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:40.628291 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf026c-1a7c-4ac4-ac38-9ea16eafeb54 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:40.628559 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf026c-1a7c-4ac4-ac38-9ea16eafeb54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:40.630272 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf026c-1a7c-4ac4-ac38-9ea16eafeb54 None admin] RBAC: Adding query filter params (role.id=a22f1a3785a746048e38205d1996764b, scope.project.id=c4d7c29a2b144df6afa96fd6894254a4, user.id=0e089e39e9de419b9e2fb1d7fc2d245a) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:40.630585 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf026c-1a7c-4ac4-ac38-9ea16eafeb54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:40.632051 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf026c-1a7c-4ac4-ac38-9ea16eafeb54 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:40.644413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:40.647839 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 339/698] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:39:40 2022] GET /identity/v3/role_assignments?user.id=0e089e39e9de419b9e2fb1d7fc2d245a&scope.project.id=c4d7c29a2b144df6afa96fd6894254a4&role.id=a22f1a3785a746048e38205d1996764b => generated 608 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:40.658595 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f463945-3fe2-42af-b5bf-187fd6830808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:40.659245 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f463945-3fe2-42af-b5bf-187fd6830808 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:40.659523 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f463945-3fe2-42af-b5bf-187fd6830808 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:40.659791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f463945-3fe2-42af-b5bf-187fd6830808 None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:40.660534 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f463945-3fe2-42af-b5bf-187fd6830808 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:40.660838 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f463945-3fe2-42af-b5bf-187fd6830808 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:40.662327 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f463945-3fe2-42af-b5bf-187fd6830808 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:40.683863 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 360/699] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:39:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:39:40.689190 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf026c-1a7c-4ac4-ac38-9ea16eafeb54 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:40.821618 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf026c-1a7c-4ac4-ac38-9ea16eafeb54 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:40.857714 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2fb3e-1e63-45d9-a6b8-4938aab478c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:40.858768 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2fb3e-1e63-45d9-a6b8-4938aab478c7 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:40.859251 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2fb3e-1e63-45d9-a6b8-4938aab478c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:40.859745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2fb3e-1e63-45d9-a6b8-4938aab478c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:40.870685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2fb3e-1e63-45d9-a6b8-4938aab478c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:40.872470 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2fb3e-1e63-45d9-a6b8-4938aab478c7 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:40.887769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-55f2fb3e-1e63-45d9-a6b8-4938aab478c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:40.887769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:40.887769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:40.887769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:40.887769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:40.887769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:40.887769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:40.887769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:40.887769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:40.887769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:40.887769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:40.887769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:40.887769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:40.887769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:40.887769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:40.888706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:40.888706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:40.888706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:40.888706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:40.888706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:40.888706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:40.888706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:40.888706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:40.888706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:40.888706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:40.888706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:40.888706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:40.888706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:40.888706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:40.888706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:40.888706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:40.888706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:40.889605 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:40.889605 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:40.889605 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:40.889605 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:40.891899 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 340/700] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:40.897201 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f463945-3fe2-42af-b5bf-187fd6830808 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:41.007572 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f463945-3fe2-42af-b5bf-187fd6830808 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:41.042008 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614859d6-5477-4cb8-a8a6-57fb3e67a479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:41.042641 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614859d6-5477-4cb8-a8a6-57fb3e67a479 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:41.042922 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614859d6-5477-4cb8-a8a6-57fb3e67a479 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:41.043194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614859d6-5477-4cb8-a8a6-57fb3e67a479 None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:41.043894 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614859d6-5477-4cb8-a8a6-57fb3e67a479 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:41.044193 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614859d6-5477-4cb8-a8a6-57fb3e67a479 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:41.045587 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614859d6-5477-4cb8-a8a6-57fb3e67a479 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:41.062326 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 361/701] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:41.063734 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2fb3e-1e63-45d9-a6b8-4938aab478c7 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:41.120728 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:41.174381 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2fb3e-1e63-45d9-a6b8-4938aab478c7 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:41.211095 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce8bd8-7eff-42f2-8e44-15d3ca0675aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:41.211864 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce8bd8-7eff-42f2-8e44-15d3ca0675aa None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:41.212144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce8bd8-7eff-42f2-8e44-15d3ca0675aa None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:41.212414 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce8bd8-7eff-42f2-8e44-15d3ca0675aa None admin] PATH_INFO: `/v3/users/nova` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:41.220089 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce8bd8-7eff-42f2-8e44-15d3ca0675aa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:41.221680 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce8bd8-7eff-42f2-8e44-15d3ca0675aa None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:41.233733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-c7ce8bd8-7eff-42f2-8e44-15d3ca0675aa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 04:39:41.233733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:41.233733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:41.233733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:41.233733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:41.233733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:41.233733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:41.233733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:41.233733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:41.233733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:41.233733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:41.233733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:41.233733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:39:41.233733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:39:41.233733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:39:41.233733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:39:41.234751 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:41.234751 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:41.234751 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:39:41.234751 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:41.234751 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:39:41.234751 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:41.234751 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:41.234751 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:41.234751 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:41.234751 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:41.234751 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:41.234751 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:41.234751 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:41.234751 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:41.234751 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:41.234751 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:41.234751 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:41.234751 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:41.236332 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:41.236332 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:41.236332 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:39:41.236332 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:39:41.236332 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:39:41.236332 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:39:41.236332 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:39:41.236332 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:39:41.236332 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 04:39:41.236332 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:41.236332 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 341/702] 10.222.0.39 () {56 vars in 1093 bytes} [Tue Jul 26 04:39:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:41.240877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614859d6-5477-4cb8-a8a6-57fb3e67a479 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:41.284604 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:41.346951 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614859d6-5477-4cb8-a8a6-57fb3e67a479 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:41.381586 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851c2bf-4996-4474-9091-23172db017e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:41.382172 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851c2bf-4996-4474-9091-23172db017e6 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:41.382452 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851c2bf-4996-4474-9091-23172db017e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:41.382722 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851c2bf-4996-4474-9091-23172db017e6 None admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:41.383523 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851c2bf-4996-4474-9091-23172db017e6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:41.383830 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851c2bf-4996-4474-9091-23172db017e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:41.385396 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851c2bf-4996-4474-9091-23172db017e6 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:41.403657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 362/703] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Jul 26 04:39:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:41.409382 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce8bd8-7eff-42f2-8e44-15d3ca0675aa None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:41.526768 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce8bd8-7eff-42f2-8e44-15d3ca0675aa None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:41.546851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:41.580033 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea29a7-c2b6-4792-b40e-d830cc71e425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:41.580779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea29a7-c2b6-4792-b40e-d830cc71e425 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:41.581059 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea29a7-c2b6-4792-b40e-d830cc71e425 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:41.581331 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea29a7-c2b6-4792-b40e-d830cc71e425 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:41.669794 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea29a7-c2b6-4792-b40e-d830cc71e425 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:41.671214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ea29a7-c2b6-4792-b40e-d830cc71e425 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:41.795591 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 342/704] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:39:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:41.800522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afea36-681c-4108-ab5c-920126b34909 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:41.801018 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afea36-681c-4108-ab5c-920126b34909 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:41.801108 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afea36-681c-4108-ab5c-920126b34909 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:41.805528 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 363/705] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:41.805661 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea29a7-c2b6-4792-b40e-d830cc71e425 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:41.812147 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abc0b9-4cb8-4e62-8b1f-24bdfc7a5b3d None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:41.812414 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abc0b9-4cb8-4e62-8b1f-24bdfc7a5b3d None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:41.812683 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abc0b9-4cb8-4e62-8b1f-24bdfc7a5b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:41.819193 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:41.850550 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-f4abc0b9-4cb8-4e62-8b1f-24bdfc7a5b3d None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:41.851887 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-f4abc0b9-4cb8-4e62-8b1f-24bdfc7a5b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:41.966887 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 364/706] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:41.974190 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ea29a7-c2b6-4792-b40e-d830cc71e425 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:41.991526 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4abc0b9-4cb8-4e62-8b1f-24bdfc7a5b3d None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:42.009253 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:42.048014 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d1938-9e52-4e3f-a2e1-37c4812d0653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:42.048730 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d1938-9e52-4e3f-a2e1-37c4812d0653 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:42.049041 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d1938-9e52-4e3f-a2e1-37c4812d0653 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:42.049534 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d1938-9e52-4e3f-a2e1-37c4812d0653 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:42.078502 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d1938-9e52-4e3f-a2e1-37c4812d0653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:42.079980 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d1938-9e52-4e3f-a2e1-37c4812d0653 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:42.102507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4abc0b9-4cb8-4e62-8b1f-24bdfc7a5b3d None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:42.111387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-320d1938-9e52-4e3f-a2e1-37c4812d0653 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:42.111387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:42.111387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:42.111387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:42.111387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:42.111387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:42.111387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:42.111387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:42.111387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:42.111387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:42.111387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:42.111387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:42.111387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:42.111387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:42.111387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:42.112326 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:42.112326 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:42.112326 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:42.112326 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:42.112326 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:42.112326 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:42.112326 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:42.112326 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:42.112326 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:42.112326 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:42.112326 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:42.112326 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:42.112326 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:42.112326 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:42.112326 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:42.112326 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:42.112326 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:42.113217 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:42.113217 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:42.113217 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:42.113217 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:42.113217 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 343/707] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:39:42.118234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d1938-9e52-4e3f-a2e1-37c4812d0653 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:42.143109 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b99ee-37b4-4d85-84b3-4f9bede02b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:42.144132 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b99ee-37b4-4d85-84b3-4f9bede02b40 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:42.144602 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b99ee-37b4-4d85-84b3-4f9bede02b40 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:42.145062 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b99ee-37b4-4d85-84b3-4f9bede02b40 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:42.146231 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b99ee-37b4-4d85-84b3-4f9bede02b40 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:42.147949 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b99ee-37b4-4d85-84b3-4f9bede02b40 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:42.160729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-860b99ee-37b4-4d85-84b3-4f9bede02b40 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 04:39:42.160729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:42.160729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 04:39:42.160729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 04:39:42.160729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 04:39:42.160729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 04:39:42.160729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 04:39:42.160729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:39:42.160729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 04:39:42.160729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:42.160729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 04:39:42.160729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:42.160729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:42.160729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:42.160729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:42.160729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:42.161717 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:42.161717 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:42.161717 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:42.161717 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:42.161717 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:42.161717 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:42.161717 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:42.161717 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 04:39:42.161717 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 04:39:42.161717 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 04:39:42.161717 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 04:39:42.161717 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:42.161717 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:42.161717 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:42.161717 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:42.161717 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:42.162640 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:42.162640 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:42.162640 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:42.162640 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:42.162640 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:42.162640 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:42.162640 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:42.162640 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:42.162640 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:42.162640 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:42.162640 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:42.162640 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 04:39:42.162640 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:39:42.162640 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 04:39:42.162640 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:42.165761 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 365/708] 10.222.0.39 () {56 vars in 1129 bytes} [Tue Jul 26 04:39:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:39:42.172053 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b99ee-37b4-4d85-84b3-4f9bede02b40 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:42.260518 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:42.276564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:42.306206 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b99ee-37b4-4d85-84b3-4f9bede02b40 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:42.344674 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad33310-7023-4152-8747-1d80999837ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:42.345685 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad33310-7023-4152-8747-1d80999837ed None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:42.346269 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad33310-7023-4152-8747-1d80999837ed None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:42.346734 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad33310-7023-4152-8747-1d80999837ed None admin] PATH_INFO: `/v3/services` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:42.347729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad33310-7023-4152-8747-1d80999837ed None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:42.348223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad33310-7023-4152-8747-1d80999837ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:42.349965 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad33310-7023-4152-8747-1d80999837ed None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:42.355512 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 366/709] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Jul 26 04:39:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:39:42.362046 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad33310-7023-4152-8747-1d80999837ed None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:42.391955 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d1938-9e52-4e3f-a2e1-37c4812d0653 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:42.470204 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad33310-7023-4152-8747-1d80999837ed None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:42.491254 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a30b7-13ef-4635-bbad-f40ed8c297fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:42.491955 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a30b7-13ef-4635-bbad-f40ed8c297fd None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:42.492175 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a30b7-13ef-4635-bbad-f40ed8c297fd None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:42.492448 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a30b7-13ef-4635-bbad-f40ed8c297fd None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:42.493148 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a30b7-13ef-4635-bbad-f40ed8c297fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:42.493450 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a30b7-13ef-4635-bbad-f40ed8c297fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:42.494858 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a30b7-13ef-4635-bbad-f40ed8c297fd None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:42.506886 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffca53f-3111-4b4c-a367-8b4aa8e81be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:42.507870 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffca53f-3111-4b4c-a367-8b4aa8e81be1 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:42.508359 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffca53f-3111-4b4c-a367-8b4aa8e81be1 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:42.508886 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffca53f-3111-4b4c-a367-8b4aa8e81be1 None admin] PATH_INFO: `/v3/services` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:42.509753 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffca53f-3111-4b4c-a367-8b4aa8e81be1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:42.510297 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffca53f-3111-4b4c-a367-8b4aa8e81be1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:42.512043 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffca53f-3111-4b4c-a367-8b4aa8e81be1 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:42.518655 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 367/710] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Jul 26 04:39:42 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:42.526033 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 344/711] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:39:42.528012 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db4081-afc5-454c-b820-2e307c5ab5e2 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:42.528300 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db4081-afc5-454c-b820-2e307c5ab5e2 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:42.528572 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db4081-afc5-454c-b820-2e307c5ab5e2 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:42.530222 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a30b7-13ef-4635-bbad-f40ed8c297fd None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:42.530523 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 368/712] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:42.540080 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ecf8a-4bee-45cf-9af8-30397a0e851c None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:42.540400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ecf8a-4bee-45cf-9af8-30397a0e851c None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:42.540629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ecf8a-4bee-45cf-9af8-30397a0e851c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:42.566374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:42.576762 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-bd9ecf8a-4bee-45cf-9af8-30397a0e851c None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:42.578099 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-bd9ecf8a-4bee-45cf-9af8-30397a0e851c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:42.639197 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a30b7-13ef-4635-bbad-f40ed8c297fd None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:42.666135 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:42.678565 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0182768-29a4-4f70-bf43-df01249b508a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:42.679393 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0182768-29a4-4f70-bf43-df01249b508a None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:42.679770 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0182768-29a4-4f70-bf43-df01249b508a None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:42.680139 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0182768-29a4-4f70-bf43-df01249b508a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:42.688145 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0182768-29a4-4f70-bf43-df01249b508a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:42.689856 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0182768-29a4-4f70-bf43-df01249b508a None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:42.703773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-c0182768-29a4-4f70-bf43-df01249b508a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:42.703773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:42.703773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:42.703773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:42.703773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:42.703773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:42.703773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:42.703773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:42.703773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:42.703773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:42.703773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:42.703773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:42.703773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:39:42.703773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:39:42.703773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:39:42.704954 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:39:42.704954 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:42.704954 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:42.704954 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:42.704954 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:42.704954 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:42.704954 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:42.704954 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:42.704954 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:42.704954 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:42.704954 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:42.704954 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:42.704954 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:42.704954 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:42.704954 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:42.704954 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:42.704954 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:42.706274 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:39:42.706274 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:39:42.706274 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:39:42.706274 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:39:42.706274 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:39:42.706274 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:39:42.706274 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:42.706274 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:42.706274 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 345/713] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:39:42.711951 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0182768-29a4-4f70-bf43-df01249b508a None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:42.716098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 369/714] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:42.755521 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ecf8a-4bee-45cf-9af8-30397a0e851c None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:42.827372 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0182768-29a4-4f70-bf43-df01249b508a None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:42.867614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad91bed-9283-4089-9d8f-7024ba7776cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:42.868223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad91bed-9283-4089-9d8f-7024ba7776cb None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:42.868499 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad91bed-9283-4089-9d8f-7024ba7776cb None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:42.868767 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad91bed-9283-4089-9d8f-7024ba7776cb None admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:42.869523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad91bed-9283-4089-9d8f-7024ba7776cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:42.869828 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad91bed-9283-4089-9d8f-7024ba7776cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:42.871319 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad91bed-9283-4089-9d8f-7024ba7776cb None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:42.880962 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ecf8a-4bee-45cf-9af8-30397a0e851c None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:42.884034 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 346/715] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:39:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:42.885315 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9ce44-9b3d-457a-9bb1-5bf321d176c1 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:42.885601 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9ce44-9b3d-457a-9bb1-5bf321d176c1 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:42.885881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9ce44-9b3d-457a-9bb1-5bf321d176c1 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:42.896094 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 347/716] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:42.896094 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9ce44-9b3d-457a-9bb1-5bf321d176c1 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:42.928903 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9f737-ecf8-44af-8185-0e2bfc1b9796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:42.930013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9f737-ecf8-44af-8185-0e2bfc1b9796 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:42.930528 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9f737-ecf8-44af-8185-0e2bfc1b9796 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:42.931128 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9f737-ecf8-44af-8185-0e2bfc1b9796 None admin] PATH_INFO: `/v3/services/network` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:42.932066 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9f737-ecf8-44af-8185-0e2bfc1b9796 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:42.933770 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9f737-ecf8-44af-8185-0e2bfc1b9796 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:42.938213 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:42.947178 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-bcf9f737-ecf8-44af-8185-0e2bfc1b9796 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 04:39:42.947178 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:42.947178 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 04:39:42.947178 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 04:39:42.947178 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 04:39:42.947178 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 04:39:42.947178 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 04:39:42.947178 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:39:42.947178 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 04:39:42.947178 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:42.947178 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 04:39:42.947178 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:42.947178 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:42.947178 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:42.947178 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:42.947178 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:42.947178 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:42.948236 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:42.948236 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:42.948236 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:42.948236 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:42.948236 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:42.948236 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:42.948236 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 04:39:42.948236 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 04:39:42.948236 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 04:39:42.948236 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 04:39:42.948236 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:42.948236 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:42.948236 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:42.948236 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:42.948236 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:42.948236 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:42.949090 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:42.949090 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:42.949090 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:42.949090 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:42.949090 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:42.949090 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:42.949090 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:42.949090 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:42.949090 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:42.949090 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:42.949090 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 04:39:42.949090 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:39:42.949090 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 04:39:42.949090 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:42.952137 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:42.957399 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 370/717] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:42 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:42.959095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695efba9-dd56-41a0-a558-ff6447304154 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:42.959595 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695efba9-dd56-41a0-a558-ff6447304154 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:42.960784 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695efba9-dd56-41a0-a558-ff6447304154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:42.990434 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-695efba9-dd56-41a0-a558-ff6447304154 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:42.992614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-695efba9-dd56-41a0-a558-ff6447304154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:43.015390 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9ce44-9b3d-457a-9bb1-5bf321d176c1 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:43.059600 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b36f81-f121-4942-bddc-faf649b7419c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:43.060548 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b36f81-f121-4942-bddc-faf649b7419c None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:43.061441 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b36f81-f121-4942-bddc-faf649b7419c None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:43.061906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b36f81-f121-4942-bddc-faf649b7419c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:43.063224 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b36f81-f121-4942-bddc-faf649b7419c None admin] RBAC: Adding query filter params (role.id=2bfdd65b06554a6da967b3939da753c7, scope.project.id=c4d7c29a2b144df6afa96fd6894254a4, user.id=ae8593e125da4b208dd100608aa2b462) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:43.063716 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b36f81-f121-4942-bddc-faf649b7419c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:43.066162 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b36f81-f121-4942-bddc-faf649b7419c None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:43.074611 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 348/718] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:39:42 2022] GET /identity/v3/role_assignments?user.id=ae8593e125da4b208dd100608aa2b462&scope.project.id=c4d7c29a2b144df6afa96fd6894254a4&role.id=2bfdd65b06554a6da967b3939da753c7 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:43.075755 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b36f81-f121-4942-bddc-faf649b7419c None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:43.080809 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 371/719] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:43.115865 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695efba9-dd56-41a0-a558-ff6447304154 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:43.284310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b36f81-f121-4942-bddc-faf649b7419c None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:43.298002 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:43.313939 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695efba9-dd56-41a0-a558-ff6447304154 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:43.323048 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d775b6-5f97-40af-8d29-eee96e2ae4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:43.323683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d775b6-5f97-40af-8d29-eee96e2ae4d1 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:43.323955 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d775b6-5f97-40af-8d29-eee96e2ae4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:43.324332 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d775b6-5f97-40af-8d29-eee96e2ae4d1 None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:43.325025 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d775b6-5f97-40af-8d29-eee96e2ae4d1 None admin] RBAC: Adding query filter params (name=network) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:43.325331 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d775b6-5f97-40af-8d29-eee96e2ae4d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:43.326843 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d775b6-5f97-40af-8d29-eee96e2ae4d1 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:43.332342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 349/720] 10.222.0.39 () {56 vars in 1112 bytes} [Tue Jul 26 04:39:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:43.333487 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d120174-d160-44eb-bc1b-48af75d43a94 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:43.333770 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d120174-d160-44eb-bc1b-48af75d43a94 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:43.334086 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d120174-d160-44eb-bc1b-48af75d43a94 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:43.335738 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 350/721] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:43.338989 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d120174-d160-44eb-bc1b-48af75d43a94 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:43.354439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:43.362197 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36647196-2eba-4bb3-bda8-ae4abe2c2158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:43.362981 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36647196-2eba-4bb3-bda8-ae4abe2c2158 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:43.363370 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36647196-2eba-4bb3-bda8-ae4abe2c2158 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:43.363738 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36647196-2eba-4bb3-bda8-ae4abe2c2158 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:43.374967 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36647196-2eba-4bb3-bda8-ae4abe2c2158 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:43.380208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-36647196-2eba-4bb3-bda8-ae4abe2c2158 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:43.380208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:43.380208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:43.380208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:43.380208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:43.380208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:43.380208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:43.380208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:43.380208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:43.380208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:43.380208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:43.380208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:43.380208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:43.380208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:43.380208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:43.380208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:43.381286 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:43.381286 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:43.381286 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:43.381286 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:43.381286 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:43.381286 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:43.381286 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:43.381286 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:43.381286 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:43.381286 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:43.381286 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:43.381286 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:43.381286 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:43.381286 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:43.381286 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:43.381286 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:43.382182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:43.382182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:43.382182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:43.382182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:43.382182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:43.382182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:43.382182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:43.382182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:43.382182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:43.382182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:43.382182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:43.382182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:43.382827 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 372/722] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 04:39:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:43.384121 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb60cb-1a8d-4410-9e49-2963dccd3fb5 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:43.384228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb60cb-1a8d-4410-9e49-2963dccd3fb5 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:43.384611 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb60cb-1a8d-4410-9e49-2963dccd3fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:43.403025 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-c2fb60cb-1a8d-4410-9e49-2963dccd3fb5 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:43.404324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-c2fb60cb-1a8d-4410-9e49-2963dccd3fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:43.484653 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 373/723] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:43.484653 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb60cb-1a8d-4410-9e49-2963dccd3fb5 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:43.494040 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d120174-d160-44eb-bc1b-48af75d43a94 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:43.550438 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5bfad-5ba5-428a-845f-d75c3a85a498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:43.551102 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5bfad-5ba5-428a-845f-d75c3a85a498 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:43.551472 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5bfad-5ba5-428a-845f-d75c3a85a498 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:43.551822 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5bfad-5ba5-428a-845f-d75c3a85a498 None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:43.552573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5bfad-5ba5-428a-845f-d75c3a85a498 None admin] RBAC: Adding query filter params (type=network) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:43.552947 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5bfad-5ba5-428a-845f-d75c3a85a498 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:43.554537 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5bfad-5ba5-428a-845f-d75c3a85a498 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:43.561002 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 351/724] 10.222.0.39 () {56 vars in 1112 bytes} [Tue Jul 26 04:39:43 2022] GET /identity/v3/services?type=network => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:43.561905 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5bfad-5ba5-428a-845f-d75c3a85a498 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:43.603226 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:43.629732 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb60cb-1a8d-4410-9e49-2963dccd3fb5 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:43.657946 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:43.677651 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9e456-954f-4d8f-86a8-684373e91f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:43.678576 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9e456-954f-4d8f-86a8-684373e91f45 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:43.678998 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9e456-954f-4d8f-86a8-684373e91f45 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:43.679406 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b9e456-954f-4d8f-86a8-684373e91f45 None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:43.679797 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5bfad-5ba5-428a-845f-d75c3a85a498 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:43.680457 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b9e456-954f-4d8f-86a8-684373e91f45 None admin] RBAC: Adding query filter params (name=service) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:43.680900 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b9e456-954f-4d8f-86a8-684373e91f45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:43.683641 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b9e456-954f-4d8f-86a8-684373e91f45 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:43.697829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 374/725] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 04:39:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:43.711477 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9e456-954f-4d8f-86a8-684373e91f45 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:43.759034 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4823b9-1154-4d5d-9a9c-37d9ce8117e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:43.759728 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4823b9-1154-4d5d-9a9c-37d9ce8117e2 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:43.760111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4823b9-1154-4d5d-9a9c-37d9ce8117e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:43.760479 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4823b9-1154-4d5d-9a9c-37d9ce8117e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:43.789428 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4823b9-1154-4d5d-9a9c-37d9ce8117e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:43.796356 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-7b4823b9-1154-4d5d-9a9c-37d9ce8117e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:39:43.796356 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:43.796356 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:43.796356 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:43.796356 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:43.796356 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:43.796356 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:43.796356 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:43.796356 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:43.796356 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:43.796356 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:43.796356 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:43.796356 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:43.796356 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:43.796356 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:43.796356 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:43.797272 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:43.797272 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:43.797272 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:43.797272 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:43.797272 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:43.797272 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:43.797272 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:43.797272 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:43.797272 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:43.797272 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:43.797272 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:43.797272 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:43.797272 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:43.797272 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:43.797272 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:43.797272 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:43.798150 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:43.798150 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:43.798150 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:43.798150 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:43.798150 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:43.798150 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:43.798150 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:43.798150 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:43.798150 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:43.798150 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:43.798150 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:39:43.798150 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:43.806519 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 352/726] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:39:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:43.808104 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4823b9-1154-4d5d-9a9c-37d9ce8117e2 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:43.832209 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b9e456-954f-4d8f-86a8-684373e91f45 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:43.881469 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f059322-81b0-4429-8fac-9e8402cf1169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:43.882132 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f059322-81b0-4429-8fac-9e8402cf1169 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:43.882401 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f059322-81b0-4429-8fac-9e8402cf1169 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:43.882671 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f059322-81b0-4429-8fac-9e8402cf1169 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:43.897202 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f059322-81b0-4429-8fac-9e8402cf1169 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:43.898850 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f059322-81b0-4429-8fac-9e8402cf1169 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:43.916351 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-2f059322-81b0-4429-8fac-9e8402cf1169 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:43.916351 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:43.916351 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:43.916351 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:43.916351 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:43.916351 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:43.916351 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:43.916351 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:43.916351 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:43.916351 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:43.916351 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:43.916351 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:43.916351 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:43.916351 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:43.916351 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:43.917296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:43.917296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:43.917296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:43.917296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:43.917296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:43.917296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:43.917296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:43.917296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:43.917296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:43.917296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:43.917296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:43.917296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:43.917296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:43.917296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:43.917296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:43.917296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:43.917296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:43.919636 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:43.919636 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:43.919636 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:43.919636 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:43.919636 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 375/727] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:39:43.924242 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f059322-81b0-4429-8fac-9e8402cf1169 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:43.944183 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:43.951773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4823b9-1154-4d5d-9a9c-37d9ce8117e2 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:43.963682 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:44.007612 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638c05e-9d06-4604-87aa-57030f7eef9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:44.008637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638c05e-9d06-4604-87aa-57030f7eef9f None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:44.009111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638c05e-9d06-4604-87aa-57030f7eef9f None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:44.009576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638c05e-9d06-4604-87aa-57030f7eef9f None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:44.010522 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638c05e-9d06-4604-87aa-57030f7eef9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:44.011017 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638c05e-9d06-4604-87aa-57030f7eef9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:44.012595 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638c05e-9d06-4604-87aa-57030f7eef9f None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:44.028412 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 353/728] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:39:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:44.031489 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f059322-81b0-4429-8fac-9e8402cf1169 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:44.033824 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638c05e-9d06-4604-87aa-57030f7eef9f None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:44.066985 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1f468-36a1-4afe-b9ee-d72373dc1186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:44.067401 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1f468-36a1-4afe-b9ee-d72373dc1186 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:44.067624 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1f468-36a1-4afe-b9ee-d72373dc1186 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:44.067901 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1f468-36a1-4afe-b9ee-d72373dc1186 None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:44.068589 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1f468-36a1-4afe-b9ee-d72373dc1186 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:44.072439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1f468-36a1-4afe-b9ee-d72373dc1186 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:44.073683 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1f468-36a1-4afe-b9ee-d72373dc1186 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:44.103045 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 376/729] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:44.103424 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1f468-36a1-4afe-b9ee-d72373dc1186 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:44.243298 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638c05e-9d06-4604-87aa-57030f7eef9f None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:44.258212 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:44.266004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1f468-36a1-4afe-b9ee-d72373dc1186 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:44.313594 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71888e7d-117c-4e76-838e-41508e012336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:44.314277 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71888e7d-117c-4e76-838e-41508e012336 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:44.314682 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71888e7d-117c-4e76-838e-41508e012336 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:44.314950 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71888e7d-117c-4e76-838e-41508e012336 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:44.337995 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71888e7d-117c-4e76-838e-41508e012336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:44.339513 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71888e7d-117c-4e76-838e-41508e012336 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:44.341282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60bd4b-23fe-46be-80f1-88d148946afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:44.341951 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60bd4b-23fe-46be-80f1-88d148946afb None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:44.342245 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60bd4b-23fe-46be-80f1-88d148946afb None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:44.342605 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60bd4b-23fe-46be-80f1-88d148946afb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:44.357891 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60bd4b-23fe-46be-80f1-88d148946afb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:44.361385 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60bd4b-23fe-46be-80f1-88d148946afb None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:44.374635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-71888e7d-117c-4e76-838e-41508e012336 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:44.374635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:44.374635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:44.374635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:44.374635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:44.374635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:44.374635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:44.374635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:44.374635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:44.374635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:44.374635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:44.374635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:44.374635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:44.374635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:44.374635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:44.375606 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:44.375606 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:44.375606 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:44.375606 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:44.375606 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:44.375606 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:44.375606 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:44.375606 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:44.375606 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:44.375606 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:44.375606 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:44.375606 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:44.375606 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:44.375606 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:44.375606 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:44.375606 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:44.375606 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:44.376495 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:44.376495 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:44.376495 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:44.376495 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:44.381962 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-2e60bd4b-23fe-46be-80f1-88d148946afb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 04:39:44.381962 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:44.381962 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:44.381962 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:44.381962 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:44.381962 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:44.381962 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:44.381962 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:44.381962 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:44.381962 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:44.381962 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:44.381962 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:44.381962 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:39:44.381962 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:39:44.381962 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:39:44.381962 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:39:44.382931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:44.382931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:44.382931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:39:44.382931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:44.382931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:39:44.382931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:44.382931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:44.382931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:44.382931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:44.382931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:44.382931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:44.382931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:44.382931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:44.382931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:44.382931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:44.382931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:44.382931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:44.382931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:44.383871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:44.383871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:44.383871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:39:44.383871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:39:44.383871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:39:44.383871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:39:44.383871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:39:44.383871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:39:44.383871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 04:39:44.383871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:44.384413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 354/730] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:39:44.384413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71888e7d-117c-4e76-838e-41508e012336 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:44.385391 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 377/731] 10.222.0.39 () {56 vars in 1117 bytes} [Tue Jul 26 04:39:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:44.393842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60bd4b-23fe-46be-80f1-88d148946afb None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:44.411266 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:44.511904 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60bd4b-23fe-46be-80f1-88d148946afb None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:44.546656 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42bf42a-013b-4a64-8f14-04fd578b2342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:44.547310 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bf42a-013b-4a64-8f14-04fd578b2342 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:44.547671 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bf42a-013b-4a64-8f14-04fd578b2342 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:44.547950 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bf42a-013b-4a64-8f14-04fd578b2342 None admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:44.548805 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42bf42a-013b-4a64-8f14-04fd578b2342 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:44.549168 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42bf42a-013b-4a64-8f14-04fd578b2342 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:44.550771 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42bf42a-013b-4a64-8f14-04fd578b2342 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:44.569179 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 378/732] 10.222.0.39 () {56 vars in 1149 bytes} [Tue Jul 26 04:39:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:44.575044 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42bf42a-013b-4a64-8f14-04fd578b2342 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:44.610395 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:44.660007 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71888e7d-117c-4e76-838e-41508e012336 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:44.677161 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42bf42a-013b-4a64-8f14-04fd578b2342 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:44.719895 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf878a76-2f92-4a02-9769-ea29cfb2052f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:44.720552 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf878a76-2f92-4a02-9769-ea29cfb2052f None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:44.720842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf878a76-2f92-4a02-9769-ea29cfb2052f None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:44.721108 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf878a76-2f92-4a02-9769-ea29cfb2052f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:44.748948 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed3a0f-6122-4506-a0aa-57861d8a22ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:44.749582 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed3a0f-6122-4506-a0aa-57861d8a22ac None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:44.749858 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed3a0f-6122-4506-a0aa-57861d8a22ac None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:44.750245 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed3a0f-6122-4506-a0aa-57861d8a22ac None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:44.751015 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed3a0f-6122-4506-a0aa-57861d8a22ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:44.751322 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed3a0f-6122-4506-a0aa-57861d8a22ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:44.752763 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed3a0f-6122-4506-a0aa-57861d8a22ac None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:44.782219 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 355/733] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:44.787014 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed3a0f-6122-4506-a0aa-57861d8a22ac None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:44.871029 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf878a76-2f92-4a02-9769-ea29cfb2052f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:44.872622 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf878a76-2f92-4a02-9769-ea29cfb2052f None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:44.883554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:44.897050 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:44.920060 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed3a0f-6122-4506-a0aa-57861d8a22ac None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:44.957901 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6335b-fc3a-4319-b33e-f8c90447c0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:44.958605 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6335b-fc3a-4319-b33e-f8c90447c0d9 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:44.958973 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6335b-fc3a-4319-b33e-f8c90447c0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:44.959268 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6335b-fc3a-4319-b33e-f8c90447c0d9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:44.967613 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6335b-fc3a-4319-b33e-f8c90447c0d9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:44.969103 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6335b-fc3a-4319-b33e-f8c90447c0d9 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:44.983538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-71d6335b-fc3a-4319-b33e-f8c90447c0d9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 04:39:44.983538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:44.983538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:44.983538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:44.983538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:44.983538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:44.983538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:44.983538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:44.983538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:44.983538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:44.983538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:44.983538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:44.983538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:39:44.983538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:39:44.983538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:39:44.983538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:39:44.984983 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:44.984983 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:44.984983 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:39:44.984983 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:44.984983 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:39:44.984983 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:44.984983 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:44.984983 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:44.984983 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:44.984983 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:44.984983 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:44.984983 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:44.984983 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:44.984983 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:44.984983 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:44.984983 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:44.984983 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:44.984983 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:44.986308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:44.986308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:44.986308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:39:44.986308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:39:44.986308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:39:44.986308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:39:44.986308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:39:44.986308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:39:44.986308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 04:39:44.986308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:44.990151 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 356/734] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:39:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:44.991629 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84c8f8-0488-48c1-90bc-30bfdc0b5fc5 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:44.991920 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84c8f8-0488-48c1-90bc-30bfdc0b5fc5 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:44.992294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84c8f8-0488-48c1-90bc-30bfdc0b5fc5 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:44.993881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 357/735] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:44.994620 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84c8f8-0488-48c1-90bc-30bfdc0b5fc5 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:45.000163 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 379/736] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:39:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:45.006742 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffb960-d595-4fe0-a1b3-796aaa182127 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:45.007217 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffb960-d595-4fe0-a1b3-796aaa182127 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:45.007637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffb960-d595-4fe0-a1b3-796aaa182127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:45.027480 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-66ffb960-d595-4fe0-a1b3-796aaa182127 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:45.029062 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-66ffb960-d595-4fe0-a1b3-796aaa182127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:45.115396 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84c8f8-0488-48c1-90bc-30bfdc0b5fc5 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:45.122980 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 380/737] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:45.124090 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffb960-d595-4fe0-a1b3-796aaa182127 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:45.164986 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:45.175074 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a4b29-615d-4c75-8526-f20ab35c5f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:45.176195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a4b29-615d-4c75-8526-f20ab35c5f2b None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:45.176524 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a4b29-615d-4c75-8526-f20ab35c5f2b None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:45.177132 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a4b29-615d-4c75-8526-f20ab35c5f2b None admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:45.178036 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a4b29-615d-4c75-8526-f20ab35c5f2b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:45.178420 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a4b29-615d-4c75-8526-f20ab35c5f2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:45.179958 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a4b29-615d-4c75-8526-f20ab35c5f2b None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:45.182355 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:45.203872 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 358/738] 10.222.0.39 () {56 vars in 1135 bytes} [Tue Jul 26 04:39:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:45.204987 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a4b29-615d-4c75-8526-f20ab35c5f2b None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:45.240451 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffb960-d595-4fe0-a1b3-796aaa182127 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:45.278753 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa51f9b-bf8a-4703-bd53-48ae39236dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:45.279735 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa51f9b-bf8a-4703-bd53-48ae39236dd7 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:45.280215 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa51f9b-bf8a-4703-bd53-48ae39236dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:45.280675 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa51f9b-bf8a-4703-bd53-48ae39236dd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:45.293612 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa51f9b-bf8a-4703-bd53-48ae39236dd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:45.295549 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa51f9b-bf8a-4703-bd53-48ae39236dd7 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:45.311796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-aaa51f9b-bf8a-4703-bd53-48ae39236dd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:45.311796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:45.311796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:45.311796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:45.311796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:45.311796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:45.311796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:45.311796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:45.311796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:45.311796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:45.311796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:45.311796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:45.311796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:45.311796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:45.311796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:45.312779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:45.312779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:45.312779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:45.312779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:45.312779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:45.312779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:45.312779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:45.312779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:45.312779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:45.312779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:45.312779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:45.312779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:45.312779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:45.312779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:45.312779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:45.312779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:45.312779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:45.313683 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:45.313683 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:45.313683 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:45.313683 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:45.313683 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 381/739] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:45.314635 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa51f9b-bf8a-4703-bd53-48ae39236dd7 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:45.325058 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a4b29-615d-4c75-8526-f20ab35c5f2b None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:45.362668 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062c82b-4117-467a-8c79-027a58543308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:45.363654 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062c82b-4117-467a-8c79-027a58543308 None admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:45.364277 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062c82b-4117-467a-8c79-027a58543308 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:45.364730 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062c82b-4117-467a-8c79-027a58543308 None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:45.366300 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9062c82b-4117-467a-8c79-027a58543308 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:45.368034 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9062c82b-4117-467a-8c79-027a58543308 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:45.394006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 359/740] 10.222.0.39 () {60 vars in 1141 bytes} [Tue Jul 26 04:39:45 2022] POST /identity/v3/services => generated 251 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:39:45.394006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3342fa-5df1-463b-9a94-bee125e8e6ee None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:45.394006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3342fa-5df1-463b-9a94-bee125e8e6ee None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:45.394006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3342fa-5df1-463b-9a94-bee125e8e6ee None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:45.398177 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 360/741] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:45.399178 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3342fa-5df1-463b-9a94-bee125e8e6ee None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:45.429857 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:45.444414 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa51f9b-bf8a-4703-bd53-48ae39236dd7 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:45.478552 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:45.509775 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c535b0-f03c-4a92-b507-053c21f9a45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:45.510474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c535b0-f03c-4a92-b507-053c21f9a45a None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:45.510757 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c535b0-f03c-4a92-b507-053c21f9a45a None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:45.511082 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c535b0-f03c-4a92-b507-053c21f9a45a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:45.549307 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3342fa-5df1-463b-9a94-bee125e8e6ee None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:45.598441 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f206f9-b757-40aa-ab98-e7312c787062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:45.599248 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f206f9-b757-40aa-ab98-e7312c787062 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:45.599627 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f206f9-b757-40aa-ab98-e7312c787062 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:45.599999 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f206f9-b757-40aa-ab98-e7312c787062 None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:45.600861 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f206f9-b757-40aa-ab98-e7312c787062 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:45.601078 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c535b0-f03c-4a92-b507-053c21f9a45a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:45.601197 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f206f9-b757-40aa-ab98-e7312c787062 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:45.602607 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c535b0-f03c-4a92-b507-053c21f9a45a None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:45.603042 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f206f9-b757-40aa-ab98-e7312c787062 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:45.617532 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 361/742] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:45.619185 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa5c4e-c6c0-4e0e-a6f3-507345fa8565 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:45.619707 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa5c4e-c6c0-4e0e-a6f3-507345fa8565 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:45.620182 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa5c4e-c6c0-4e0e-a6f3-507345fa8565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:45.641523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-32fa5c4e-c6c0-4e0e-a6f3-507345fa8565 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:45.643847 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-32fa5c4e-c6c0-4e0e-a6f3-507345fa8565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:45.710285 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:45.723031 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 382/743] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:39:45 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 26 04:39:45.724002 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c535b0-f03c-4a92-b507-053c21f9a45a None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:45.739670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 362/744] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:45 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:45.741220 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa5c4e-c6c0-4e0e-a6f3-507345fa8565 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:45.793347 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:45.855123 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c535b0-f03c-4a92-b507-053c21f9a45a None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:45.885639 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa5c4e-c6c0-4e0e-a6f3-507345fa8565 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:45.906209 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca4794-d46d-41e6-a6ac-b9b49c6a6fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:45.907609 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca4794-d46d-41e6-a6ac-b9b49c6a6fc7 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:45.908171 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca4794-d46d-41e6-a6ac-b9b49c6a6fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:45.909176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca4794-d46d-41e6-a6ac-b9b49c6a6fc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:45.919870 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca4794-d46d-41e6-a6ac-b9b49c6a6fc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:45.921361 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca4794-d46d-41e6-a6ac-b9b49c6a6fc7 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:45.930986 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23c18c-8f4f-4033-b77f-fa59d5e0bc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:45.931639 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23c18c-8f4f-4033-b77f-fa59d5e0bc7c None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:45.931914 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23c18c-8f4f-4033-b77f-fa59d5e0bc7c None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:45.932181 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23c18c-8f4f-4033-b77f-fa59d5e0bc7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:45.937333 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-01ca4794-d46d-41e6-a6ac-b9b49c6a6fc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:45.937333 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:45.937333 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:45.937333 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:45.937333 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:45.937333 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:45.937333 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:45.937333 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:45.937333 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:45.937333 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:45.937333 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:45.937333 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:45.937333 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:39:45.937333 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:39:45.937333 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:39:45.938282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:39:45.938282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:45.938282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:45.938282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:45.938282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:45.938282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:45.938282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:45.938282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:45.938282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:45.938282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:45.938282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:45.938282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:45.938282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:45.938282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:45.938282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:45.938282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:45.938282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:45.939269 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:39:45.939269 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:39:45.939269 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:39:45.939269 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:39:45.939269 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:39:45.939269 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:39:45.939269 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:45.939269 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:45.942546 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 383/745] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:45.943540 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca4794-d46d-41e6-a6ac-b9b49c6a6fc7 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:45.948812 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23c18c-8f4f-4033-b77f-fa59d5e0bc7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:45.951214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23c18c-8f4f-4033-b77f-fa59d5e0bc7c None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:45.971319 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-da23c18c-8f4f-4033-b77f-fa59d5e0bc7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:45.971319 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:45.971319 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:45.971319 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:45.971319 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:45.971319 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:45.971319 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:45.971319 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:45.971319 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:45.971319 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:45.971319 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:45.971319 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:45.971319 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:45.971319 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:45.971319 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:45.972490 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:45.972490 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:45.972490 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:45.972490 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:45.972490 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:45.972490 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:45.972490 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:45.972490 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:45.972490 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:45.972490 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:45.972490 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:45.972490 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:45.972490 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:45.972490 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:45.972490 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:45.972490 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:45.972490 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:45.973635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:45.973635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:45.973635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:45.973635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:45.980115 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 363/746] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:45.980115 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23c18c-8f4f-4033-b77f-fa59d5e0bc7c None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:46.012304 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:46.068990 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca4794-d46d-41e6-a6ac-b9b49c6a6fc7 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:46.078050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:46.089999 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23c18c-8f4f-4033-b77f-fa59d5e0bc7c None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:46.104391 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed5f8d-c310-49f8-bcc6-922b41bdc4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:46.105052 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed5f8d-c310-49f8-bcc6-922b41bdc4ef None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:46.105329 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed5f8d-c310-49f8-bcc6-922b41bdc4ef None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:46.105599 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed5f8d-c310-49f8-bcc6-922b41bdc4ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:46.116915 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed5f8d-c310-49f8-bcc6-922b41bdc4ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:46.121926 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-5bed5f8d-c310-49f8-bcc6-922b41bdc4ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:39:46.121926 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:46.121926 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:46.121926 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:46.121926 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:46.121926 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:46.121926 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:46.121926 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:46.121926 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:46.121926 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:46.121926 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:46.121926 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:46.121926 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:46.121926 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:46.121926 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:46.121926 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:46.122993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:46.122993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:46.122993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:46.122993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:46.122993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:46.122993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:46.122993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:46.122993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:46.122993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:46.122993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:46.122993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:46.122993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:46.122993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:46.122993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:46.122993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:46.122993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:46.123832 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:46.123832 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:46.123832 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:46.123832 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:46.123832 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:46.123832 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:46.123832 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:46.123832 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:46.123832 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:46.123832 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:46.123832 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:39:46.123832 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:46.123832 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 384/747] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:39:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:46.124527 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed5f8d-c310-49f8-bcc6-922b41bdc4ef None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:46.132386 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e654bd6-e01f-4923-8868-8abaa97ee1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:46.133034 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e654bd6-e01f-4923-8868-8abaa97ee1a3 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:46.133314 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e654bd6-e01f-4923-8868-8abaa97ee1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:46.133586 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e654bd6-e01f-4923-8868-8abaa97ee1a3 None admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:46.134408 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e654bd6-e01f-4923-8868-8abaa97ee1a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:46.134716 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e654bd6-e01f-4923-8868-8abaa97ee1a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:46.136250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e654bd6-e01f-4923-8868-8abaa97ee1a3 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:46.149891 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 364/748] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:39:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:46.151214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27e47b-72ed-4167-82b5-b9c9f0e5abd5 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:46.151501 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27e47b-72ed-4167-82b5-b9c9f0e5abd5 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:46.151776 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27e47b-72ed-4167-82b5-b9c9f0e5abd5 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:46.153123 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 365/749] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:46.153685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27e47b-72ed-4167-82b5-b9c9f0e5abd5 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:46.235976 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed5f8d-c310-49f8-bcc6-922b41bdc4ef None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:46.247911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:46.269274 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27e47b-72ed-4167-82b5-b9c9f0e5abd5 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:46.278413 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4bab45-7348-4339-8d78-b6e37610090a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:46.279820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4bab45-7348-4339-8d78-b6e37610090a None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:46.280304 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4bab45-7348-4339-8d78-b6e37610090a None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:46.281185 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4bab45-7348-4339-8d78-b6e37610090a None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:46.282393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4bab45-7348-4339-8d78-b6e37610090a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:46.282968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4bab45-7348-4339-8d78-b6e37610090a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:46.285320 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4bab45-7348-4339-8d78-b6e37610090a None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:46.300622 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 385/750] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:46.301500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4bab45-7348-4339-8d78-b6e37610090a None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:46.315721 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa7941-c3b6-4ae8-94cf-cccd47e7a4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:46.316993 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa7941-c3b6-4ae8-94cf-cccd47e7a4c0 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:46.317480 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa7941-c3b6-4ae8-94cf-cccd47e7a4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:46.318003 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa7941-c3b6-4ae8-94cf-cccd47e7a4c0 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:46.319231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa7941-c3b6-4ae8-94cf-cccd47e7a4c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:46.319741 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa7941-c3b6-4ae8-94cf-cccd47e7a4c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:46.321741 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa7941-c3b6-4ae8-94cf-cccd47e7a4c0 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:46.335603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 366/751] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:39:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:46.335603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808b7e6-8fac-4af5-a82c-b59798e3c4e8 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:46.335603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808b7e6-8fac-4af5-a82c-b59798e3c4e8 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:46.335603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808b7e6-8fac-4af5-a82c-b59798e3c4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:46.351318 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-2808b7e6-8fac-4af5-a82c-b59798e3c4e8 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:46.352541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-2808b7e6-8fac-4af5-a82c-b59798e3c4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:46.360716 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:46.419548 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4bab45-7348-4339-8d78-b6e37610090a None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:46.423697 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 367/752] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:46 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 26 04:39:46.424566 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808b7e6-8fac-4af5-a82c-b59798e3c4e8 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:46.462993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419a3e8-6077-477c-b50b-de43874914ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:46.463631 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419a3e8-6077-477c-b50b-de43874914ae None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:46.463903 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419a3e8-6077-477c-b50b-de43874914ae None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:46.464174 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419a3e8-6077-477c-b50b-de43874914ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:46.465012 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419a3e8-6077-477c-b50b-de43874914ae None admin] RBAC: Adding query filter params (role.id=a22f1a3785a746048e38205d1996764b, scope.project.id=c4d7c29a2b144df6afa96fd6894254a4, user.id=b613dee1148c4822af2e7847b28cf4aa) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:46.465322 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419a3e8-6077-477c-b50b-de43874914ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:46.466822 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419a3e8-6077-477c-b50b-de43874914ae None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:46.482037 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 386/753] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:39:46 2022] GET /identity/v3/role_assignments?user.id=b613dee1148c4822af2e7847b28cf4aa&scope.project.id=c4d7c29a2b144df6afa96fd6894254a4&role.id=a22f1a3785a746048e38205d1996764b => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:46.482037 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419a3e8-6077-477c-b50b-de43874914ae None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:46.528281 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:46.579078 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808b7e6-8fac-4af5-a82c-b59798e3c4e8 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:46.620803 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03166569-de62-4b11-a0b3-be920e22d48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:46.621551 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03166569-de62-4b11-a0b3-be920e22d48c None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:46.621829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03166569-de62-4b11-a0b3-be920e22d48c None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:46.622171 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03166569-de62-4b11-a0b3-be920e22d48c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:46.630144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03166569-de62-4b11-a0b3-be920e22d48c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:46.631632 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03166569-de62-4b11-a0b3-be920e22d48c None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:46.634650 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419a3e8-6077-477c-b50b-de43874914ae None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:46.646631 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-03166569-de62-4b11-a0b3-be920e22d48c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:46.646631 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:46.646631 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:46.646631 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:46.646631 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:46.646631 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:46.646631 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:46.646631 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:46.646631 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:46.646631 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:46.646631 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:46.646631 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:46.646631 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:39:46.646631 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:39:46.646631 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:39:46.647592 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:39:46.647592 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:46.647592 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:46.647592 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:46.647592 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:46.647592 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:46.647592 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:46.647592 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:46.647592 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:46.647592 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:46.647592 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:46.647592 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:46.647592 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:46.647592 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:46.647592 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:46.647592 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:46.647592 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:46.648505 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:39:46.648505 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:39:46.648505 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:39:46.648505 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:39:46.648505 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:39:46.648505 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:39:46.648505 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:46.648505 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:46.649916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 368/754] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:46.650520 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03166569-de62-4b11-a0b3-be920e22d48c None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:46.657444 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:46.683872 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bc66d-7695-4128-86eb-932c0532e6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:46.684449 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bc66d-7695-4128-86eb-932c0532e6d0 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:46.684727 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bc66d-7695-4128-86eb-932c0532e6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:46.684997 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4bc66d-7695-4128-86eb-932c0532e6d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:46.700682 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4bc66d-7695-4128-86eb-932c0532e6d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:46.703114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4bc66d-7695-4128-86eb-932c0532e6d0 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:46.720474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-9b4bc66d-7695-4128-86eb-932c0532e6d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:46.720474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:46.720474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:46.720474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:46.720474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:46.720474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:46.720474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:46.720474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:46.720474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:46.720474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:46.720474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:46.720474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:46.720474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:46.720474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:46.720474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:46.721439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:46.721439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:46.721439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:46.721439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:46.721439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:46.721439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:46.721439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:46.721439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:46.721439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:46.721439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:46.721439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:46.721439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:46.721439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:46.721439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:46.721439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:46.721439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:46.721439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:46.722384 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:46.722384 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:46.722384 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:46.722384 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:46.722384 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 387/755] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:46.723097 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bc66d-7695-4128-86eb-932c0532e6d0 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:46.785801 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03166569-de62-4b11-a0b3-be920e22d48c None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:46.828030 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009994e0-9491-411d-8e03-ee3afdc09196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:46.829015 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009994e0-9491-411d-8e03-ee3afdc09196 None admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:46.829293 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009994e0-9491-411d-8e03-ee3afdc09196 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:46.829564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009994e0-9491-411d-8e03-ee3afdc09196 None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:46.830907 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009994e0-9491-411d-8e03-ee3afdc09196 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:46.832427 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009994e0-9491-411d-8e03-ee3afdc09196 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:46.837246 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:46.856127 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 369/756] 10.222.0.39 () {60 vars in 1141 bytes} [Tue Jul 26 04:39:46 2022] POST /identity/v3/services => generated 240 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:39:46.856664 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4bc66d-7695-4128-86eb-932c0532e6d0 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:46.857042 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009994e0-9491-411d-8e03-ee3afdc09196 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:46.937534 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:46.938079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153bcf9-7e67-4ef2-9248-91b047a3d881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:46.939886 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153bcf9-7e67-4ef2-9248-91b047a3d881 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:46.940423 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153bcf9-7e67-4ef2-9248-91b047a3d881 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:46.941026 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153bcf9-7e67-4ef2-9248-91b047a3d881 None admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:46.942083 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153bcf9-7e67-4ef2-9248-91b047a3d881 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:46.942424 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153bcf9-7e67-4ef2-9248-91b047a3d881 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:46.944077 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153bcf9-7e67-4ef2-9248-91b047a3d881 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:46.972890 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 388/757] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:39:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:46.980661 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153bcf9-7e67-4ef2-9248-91b047a3d881 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:46.988839 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009994e0-9491-411d-8e03-ee3afdc09196 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:47.033817 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a70ee-b1a5-4a02-a09a-b71cf8e6c443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:47.034495 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a70ee-b1a5-4a02-a09a-b71cf8e6c443 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:47.034769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a70ee-b1a5-4a02-a09a-b71cf8e6c443 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:47.035036 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a70ee-b1a5-4a02-a09a-b71cf8e6c443 None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:47.035746 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a70ee-b1a5-4a02-a09a-b71cf8e6c443 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:47.036043 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a70ee-b1a5-4a02-a09a-b71cf8e6c443 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:47.038376 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80a70ee-b1a5-4a02-a09a-b71cf8e6c443 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:47.058889 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 370/758] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:47.064961 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a70ee-b1a5-4a02-a09a-b71cf8e6c443 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:47.145666 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153bcf9-7e67-4ef2-9248-91b047a3d881 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:47.179987 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a70ee-b1a5-4a02-a09a-b71cf8e6c443 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:47.195580 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ba373-5bbf-4804-97ac-102245aac5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:47.196491 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ba373-5bbf-4804-97ac-102245aac5f6 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:47.197179 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ba373-5bbf-4804-97ac-102245aac5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:47.197645 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ba373-5bbf-4804-97ac-102245aac5f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:47.199327 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ba373-5bbf-4804-97ac-102245aac5f6 None admin] RBAC: Adding query filter params (role.id=2bfdd65b06554a6da967b3939da753c7, scope.project.id=c4d7c29a2b144df6afa96fd6894254a4, user.id=0e089e39e9de419b9e2fb1d7fc2d245a) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:47.199923 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ba373-5bbf-4804-97ac-102245aac5f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:47.202146 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69ba373-5bbf-4804-97ac-102245aac5f6 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:47.211835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:47.213526 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 389/759] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:39:46 2022] GET /identity/v3/role_assignments?user.id=0e089e39e9de419b9e2fb1d7fc2d245a&scope.project.id=c4d7c29a2b144df6afa96fd6894254a4&role.id=2bfdd65b06554a6da967b3939da753c7 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:39:47.228851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4f0e1-81fa-4fbc-adce-0e76a3aec802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:47.229531 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4f0e1-81fa-4fbc-adce-0e76a3aec802 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:47.229806 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4f0e1-81fa-4fbc-adce-0e76a3aec802 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:47.230140 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4f0e1-81fa-4fbc-adce-0e76a3aec802 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:47.239032 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4f0e1-81fa-4fbc-adce-0e76a3aec802 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:47.240595 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4f0e1-81fa-4fbc-adce-0e76a3aec802 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:47.255437 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-3ca4f0e1-81fa-4fbc-adce-0e76a3aec802 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 04:39:47.255437 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:47.255437 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:47.255437 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:47.255437 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:47.255437 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:47.255437 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:47.255437 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:47.255437 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:47.255437 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:47.255437 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:47.255437 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:47.255437 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:39:47.255437 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:39:47.255437 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:39:47.255437 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:39:47.256494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:47.256494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:47.256494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:39:47.256494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:47.256494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:39:47.256494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:47.256494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:47.256494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:47.256494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:47.256494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:47.256494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:47.256494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:47.256494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:47.256494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:47.256494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:47.256494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:47.256494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:47.256494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:47.257460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:47.257460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:47.257460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:39:47.257460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:39:47.257460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:39:47.257460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:39:47.257460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:39:47.257460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:39:47.257460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 04:39:47.257460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:47.257460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 371/760] 10.222.0.39 () {56 vars in 1093 bytes} [Tue Jul 26 04:39:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:47.267329 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ba373-5bbf-4804-97ac-102245aac5f6 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:47.281474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:47.386929 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ba373-5bbf-4804-97ac-102245aac5f6 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:47.424623 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda3cac-2bd7-4e8d-b451-efe9d963f3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:47.425640 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda3cac-2bd7-4e8d-b451-efe9d963f3c7 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:47.426188 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda3cac-2bd7-4e8d-b451-efe9d963f3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:47.426668 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda3cac-2bd7-4e8d-b451-efe9d963f3c7 None admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:47.427699 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda3cac-2bd7-4e8d-b451-efe9d963f3c7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:47.428233 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda3cac-2bd7-4e8d-b451-efe9d963f3c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:47.429932 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda3cac-2bd7-4e8d-b451-efe9d963f3c7 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:47.450797 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 390/761] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Jul 26 04:39:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:47.459090 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4f0e1-81fa-4fbc-adce-0e76a3aec802 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:47.553269 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e97d33-25bf-48a4-8ab0-642aee036bf4 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:47.553921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e97d33-25bf-48a4-8ab0-642aee036bf4 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:47.554421 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e97d33-25bf-48a4-8ab0-642aee036bf4 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:47.556280 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 391/762] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:47.562409 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c627d-cd6c-40d0-847a-4ed0a48d1a6a None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:47.563050 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c627d-cd6c-40d0-847a-4ed0a48d1a6a None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:47.563549 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c627d-cd6c-40d0-847a-4ed0a48d1a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:47.583352 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-950c627d-cd6c-40d0-847a-4ed0a48d1a6a None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:47.585084 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-950c627d-cd6c-40d0-847a-4ed0a48d1a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:47.698114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:47.702579 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4f0e1-81fa-4fbc-adce-0e76a3aec802 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:47.716200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 392/763] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 04:39:47.747255 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c627d-cd6c-40d0-847a-4ed0a48d1a6a None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:47.747460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbf8f1-a1b4-47ec-9e91-283b9a475cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:47.747948 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbf8f1-a1b4-47ec-9e91-283b9a475cf9 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:47.748223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbf8f1-a1b4-47ec-9e91-283b9a475cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:47.748486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbf8f1-a1b4-47ec-9e91-283b9a475cf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:47.760646 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbf8f1-a1b4-47ec-9e91-283b9a475cf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:47.761876 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbf8f1-a1b4-47ec-9e91-283b9a475cf9 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:47.789053 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-b8cbf8f1-a1b4-47ec-9e91-283b9a475cf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:47.789053 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:47.789053 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:47.789053 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:47.789053 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:47.789053 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:47.789053 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:47.789053 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:47.789053 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:47.789053 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:47.789053 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:47.789053 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:47.789053 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:47.789053 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:47.789053 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:47.790489 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:47.790489 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:47.790489 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:47.790489 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:47.790489 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:47.790489 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:47.790489 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:47.790489 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:47.790489 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:47.790489 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:47.790489 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:47.790489 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:47.790489 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:47.790489 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:47.790489 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:47.790489 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:47.790489 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:47.791407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:47.791407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:47.791407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:47.791407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:47.791407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 372/764] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:47.798105 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbf8f1-a1b4-47ec-9e91-283b9a475cf9 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:47.866571 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:47.965306 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c627d-cd6c-40d0-847a-4ed0a48d1a6a None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:48.004402 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbf8f1-a1b4-47ec-9e91-283b9a475cf9 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:48.029339 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f008d-fc1d-458b-8fce-b4afff55b8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:48.030036 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f008d-fc1d-458b-8fce-b4afff55b8e7 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:48.030315 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f008d-fc1d-458b-8fce-b4afff55b8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:48.030586 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f008d-fc1d-458b-8fce-b4afff55b8e7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:48.031224 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f008d-fc1d-458b-8fce-b4afff55b8e7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:48.032623 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f008d-fc1d-458b-8fce-b4afff55b8e7 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:48.047928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-1d3f008d-fc1d-458b-8fce-b4afff55b8e7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 04:39:48.047928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:48.047928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 04:39:48.047928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 04:39:48.047928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 04:39:48.047928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 04:39:48.047928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 04:39:48.047928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:39:48.047928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 04:39:48.047928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:48.047928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 04:39:48.047928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:48.047928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:48.047928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:48.047928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:48.047928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:48.048994 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:48.048994 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:48.048994 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:48.048994 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:48.048994 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:48.048994 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:48.048994 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:48.048994 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 04:39:48.048994 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 04:39:48.048994 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 04:39:48.048994 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 04:39:48.048994 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:48.048994 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:48.048994 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:48.048994 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:48.048994 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:48.049846 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:48.049846 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:48.049846 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:48.049846 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:48.049846 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:48.049846 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:48.049846 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:48.049846 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:48.049846 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:48.049846 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:48.049846 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:48.049846 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 04:39:48.049846 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:39:48.049846 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 04:39:48.049846 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:48.049846 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 393/765] 10.222.0.39 () {56 vars in 1129 bytes} [Tue Jul 26 04:39:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:48.057019 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f008d-fc1d-458b-8fce-b4afff55b8e7 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:48.074669 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdabc54d-964f-4f1d-b9f1-b7af06b36352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:48.075300 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabc54d-964f-4f1d-b9f1-b7af06b36352 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:48.075628 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabc54d-964f-4f1d-b9f1-b7af06b36352 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:48.075903 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabc54d-964f-4f1d-b9f1-b7af06b36352 None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:48.076600 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdabc54d-964f-4f1d-b9f1-b7af06b36352 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:48.076897 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdabc54d-964f-4f1d-b9f1-b7af06b36352 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:48.078307 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdabc54d-964f-4f1d-b9f1-b7af06b36352 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:48.098903 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 373/766] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:48.105146 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdabc54d-964f-4f1d-b9f1-b7af06b36352 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:48.169600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:48.255773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f008d-fc1d-458b-8fce-b4afff55b8e7 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:48.312621 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad2d09-06f7-4e5d-9482-302b0d6960de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:48.313680 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad2d09-06f7-4e5d-9482-302b0d6960de None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:48.314235 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad2d09-06f7-4e5d-9482-302b0d6960de None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:48.314711 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad2d09-06f7-4e5d-9482-302b0d6960de None admin] PATH_INFO: `/v3/services` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:48.315636 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad2d09-06f7-4e5d-9482-302b0d6960de None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:48.319354 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad2d09-06f7-4e5d-9482-302b0d6960de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:48.321362 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ad2d09-06f7-4e5d-9482-302b0d6960de None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:48.330286 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 394/767] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Jul 26 04:39:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:48.336647 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad2d09-06f7-4e5d-9482-302b0d6960de None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:48.340733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:48.350468 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdabc54d-964f-4f1d-b9f1-b7af06b36352 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:48.419338 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887adaaf-e243-40dd-84a1-ae5078e3376a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:48.420397 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887adaaf-e243-40dd-84a1-ae5078e3376a None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:48.420881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887adaaf-e243-40dd-84a1-ae5078e3376a None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:48.421386 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887adaaf-e243-40dd-84a1-ae5078e3376a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:48.442994 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887adaaf-e243-40dd-84a1-ae5078e3376a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:48.445234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887adaaf-e243-40dd-84a1-ae5078e3376a None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:48.470372 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-887adaaf-e243-40dd-84a1-ae5078e3376a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:48.470372 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:48.470372 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:48.470372 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:48.470372 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:48.470372 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:48.470372 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:48.470372 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:48.470372 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:48.470372 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:48.470372 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:48.470372 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:48.470372 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:39:48.470372 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:39:48.470372 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:39:48.471366 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:39:48.471366 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:48.471366 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:48.471366 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:48.471366 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:48.471366 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:48.471366 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:48.471366 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:48.471366 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:48.471366 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:48.471366 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:48.471366 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:48.471366 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:48.471366 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:48.471366 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:48.471366 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:48.471366 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:48.472271 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:39:48.472271 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:39:48.472271 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:39:48.472271 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:39:48.472271 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:39:48.472271 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:39:48.472271 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:48.472271 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:48.482022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad2d09-06f7-4e5d-9482-302b0d6960de None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:48.482721 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 374/768] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:48.483878 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887adaaf-e243-40dd-84a1-ae5078e3376a None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:48.518090 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a023c-be55-4d9c-9aaa-41a58258f483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:48.518090 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a023c-be55-4d9c-9aaa-41a58258f483 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:48.518090 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a023c-be55-4d9c-9aaa-41a58258f483 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:48.518090 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a023c-be55-4d9c-9aaa-41a58258f483 None admin] PATH_INFO: `/v3/services` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:48.518487 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a023c-be55-4d9c-9aaa-41a58258f483 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:48.518487 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a023c-be55-4d9c-9aaa-41a58258f483 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:48.518487 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a023c-be55-4d9c-9aaa-41a58258f483 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:48.520779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:48.529947 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 395/769] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Jul 26 04:39:48 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:48.536278 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a023c-be55-4d9c-9aaa-41a58258f483 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:48.630812 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887adaaf-e243-40dd-84a1-ae5078e3376a None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:48.670664 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51f475-f29d-41c3-aa5e-beec79272464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:48.671964 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51f475-f29d-41c3-aa5e-beec79272464 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:48.672249 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51f475-f29d-41c3-aa5e-beec79272464 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:48.672525 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca51f475-f29d-41c3-aa5e-beec79272464 None admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:48.673288 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51f475-f29d-41c3-aa5e-beec79272464 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:48.673652 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51f475-f29d-41c3-aa5e-beec79272464 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:48.675473 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca51f475-f29d-41c3-aa5e-beec79272464 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:48.690524 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 375/770] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:39:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:48.696944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51f475-f29d-41c3-aa5e-beec79272464 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:48.738388 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:48.849903 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca51f475-f29d-41c3-aa5e-beec79272464 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:48.879666 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a023c-be55-4d9c-9aaa-41a58258f483 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:48.894161 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b897345-fd5c-4cc9-be25-f1ece854cd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:48.895304 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b897345-fd5c-4cc9-be25-f1ece854cd2f None admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:48.895598 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b897345-fd5c-4cc9-be25-f1ece854cd2f None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:48.895875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b897345-fd5c-4cc9-be25-f1ece854cd2f None admin] PATH_INFO: `/v3/projects/c4d7c29a2b144df6afa96fd6894254a4/users/ae8593e125da4b208dd100608aa2b462/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:48.898363 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b897345-fd5c-4cc9-be25-f1ece854cd2f None admin] RBAC: Authorizing `identity:create_grant(project_id=c4d7c29a2b144df6afa96fd6894254a4, user_id=ae8593e125da4b208dd100608aa2b462, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:48.900178 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b897345-fd5c-4cc9-be25-f1ece854cd2f None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:48.918544 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 376/771] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 04:39:48 2022] PUT /identity/v3/projects/c4d7c29a2b144df6afa96fd6894254a4/users/ae8593e125da4b208dd100608aa2b462/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:39:48.918878 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ad829-a4b4-42bb-a3d9-6a767f9a3f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:48.919573 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ad829-a4b4-42bb-a3d9-6a767f9a3f92 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:48.919860 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ad829-a4b4-42bb-a3d9-6a767f9a3f92 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:48.920032 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e80bf3-4d5a-4a5c-8523-5a8cc237c9c3 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:48.920186 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3ad829-a4b4-42bb-a3d9-6a767f9a3f92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:48.920363 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e80bf3-4d5a-4a5c-8523-5a8cc237c9c3 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:48.920513 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e80bf3-4d5a-4a5c-8523-5a8cc237c9c3 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:48.920897 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ad829-a4b4-42bb-a3d9-6a767f9a3f92 None admin] RBAC: Adding query filter params (interface=public, service_id=f4a69e13b8894c719697611032cb7adf, region_id=RegionOne) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:48.921275 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ad829-a4b4-42bb-a3d9-6a767f9a3f92 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:48.922012 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 377/772] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:48.927035 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3ad829-a4b4-42bb-a3d9-6a767f9a3f92 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:48.927863 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a86064-9ac7-4113-8c36-1abadaf3982d None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:48.928246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a86064-9ac7-4113-8c36-1abadaf3982d None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:48.928613 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a86064-9ac7-4113-8c36-1abadaf3982d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:48.941607 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 396/773] 10.222.0.39 () {56 vars in 1251 bytes} [Tue Jul 26 04:39:48 2022] GET /identity/v3/endpoints?service_id=f4a69e13b8894c719697611032cb7adf&interface=public®ion_id=RegionOne => generated 194 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:39:48.942964 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ad829-a4b4-42bb-a3d9-6a767f9a3f92 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:48.949630 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-79a86064-9ac7-4113-8c36-1abadaf3982d None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:48.950967 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-79a86064-9ac7-4113-8c36-1abadaf3982d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:49.000879 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:49.030733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 378/774] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 04:39:49.055990 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a86064-9ac7-4113-8c36-1abadaf3982d None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:49.059108 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3ad829-a4b4-42bb-a3d9-6a767f9a3f92 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:49.072736 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:49.098296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81577a-2a3e-4076-ae06-2f8dfc47bf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:49.099334 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81577a-2a3e-4076-ae06-2f8dfc47bf80 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:49.099838 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81577a-2a3e-4076-ae06-2f8dfc47bf80 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:49.100392 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a81577a-2a3e-4076-ae06-2f8dfc47bf80 None admin] PATH_INFO: `/v3/services` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:49.101272 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a81577a-2a3e-4076-ae06-2f8dfc47bf80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:49.103031 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a81577a-2a3e-4076-ae06-2f8dfc47bf80 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:49.114114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 397/775] 10.222.0.39 () {56 vars in 1087 bytes} [Tue Jul 26 04:39:48 2022] GET /identity/v3/services => generated 772 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:49.182699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a86064-9ac7-4113-8c36-1abadaf3982d None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:49.225354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d560a5c-5b31-4cb7-807f-a6a5632e05f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:49.226060 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d560a5c-5b31-4cb7-807f-a6a5632e05f8 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:49.226500 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d560a5c-5b31-4cb7-807f-a6a5632e05f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:49.226839 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d560a5c-5b31-4cb7-807f-a6a5632e05f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:49.239973 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d560a5c-5b31-4cb7-807f-a6a5632e05f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:49.245547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-5d560a5c-5b31-4cb7-807f-a6a5632e05f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:49.245547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:49.245547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:49.245547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:49.245547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:49.245547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:49.245547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:49.245547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:49.245547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:49.245547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:49.245547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:49.245547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:49.245547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:49.245547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:49.245547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:49.245547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:49.246829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:49.246829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:49.246829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:49.246829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:49.246829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:49.246829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:49.246829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:49.246829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:49.246829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:49.246829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:49.246829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:49.246829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:49.246829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:49.246829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:49.246829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:49.246829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:49.247920 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:49.247920 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:49.247920 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:49.247920 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:49.247920 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:49.247920 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:49.247920 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:49.247920 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:49.247920 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:49.247920 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:49.247920 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:49.247920 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:49.249344 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 379/776] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 04:39:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:39:49.255352 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81577a-2a3e-4076-ae06-2f8dfc47bf80 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:49.369222 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a81577a-2a3e-4076-ae06-2f8dfc47bf80 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:49.384744 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:49.408454 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a72926-7545-416f-bcb9-0509c033d320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:49.409087 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a72926-7545-416f-bcb9-0509c033d320 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:49.409369 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a72926-7545-416f-bcb9-0509c033d320 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:49.409640 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a72926-7545-416f-bcb9-0509c033d320 None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:49.410401 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a72926-7545-416f-bcb9-0509c033d320 None admin] RBAC: Adding query filter params (name=service) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:49.410706 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a72926-7545-416f-bcb9-0509c033d320 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:49.412225 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a72926-7545-416f-bcb9-0509c033d320 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:49.422619 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 398/777] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 04:39:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:49.428671 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d560a5c-5b31-4cb7-807f-a6a5632e05f8 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:49.502397 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:49.540271 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aab214-ead5-4fe3-bb42-45adea09e74b None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:49.540553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aab214-ead5-4fe3-bb42-45adea09e74b None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:49.540827 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aab214-ead5-4fe3-bb42-45adea09e74b None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:49.542227 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 399/778] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:39:49.548822 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d03cf5-c8aa-4f3b-a056-fcbe6ca8de2f None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:49.549124 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d560a5c-5b31-4cb7-807f-a6a5632e05f8 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:49.549293 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d03cf5-c8aa-4f3b-a056-fcbe6ca8de2f None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:49.549442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d03cf5-c8aa-4f3b-a056-fcbe6ca8de2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:49.581594 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-f8d03cf5-c8aa-4f3b-a056-fcbe6ca8de2f None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:49.582864 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-f8d03cf5-c8aa-4f3b-a056-fcbe6ca8de2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:49.644642 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaad9e7-1317-4bf5-97ff-e7bf15fabe60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:49.645655 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaad9e7-1317-4bf5-97ff-e7bf15fabe60 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:49.645958 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaad9e7-1317-4bf5-97ff-e7bf15fabe60 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:49.646423 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaad9e7-1317-4bf5-97ff-e7bf15fabe60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:49.664160 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaad9e7-1317-4bf5-97ff-e7bf15fabe60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:49.665765 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaad9e7-1317-4bf5-97ff-e7bf15fabe60 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:49.682961 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-ceaad9e7-1317-4bf5-97ff-e7bf15fabe60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:49.682961 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:49.682961 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:49.682961 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:49.682961 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:49.682961 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:49.682961 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:49.682961 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:49.682961 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:49.682961 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:49.682961 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:49.682961 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:49.682961 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:49.682961 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:49.682961 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:49.683944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:49.683944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:49.683944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:49.683944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:49.683944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:49.683944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:49.683944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:49.683944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:49.683944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:49.683944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:49.683944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:49.683944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:49.683944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:49.683944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:49.683944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:49.683944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:49.683944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:49.685469 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:49.685469 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:49.685469 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:49.685469 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:49.685469 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 380/779] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:49.685782 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a8faa-19d4-4afc-95b0-ba519b0f1f00 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:49.686102 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a8faa-19d4-4afc-95b0-ba519b0f1f00 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:49.686378 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a8faa-19d4-4afc-95b0-ba519b0f1f00 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:49.687890 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 381/780] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:49.690983 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a8faa-19d4-4afc-95b0-ba519b0f1f00 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:49.729737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 400/781] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 04:39:49.732557 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f529bd2-d3cc-4a51-ac30-535381851301 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:49.733315 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f529bd2-d3cc-4a51-ac30-535381851301 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:49.733315 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f529bd2-d3cc-4a51-ac30-535381851301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:49.753226 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-6f529bd2-d3cc-4a51-ac30-535381851301 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:49.754529 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-6f529bd2-d3cc-4a51-ac30-535381851301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:49.840704 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a8faa-19d4-4afc-95b0-ba519b0f1f00 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:49.849198 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 401/782] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:39:49.852691 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f529bd2-d3cc-4a51-ac30-535381851301 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:49.867118 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:49.895810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad09615-08c5-431c-ab7f-9130b257a3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:49.896449 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:49.897915 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad09615-08c5-431c-ab7f-9130b257a3da None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:49.898465 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad09615-08c5-431c-ab7f-9130b257a3da None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:49.898918 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad09615-08c5-431c-ab7f-9130b257a3da None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:49.899812 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad09615-08c5-431c-ab7f-9130b257a3da None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:49.900438 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad09615-08c5-431c-ab7f-9130b257a3da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:49.902995 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad09615-08c5-431c-ab7f-9130b257a3da None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:49.934885 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 382/783] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:49.936338 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad09615-08c5-431c-ab7f-9130b257a3da None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:49.982748 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f529bd2-d3cc-4a51-ac30-535381851301 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:50.029154 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b5757-0f38-4fec-8223-37116739cd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:50.029801 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b5757-0f38-4fec-8223-37116739cd28 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:50.030118 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b5757-0f38-4fec-8223-37116739cd28 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:50.030394 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b5757-0f38-4fec-8223-37116739cd28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:50.044357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b5757-0f38-4fec-8223-37116739cd28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:50.050662 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-769b5757-0f38-4fec-8223-37116739cd28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:39:50.050662 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:50.050662 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:50.050662 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:50.050662 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:50.050662 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:50.050662 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:50.050662 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:50.050662 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:50.050662 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:50.050662 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:50.050662 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:50.050662 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:50.050662 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:50.050662 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:50.050662 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:50.051659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:50.051659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:50.051659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:50.051659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:50.051659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:50.051659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:50.051659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:50.051659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:50.051659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:50.051659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:50.051659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:50.051659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:50.051659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:50.051659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:50.051659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:50.051659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:50.052773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:50.052773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:50.052773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:50.052773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:50.052773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:50.052773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:50.052773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:50.052773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:50.052773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:50.052773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:50.052773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:39:50.052773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:50.057317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 402/784] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:39:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:50.058493 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b5757-0f38-4fec-8223-37116739cd28 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:50.075832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad09615-08c5-431c-ab7f-9130b257a3da None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:50.114878 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1588e-209d-4e5d-a40b-75c0f4472e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:50.115921 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1588e-209d-4e5d-a40b-75c0f4472e68 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:50.116525 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1588e-209d-4e5d-a40b-75c0f4472e68 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:50.116996 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1588e-209d-4e5d-a40b-75c0f4472e68 None admin] PATH_INFO: `/v3/services/network` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:50.117839 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1588e-209d-4e5d-a40b-75c0f4472e68 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:50.119556 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1588e-209d-4e5d-a40b-75c0f4472e68 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:50.131959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-66d1588e-209d-4e5d-a40b-75c0f4472e68 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 04:39:50.131959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:50.131959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 04:39:50.131959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 04:39:50.131959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 04:39:50.131959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 04:39:50.131959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 04:39:50.131959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:39:50.131959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 04:39:50.131959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:50.131959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 04:39:50.131959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:50.131959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:50.131959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:50.131959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:50.131959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:50.131959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:50.133067 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:50.133067 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:50.133067 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:50.133067 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:50.133067 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:50.133067 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:50.133067 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 04:39:50.133067 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 04:39:50.133067 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 04:39:50.133067 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 04:39:50.133067 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:50.133067 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:50.133067 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:50.133067 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:50.133067 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:50.133067 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:50.133916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:50.133916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:50.133916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:50.133916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:50.133916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:50.133916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:50.133916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:50.133916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:50.133916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:50.133916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:50.133916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 04:39:50.133916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:39:50.133916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 04:39:50.133916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:50.136907 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 383/785] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:49 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:50.138156 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1588e-209d-4e5d-a40b-75c0f4472e68 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:50.179339 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:50.186291 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b5757-0f38-4fec-8223-37116739cd28 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:50.192887 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:50.242169 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db02785-4149-476b-8f13-1acdae51eeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:50.242861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db02785-4149-476b-8f13-1acdae51eeb2 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:50.243610 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db02785-4149-476b-8f13-1acdae51eeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:50.243894 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db02785-4149-476b-8f13-1acdae51eeb2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:50.254068 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db02785-4149-476b-8f13-1acdae51eeb2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:50.256413 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db02785-4149-476b-8f13-1acdae51eeb2 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:50.267939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1588e-209d-4e5d-a40b-75c0f4472e68 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:50.273390 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-6db02785-4149-476b-8f13-1acdae51eeb2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 04:39:50.273390 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:50.273390 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:50.273390 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:50.273390 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:50.273390 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:50.273390 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:50.273390 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:50.273390 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:50.273390 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:50.273390 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:50.273390 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:50.273390 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:39:50.273390 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:39:50.273390 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:39:50.273390 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:39:50.274427 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:50.274427 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:50.274427 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:39:50.274427 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:50.274427 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:39:50.274427 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:50.274427 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:50.274427 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:50.274427 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:50.274427 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:50.274427 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:50.274427 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:50.274427 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:50.274427 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:50.274427 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:50.274427 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:50.274427 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:50.274427 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:50.276015 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:50.276015 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:50.276015 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:39:50.276015 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:39:50.276015 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:39:50.276015 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:39:50.276015 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:39:50.276015 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:39:50.276015 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 04:39:50.276015 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:50.276015 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 403/786] 10.222.0.39 () {56 vars in 1117 bytes} [Tue Jul 26 04:39:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:50.276015 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db02785-4149-476b-8f13-1acdae51eeb2 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:50.327308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8979fc7-a292-45a4-9467-eae3120d8c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:50.328346 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8979fc7-a292-45a4-9467-eae3120d8c09 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:50.328822 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8979fc7-a292-45a4-9467-eae3120d8c09 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:50.329357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8979fc7-a292-45a4-9467-eae3120d8c09 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:50.330364 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8979fc7-a292-45a4-9467-eae3120d8c09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:50.330942 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8979fc7-a292-45a4-9467-eae3120d8c09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:50.332568 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8979fc7-a292-45a4-9467-eae3120d8c09 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:50.344413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 384/787] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:39:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:50.345842 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8979fc7-a292-45a4-9467-eae3120d8c09 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:50.425017 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db02785-4149-476b-8f13-1acdae51eeb2 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:50.478249 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75336900-fd9a-45f4-bf4f-38729d3c4a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:50.478903 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75336900-fd9a-45f4-bf4f-38729d3c4a26 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:50.479184 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75336900-fd9a-45f4-bf4f-38729d3c4a26 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:50.479461 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75336900-fd9a-45f4-bf4f-38729d3c4a26 None admin] PATH_INFO: `/v3/services` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:50.480461 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75336900-fd9a-45f4-bf4f-38729d3c4a26 None admin] RBAC: Adding query filter params (name=network) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:50.480770 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75336900-fd9a-45f4-bf4f-38729d3c4a26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:50.483666 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75336900-fd9a-45f4-bf4f-38729d3c4a26 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:50.489934 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 404/788] 10.222.0.39 () {56 vars in 1112 bytes} [Tue Jul 26 04:39:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:50.491056 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75336900-fd9a-45f4-bf4f-38729d3c4a26 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:50.491697 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8979fc7-a292-45a4-9467-eae3120d8c09 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:50.493873 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:50.519826 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:50.536554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca0312-26a7-48c2-8124-3ba58a2470d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:50.537191 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca0312-26a7-48c2-8124-3ba58a2470d4 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:50.537475 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca0312-26a7-48c2-8124-3ba58a2470d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:50.537742 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baca0312-26a7-48c2-8124-3ba58a2470d4 None admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:50.538580 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca0312-26a7-48c2-8124-3ba58a2470d4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:50.538890 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca0312-26a7-48c2-8124-3ba58a2470d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:50.540350 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baca0312-26a7-48c2-8124-3ba58a2470d4 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:50.564642 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 385/789] 10.222.0.39 () {56 vars in 1149 bytes} [Tue Jul 26 04:39:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:50.565614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca0312-26a7-48c2-8124-3ba58a2470d4 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:50.606193 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75336900-fd9a-45f4-bf4f-38729d3c4a26 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:50.640896 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68de92-7006-4c2c-9924-29371c178336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:50.641557 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68de92-7006-4c2c-9924-29371c178336 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:50.641872 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68de92-7006-4c2c-9924-29371c178336 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:50.642221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68de92-7006-4c2c-9924-29371c178336 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:50.653795 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68de92-7006-4c2c-9924-29371c178336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:50.655346 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68de92-7006-4c2c-9924-29371c178336 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:50.670587 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-dd68de92-7006-4c2c-9924-29371c178336 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:50.670587 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:50.670587 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:50.670587 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:50.670587 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:50.670587 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:50.670587 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:50.670587 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:50.670587 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:50.670587 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:50.670587 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:50.670587 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:50.670587 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:50.670587 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:50.670587 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:50.671568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:50.671568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:50.671568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:50.671568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:50.671568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:50.671568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:50.671568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:50.671568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:50.671568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:50.671568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:50.671568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:50.671568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:50.671568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:50.671568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:50.671568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:50.671568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:50.671568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:50.672464 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:50.672464 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:50.672464 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:50.672464 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:50.674526 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baca0312-26a7-48c2-8124-3ba58a2470d4 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:50.676522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 405/790] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:50.677448 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68de92-7006-4c2c-9924-29371c178336 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:50.712994 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc89c9-9c70-4190-89f3-569d31253b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:50.713635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc89c9-9c70-4190-89f3-569d31253b3b None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:50.713916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc89c9-9c70-4190-89f3-569d31253b3b None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:50.714221 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc89c9-9c70-4190-89f3-569d31253b3b None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:50.715023 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc89c9-9c70-4190-89f3-569d31253b3b None admin] RBAC: Adding query filter params (type=network) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:50.715331 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc89c9-9c70-4190-89f3-569d31253b3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:50.717198 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc89c9-9c70-4190-89f3-569d31253b3b None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:50.725104 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 386/791] 10.222.0.39 () {56 vars in 1112 bytes} [Tue Jul 26 04:39:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:50.726071 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc89c9-9c70-4190-89f3-569d31253b3b None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:50.750436 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:50.753030 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:50.782015 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68de92-7006-4c2c-9924-29371c178336 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:50.817494 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8af85-501d-4cf1-9d24-5d97efc26b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:50.818183 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8af85-501d-4cf1-9d24-5d97efc26b85 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:50.818503 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8af85-501d-4cf1-9d24-5d97efc26b85 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:50.818769 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8af85-501d-4cf1-9d24-5d97efc26b85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:50.831599 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8af85-501d-4cf1-9d24-5d97efc26b85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:50.833109 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8af85-501d-4cf1-9d24-5d97efc26b85 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:50.843130 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc89c9-9c70-4190-89f3-569d31253b3b None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:50.848332 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-68d8af85-501d-4cf1-9d24-5d97efc26b85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:50.848332 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:50.848332 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:50.848332 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:50.848332 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:50.848332 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:50.848332 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:50.848332 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:50.848332 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:50.848332 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:50.848332 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:50.848332 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:50.848332 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:50.848332 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:50.848332 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:50.849282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:50.849282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:50.849282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:50.849282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:50.849282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:50.849282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:50.849282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:50.849282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:50.849282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:50.849282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:50.849282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:50.849282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:50.849282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:50.849282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:50.849282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:50.849282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:50.849282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:50.850223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:50.850223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:50.850223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:50.850223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:50.854275 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 406/792] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:50.855217 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8af85-501d-4cf1-9d24-5d97efc26b85 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:50.886126 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534482fe-517f-42c0-b5c6-eee94e4baac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:50.887417 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534482fe-517f-42c0-b5c6-eee94e4baac2 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:50.888004 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534482fe-517f-42c0-b5c6-eee94e4baac2 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:50.888460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534482fe-517f-42c0-b5c6-eee94e4baac2 None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:50.889395 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534482fe-517f-42c0-b5c6-eee94e4baac2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:50.889881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534482fe-517f-42c0-b5c6-eee94e4baac2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:50.891484 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534482fe-517f-42c0-b5c6-eee94e4baac2 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:50.905259 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 387/793] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:50.906453 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534482fe-517f-42c0-b5c6-eee94e4baac2 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:50.967423 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8af85-501d-4cf1-9d24-5d97efc26b85 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:50.992242 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:51.003799 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80fd1d4-ba3b-49fe-814b-653cabaab2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:51.004348 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fd1d4-ba3b-49fe-814b-653cabaab2fe None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:51.004775 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fd1d4-ba3b-49fe-814b-653cabaab2fe None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:51.005059 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80fd1d4-ba3b-49fe-814b-653cabaab2fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:51.006257 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80fd1d4-ba3b-49fe-814b-653cabaab2fe None admin] RBAC: Adding query filter params (interface=public, service_id=da5a7ab455fb4b60a791e1f98ee2fcfa, region_id=RegionOne) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:51.006579 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80fd1d4-ba3b-49fe-814b-653cabaab2fe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:51.008259 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80fd1d4-ba3b-49fe-814b-653cabaab2fe None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:51.009134 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:51.014798 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 407/794] 10.222.0.39 () {56 vars in 1251 bytes} [Tue Jul 26 04:39:50 2022] GET /identity/v3/endpoints?service_id=da5a7ab455fb4b60a791e1f98ee2fcfa&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:51.016226 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80fd1d4-ba3b-49fe-814b-653cabaab2fe None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:51.031023 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534482fe-517f-42c0-b5c6-eee94e4baac2 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:51.073034 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1887585-1ab2-4e13-9e28-7493ecf0c44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:51.074183 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1887585-1ab2-4e13-9e28-7493ecf0c44b None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:51.074708 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1887585-1ab2-4e13-9e28-7493ecf0c44b None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:51.075161 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1887585-1ab2-4e13-9e28-7493ecf0c44b None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:51.076034 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1887585-1ab2-4e13-9e28-7493ecf0c44b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:51.076534 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1887585-1ab2-4e13-9e28-7493ecf0c44b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:51.078350 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1887585-1ab2-4e13-9e28-7493ecf0c44b None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:51.092077 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 388/795] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:51.093148 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1887585-1ab2-4e13-9e28-7493ecf0c44b None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:51.148055 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80fd1d4-ba3b-49fe-814b-653cabaab2fe None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:51.195886 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394f523-8a71-47c2-83ae-851442e20561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:51.196546 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394f523-8a71-47c2-83ae-851442e20561 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:51.196826 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394f523-8a71-47c2-83ae-851442e20561 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:51.197223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394f523-8a71-47c2-83ae-851442e20561 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:51.208618 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394f523-8a71-47c2-83ae-851442e20561 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:51.209061 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1887585-1ab2-4e13-9e28-7493ecf0c44b None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:51.210129 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394f523-8a71-47c2-83ae-851442e20561 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:51.226120 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-3394f523-8a71-47c2-83ae-851442e20561 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 04:39:51.226120 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:51.226120 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:51.226120 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:51.226120 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:51.226120 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:51.226120 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:51.226120 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:51.226120 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:51.226120 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:51.226120 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:51.226120 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:51.226120 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:39:51.226120 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:39:51.226120 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:39:51.226120 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:39:51.227869 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:51.227869 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:51.227869 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:39:51.227869 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:51.227869 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:39:51.227869 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:51.227869 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:51.227869 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:51.227869 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:51.227869 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:51.227869 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:51.227869 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:51.227869 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:51.227869 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:51.227869 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:51.227869 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:51.227869 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:51.227869 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:51.228829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:51.228829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:51.228829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:39:51.228829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:39:51.228829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:39:51.228829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:39:51.228829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:39:51.228829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:39:51.228829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 04:39:51.228829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:51.232306 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 408/796] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:39:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:51.233465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394f523-8a71-47c2-83ae-851442e20561 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:51.260748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592ffa4-bd17-404a-9abd-d0a67fd7eb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:51.261705 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592ffa4-bd17-404a-9abd-d0a67fd7eb68 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:51.262272 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592ffa4-bd17-404a-9abd-d0a67fd7eb68 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:51.262741 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592ffa4-bd17-404a-9abd-d0a67fd7eb68 None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:51.263589 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592ffa4-bd17-404a-9abd-d0a67fd7eb68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:51.265297 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592ffa4-bd17-404a-9abd-d0a67fd7eb68 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:51.272177 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 389/797] 10.222.0.39 () {56 vars in 1087 bytes} [Tue Jul 26 04:39:51 2022] GET /identity/v3/services => generated 772 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:51.273623 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592ffa4-bd17-404a-9abd-d0a67fd7eb68 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:51.295793 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:51.310461 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:51.370706 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394f523-8a71-47c2-83ae-851442e20561 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:51.409252 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592ffa4-bd17-404a-9abd-d0a67fd7eb68 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:51.412200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623bcdfb-ed98-4729-bdc4-1bff7d4043a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:51.413127 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bcdfb-ed98-4729-bdc4-1bff7d4043a6 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:51.413650 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bcdfb-ed98-4729-bdc4-1bff7d4043a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:51.414172 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bcdfb-ed98-4729-bdc4-1bff7d4043a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:51.423658 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623bcdfb-ed98-4729-bdc4-1bff7d4043a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:51.426748 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623bcdfb-ed98-4729-bdc4-1bff7d4043a6 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:51.440194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-623bcdfb-ed98-4729-bdc4-1bff7d4043a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:51.440194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:51.440194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:51.440194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:51.440194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:51.440194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:51.440194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:51.440194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:51.440194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:51.440194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:51.440194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:51.440194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:51.440194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:39:51.440194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:39:51.440194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:39:51.441720 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:39:51.441720 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:51.441720 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:51.441720 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:51.441720 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:51.441720 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:51.441720 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:51.441720 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:51.441720 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:51.441720 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:51.441720 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:51.441720 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:51.441720 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:51.441720 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:51.441720 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:51.441720 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:51.441720 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:51.443079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:39:51.443079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:39:51.443079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:39:51.443079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:39:51.443079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:39:51.443079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:39:51.443079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:51.443079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:51.445777 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 409/798] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:51.452636 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec75c1a-8d77-479d-961d-515205873bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:51.453299 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec75c1a-8d77-479d-961d-515205873bee None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:51.453428 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623bcdfb-ed98-4729-bdc4-1bff7d4043a6 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:51.453575 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec75c1a-8d77-479d-961d-515205873bee None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:51.453850 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec75c1a-8d77-479d-961d-515205873bee None admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:51.454805 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec75c1a-8d77-479d-961d-515205873bee None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:51.455113 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec75c1a-8d77-479d-961d-515205873bee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:51.457390 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec75c1a-8d77-479d-961d-515205873bee None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:51.479490 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 390/799] 10.222.0.39 () {56 vars in 1135 bytes} [Tue Jul 26 04:39:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:51.480849 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cd68d-246f-424f-89c6-c983e0ae8209 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:51.481133 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cd68d-246f-424f-89c6-c983e0ae8209 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:51.481405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cd68d-246f-424f-89c6-c983e0ae8209 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:51.487883 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 391/800] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:51.488778 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cd68d-246f-424f-89c6-c983e0ae8209 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:51.578412 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:51.585728 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623bcdfb-ed98-4729-bdc4-1bff7d4043a6 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:51.596786 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:51.623872 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cd68d-246f-424f-89c6-c983e0ae8209 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:51.628227 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b410f2f-4f65-4d92-881b-6975cd32c786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:51.628869 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b410f2f-4f65-4d92-881b-6975cd32c786 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:51.629146 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b410f2f-4f65-4d92-881b-6975cd32c786 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:51.629416 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b410f2f-4f65-4d92-881b-6975cd32c786 None admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:51.630242 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b410f2f-4f65-4d92-881b-6975cd32c786 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:51.630551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b410f2f-4f65-4d92-881b-6975cd32c786 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:51.632064 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b410f2f-4f65-4d92-881b-6975cd32c786 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:51.646456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 410/801] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:39:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:39:51.652838 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a796dc-1a49-491b-b240-080db833e3b0 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:51.653132 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a796dc-1a49-491b-b240-080db833e3b0 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:51.653396 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a796dc-1a49-491b-b240-080db833e3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:51.671831 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0233a84-3304-42f0-815a-cadc2a49f0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:51.672479 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0233a84-3304-42f0-815a-cadc2a49f0ea None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:51.672755 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0233a84-3304-42f0-815a-cadc2a49f0ea None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:51.673059 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0233a84-3304-42f0-815a-cadc2a49f0ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:51.676876 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-80a796dc-1a49-491b-b240-080db833e3b0 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:51.678521 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-80a796dc-1a49-491b-b240-080db833e3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:51.689171 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0233a84-3304-42f0-815a-cadc2a49f0ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:51.692688 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0233a84-3304-42f0-815a-cadc2a49f0ea None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:51.710554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-e0233a84-3304-42f0-815a-cadc2a49f0ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:51.710554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:51.710554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:51.710554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:51.710554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:51.710554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:51.710554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:51.710554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:51.710554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:51.710554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:51.710554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:51.710554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:51.710554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:51.710554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:51.710554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:51.711536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:51.711536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:51.711536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:51.711536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:51.711536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:51.711536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:51.711536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:51.711536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:51.711536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:51.711536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:51.711536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:51.711536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:51.711536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:51.711536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:51.711536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:51.711536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:51.711536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:51.712440 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:51.712440 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:51.712440 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:51.712440 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:51.714578 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 392/802] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:51.716600 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9aeb9-ede2-41e6-8e92-65b6385aa1c8 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:51.721390 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9aeb9-ede2-41e6-8e92-65b6385aa1c8 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:51.721390 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9aeb9-ede2-41e6-8e92-65b6385aa1c8 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:51.721390 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 393/803] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:51.721390 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9aeb9-ede2-41e6-8e92-65b6385aa1c8 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:51.766895 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 411/804] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:39:51.768125 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a796dc-1a49-491b-b240-080db833e3b0 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:51.843826 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9aeb9-ede2-41e6-8e92-65b6385aa1c8 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:51.865054 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:51.885251 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb0e81-dd30-4b89-a457-cb1301c1310b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:51.886305 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb0e81-dd30-4b89-a457-cb1301c1310b None admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:51.886907 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:51.887315 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb0e81-dd30-4b89-a457-cb1301c1310b None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:51.887596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb0e81-dd30-4b89-a457-cb1301c1310b None admin] PATH_INFO: `/v3/projects/c4d7c29a2b144df6afa96fd6894254a4/users/b613dee1148c4822af2e7847b28cf4aa/roles/a22f1a3785a746048e38205d1996764b` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:51.891456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a796dc-1a49-491b-b240-080db833e3b0 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:51.906210 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb0e81-dd30-4b89-a457-cb1301c1310b None admin] RBAC: Authorizing `identity:create_grant(project_id=c4d7c29a2b144df6afa96fd6894254a4, user_id=b613dee1148c4822af2e7847b28cf4aa, role_id=a22f1a3785a746048e38205d1996764b)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:51.907766 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb0e81-dd30-4b89-a457-cb1301c1310b None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:51.922825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 394/805] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 04:39:51 2022] PUT /identity/v3/projects/c4d7c29a2b144df6afa96fd6894254a4/users/b613dee1148c4822af2e7847b28cf4aa/roles/a22f1a3785a746048e38205d1996764b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:39:51.924238 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adcd6a-6d0c-4cdb-b8f2-288a2fee5e53 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:51.924541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adcd6a-6d0c-4cdb-b8f2-288a2fee5e53 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:51.924815 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adcd6a-6d0c-4cdb-b8f2-288a2fee5e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:51.937186 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c0b84-7036-4573-a05d-104c4a475eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:51.938375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c0b84-7036-4573-a05d-104c4a475eee None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:51.939222 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c0b84-7036-4573-a05d-104c4a475eee None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:51.939710 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c0b84-7036-4573-a05d-104c4a475eee None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:51.940750 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c0b84-7036-4573-a05d-104c4a475eee None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:51.941285 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c0b84-7036-4573-a05d-104c4a475eee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:51.943152 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c0b84-7036-4573-a05d-104c4a475eee None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:51.945201 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-46adcd6a-6d0c-4cdb-b8f2-288a2fee5e53 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:51.946828 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-46adcd6a-6d0c-4cdb-b8f2-288a2fee5e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:51.958035 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 412/806] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:51.959316 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c0b84-7036-4573-a05d-104c4a475eee None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:52.045428 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 395/807] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:39:52.046838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46adcd6a-6d0c-4cdb-b8f2-288a2fee5e53 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:52.101519 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c0b84-7036-4573-a05d-104c4a475eee None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:52.144605 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b8c99-8d8e-47db-bcbf-6d39ed3dcf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:52.145231 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b8c99-8d8e-47db-bcbf-6d39ed3dcf05 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:52.145510 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b8c99-8d8e-47db-bcbf-6d39ed3dcf05 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:52.145777 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b8c99-8d8e-47db-bcbf-6d39ed3dcf05 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:52.146454 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b8c99-8d8e-47db-bcbf-6d39ed3dcf05 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:52.149023 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b8c99-8d8e-47db-bcbf-6d39ed3dcf05 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:52.159375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-7a1b8c99-8d8e-47db-bcbf-6d39ed3dcf05 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 04:39:52.159375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:52.159375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 04:39:52.159375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 04:39:52.159375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 04:39:52.159375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 04:39:52.159375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 04:39:52.159375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:39:52.159375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 04:39:52.159375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:52.159375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 04:39:52.159375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:52.159375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:52.159375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:52.159375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:52.159375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:52.160589 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:52.160589 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:52.160589 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:52.160589 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:52.160589 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:52.160589 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:52.160589 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:52.160589 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 04:39:52.160589 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 04:39:52.160589 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 04:39:52.160589 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 04:39:52.160589 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:52.160589 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:52.160589 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:52.160589 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:52.160589 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:52.161657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:52.161657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:52.161657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:52.161657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:52.161657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:52.161657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:52.161657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:52.161657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:52.161657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:52.161657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:52.161657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:52.161657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 04:39:52.161657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:39:52.161657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 26 04:39:52.161657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:52.161657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 413/808] 10.222.0.39 () {56 vars in 1129 bytes} [Tue Jul 26 04:39:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:52.162786 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b8c99-8d8e-47db-bcbf-6d39ed3dcf05 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:52.191463 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:52.202848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:52.212375 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46adcd6a-6d0c-4cdb-b8f2-288a2fee5e53 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:52.255235 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf2f0a-fa6e-499a-8dfa-34619bda4d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:52.255894 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf2f0a-fa6e-499a-8dfa-34619bda4d5a None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:52.256174 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf2f0a-fa6e-499a-8dfa-34619bda4d5a None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:52.256610 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf2f0a-fa6e-499a-8dfa-34619bda4d5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:52.266531 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf2f0a-fa6e-499a-8dfa-34619bda4d5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:52.270769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf2f0a-fa6e-499a-8dfa-34619bda4d5a None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:52.277656 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b8c99-8d8e-47db-bcbf-6d39ed3dcf05 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:52.285267 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-84cf2f0a-fa6e-499a-8dfa-34619bda4d5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:52.285267 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:52.285267 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:52.285267 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:52.285267 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:52.285267 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:52.285267 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:52.285267 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:52.285267 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:52.285267 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:52.285267 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:52.285267 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:52.285267 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:39:52.285267 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:39:52.285267 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:39:52.286253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:39:52.286253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:52.286253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:52.286253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:52.286253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:52.286253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:52.286253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:52.286253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:52.286253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:52.286253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:52.286253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:52.286253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:52.286253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:52.286253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:52.286253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:52.286253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:52.286253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:52.287257 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:39:52.287257 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:39:52.287257 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:39:52.287257 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:39:52.287257 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:39:52.287257 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:39:52.287257 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:52.287257 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:52.287694 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 396/809] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:52.288085 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf2f0a-fa6e-499a-8dfa-34619bda4d5a None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:52.328443 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3496a7e-ae7e-4293-b814-ef26376ee194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:52.329108 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3496a7e-ae7e-4293-b814-ef26376ee194 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:52.329442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3496a7e-ae7e-4293-b814-ef26376ee194 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:52.329715 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3496a7e-ae7e-4293-b814-ef26376ee194 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:52.341913 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3496a7e-ae7e-4293-b814-ef26376ee194 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:52.347561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-f3496a7e-ae7e-4293-b814-ef26376ee194 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:39:52.347561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:52.347561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:52.347561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:52.347561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:52.347561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:52.347561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:52.347561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:52.347561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:52.347561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:52.347561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:52.347561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:52.347561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:52.347561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:52.347561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:52.347561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:52.348548 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:52.348548 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:52.348548 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:52.348548 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:52.348548 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:52.348548 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:52.348548 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:52.348548 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:52.348548 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:52.348548 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:52.348548 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:52.348548 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:52.348548 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:52.348548 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:52.348548 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:52.348548 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:52.349412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:52.349412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:52.349412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:52.349412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:52.349412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:52.349412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:52.349412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:52.349412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:52.349412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:52.349412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:52.349412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:39:52.349412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:52.354158 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 414/810] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:39:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:52.355050 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3496a7e-ae7e-4293-b814-ef26376ee194 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:52.431725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf2f0a-fa6e-499a-8dfa-34619bda4d5a None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:52.449193 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:52.470022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3496a7e-ae7e-4293-b814-ef26376ee194 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:52.480032 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496a884-0db0-42e8-9af8-769daa82efd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:52.481361 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496a884-0db0-42e8-9af8-769daa82efd1 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:52.481851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496a884-0db0-42e8-9af8-769daa82efd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:52.482361 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496a884-0db0-42e8-9af8-769daa82efd1 None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:52.483104 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496a884-0db0-42e8-9af8-769daa82efd1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:52.483407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496a884-0db0-42e8-9af8-769daa82efd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:52.484819 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496a884-0db0-42e8-9af8-769daa82efd1 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:52.497016 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 397/811] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Jul 26 04:39:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:52.497016 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496a884-0db0-42e8-9af8-769daa82efd1 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:52.516415 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bdfce-b993-4b82-ae4b-2a1c966b6eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:52.517098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bdfce-b993-4b82-ae4b-2a1c966b6eb5 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:52.517381 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bdfce-b993-4b82-ae4b-2a1c966b6eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:52.517900 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bdfce-b993-4b82-ae4b-2a1c966b6eb5 None admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:52.518527 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bdfce-b993-4b82-ae4b-2a1c966b6eb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:52.518846 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bdfce-b993-4b82-ae4b-2a1c966b6eb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:52.520318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bdfce-b993-4b82-ae4b-2a1c966b6eb5 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:52.525063 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:52.539315 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 415/812] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:39:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:52.540309 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bdfce-b993-4b82-ae4b-2a1c966b6eb5 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:52.621102 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496a884-0db0-42e8-9af8-769daa82efd1 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:52.658549 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bdfce-b993-4b82-ae4b-2a1c966b6eb5 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:52.663128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fea84-4448-409f-950f-00001dc0f486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:52.663766 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fea84-4448-409f-950f-00001dc0f486 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:52.664048 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fea84-4448-409f-950f-00001dc0f486 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:52.664327 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8fea84-4448-409f-950f-00001dc0f486 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:52.665054 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8fea84-4448-409f-950f-00001dc0f486 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:52.665362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8fea84-4448-409f-950f-00001dc0f486 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:52.666799 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8fea84-4448-409f-950f-00001dc0f486 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:52.680918 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 398/813] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:39:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:52.681643 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fea84-4448-409f-950f-00001dc0f486 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:52.703377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91efe2f-ee9b-4a95-9faa-b1672f6df14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:52.704384 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91efe2f-ee9b-4a95-9faa-b1672f6df14e None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:52.704813 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91efe2f-ee9b-4a95-9faa-b1672f6df14e None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:52.705658 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91efe2f-ee9b-4a95-9faa-b1672f6df14e None admin] PATH_INFO: `/v3/services` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:52.706736 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91efe2f-ee9b-4a95-9faa-b1672f6df14e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:52.707293 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91efe2f-ee9b-4a95-9faa-b1672f6df14e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:52.709355 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91efe2f-ee9b-4a95-9faa-b1672f6df14e None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:52.721800 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 416/814] 10.222.0.39 () {56 vars in 1124 bytes} [Tue Jul 26 04:39:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:52.723933 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91efe2f-ee9b-4a95-9faa-b1672f6df14e None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:52.734594 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:52.780799 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:52.803497 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8fea84-4448-409f-950f-00001dc0f486 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:52.846473 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91efe2f-ee9b-4a95-9faa-b1672f6df14e None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:52.858157 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d9d74-d3b9-4eed-9a52-1df111e27afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:52.859413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d9d74-d3b9-4eed-9a52-1df111e27afd None admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:52.859844 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d9d74-d3b9-4eed-9a52-1df111e27afd None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:52.860264 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d9d74-d3b9-4eed-9a52-1df111e27afd None admin] PATH_INFO: `/v3/projects/c4d7c29a2b144df6afa96fd6894254a4/users/0e089e39e9de419b9e2fb1d7fc2d245a/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:52.863584 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d9d74-d3b9-4eed-9a52-1df111e27afd None admin] RBAC: Authorizing `identity:create_grant(project_id=c4d7c29a2b144df6afa96fd6894254a4, user_id=0e089e39e9de419b9e2fb1d7fc2d245a, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:52.865944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d9d74-d3b9-4eed-9a52-1df111e27afd None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:52.884931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e389ca-7b82-4338-9f04-4f60439b74ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:52.885549 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e389ca-7b82-4338-9f04-4f60439b74ed None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:52.885882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e389ca-7b82-4338-9f04-4f60439b74ed None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:52.886204 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e389ca-7b82-4338-9f04-4f60439b74ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:52.886570 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 399/815] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 04:39:52 2022] PUT /identity/v3/projects/c4d7c29a2b144df6afa96fd6894254a4/users/0e089e39e9de419b9e2fb1d7fc2d245a/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:39:52.887920 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d9d74-d3b9-4eed-9a52-1df111e27afd None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:52.915312 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e389ca-7b82-4338-9f04-4f60439b74ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:52.916844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e389ca-7b82-4338-9f04-4f60439b74ed None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:52.946101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-34e389ca-7b82-4338-9f04-4f60439b74ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:52.946101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:52.946101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:52.946101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:52.946101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:52.946101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:52.946101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:52.946101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:52.946101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:52.946101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:52.946101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:52.946101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:52.946101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:52.946101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:52.946101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:52.947297 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:52.947297 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:52.947297 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:52.947297 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:52.947297 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:52.947297 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:52.947297 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:52.947297 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:52.947297 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:52.947297 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:52.947297 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:52.947297 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:52.947297 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:52.947297 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:52.947297 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:52.947297 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:52.947297 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:52.948368 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:52.948368 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:52.948368 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:52.948368 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:52.954931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 417/816] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:52.955947 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e389ca-7b82-4338-9f04-4f60439b74ed None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:53.021955 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d9d74-d3b9-4eed-9a52-1df111e27afd None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:53.066002 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16438e7-3046-4087-b533-9d8c15a37769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:53.066921 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16438e7-3046-4087-b533-9d8c15a37769 None admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:53.067383 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16438e7-3046-4087-b533-9d8c15a37769 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:53.067807 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16438e7-3046-4087-b533-9d8c15a37769 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:53.068729 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16438e7-3046-4087-b533-9d8c15a37769 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:53.070704 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16438e7-3046-4087-b533-9d8c15a37769 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:53.094932 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:53.099551 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:53.109084 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 400/817] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:39:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:39:53.162455 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e389ca-7b82-4338-9f04-4f60439b74ed None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:53.223432 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0fb8c-8dff-43a4-80ec-2e512ae9daf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:53.224143 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0fb8c-8dff-43a4-80ec-2e512ae9daf8 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:53.224430 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0fb8c-8dff-43a4-80ec-2e512ae9daf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:53.224701 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0fb8c-8dff-43a4-80ec-2e512ae9daf8 None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:53.225441 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0fb8c-8dff-43a4-80ec-2e512ae9daf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:53.225747 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0fb8c-8dff-43a4-80ec-2e512ae9daf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:53.227307 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0fb8c-8dff-43a4-80ec-2e512ae9daf8 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:53.242264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 418/818] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:53.250269 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16438e7-3046-4087-b533-9d8c15a37769 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:53.372953 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16438e7-3046-4087-b533-9d8c15a37769 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:53.409473 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b214d70-cf0b-4c0d-9963-b03eccb1a128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:53.410181 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b214d70-cf0b-4c0d-9963-b03eccb1a128 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:53.410463 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b214d70-cf0b-4c0d-9963-b03eccb1a128 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:53.410737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b214d70-cf0b-4c0d-9963-b03eccb1a128 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:53.418959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b214d70-cf0b-4c0d-9963-b03eccb1a128 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:53.420362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b214d70-cf0b-4c0d-9963-b03eccb1a128 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:53.432829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-6b214d70-cf0b-4c0d-9963-b03eccb1a128 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 04:39:53.432829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:53.432829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:53.432829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:53.432829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:53.432829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:53.432829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:53.432829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:53.432829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:53.432829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:53.432829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:53.432829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:53.432829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:39:53.432829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:39:53.432829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:39:53.432829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:39:53.433825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:53.433825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:53.433825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:39:53.433825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:53.433825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:39:53.433825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:53.433825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:53.433825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:53.433825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:53.433825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:53.433825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:53.433825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:53.433825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:53.433825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:53.433825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:53.433825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:53.433825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:53.433825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:53.434890 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:53.434890 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:53.434890 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:39:53.434890 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:39:53.434890 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:39:53.434890 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:39:53.434890 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:39:53.434890 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:39:53.434890 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 04:39:53.434890 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:53.434890 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 401/819] 10.222.0.39 () {56 vars in 1093 bytes} [Tue Jul 26 04:39:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:53.439904 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0fb8c-8dff-43a4-80ec-2e512ae9daf8 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:53.537332 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa27ebb-61e5-4199-9dd6-8e55ddea9618 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:53.537687 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa27ebb-61e5-4199-9dd6-8e55ddea9618 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:53.537859 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa27ebb-61e5-4199-9dd6-8e55ddea9618 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:53.539555 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 402/820] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:53.544754 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bdc91-0245-449c-94ca-3998bf19c0a8 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:53.545038 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bdc91-0245-449c-94ca-3998bf19c0a8 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:53.545316 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bdc91-0245-449c-94ca-3998bf19c0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:53.566681 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0fb8c-8dff-43a4-80ec-2e512ae9daf8 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:53.579022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-a44bdc91-0245-449c-94ca-3998bf19c0a8 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:53.580319 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-a44bdc91-0245-449c-94ca-3998bf19c0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:53.589157 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:53.627582 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce02a20-3f78-4966-93ab-297b901a35ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:53.628225 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce02a20-3f78-4966-93ab-297b901a35ad None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:53.628505 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce02a20-3f78-4966-93ab-297b901a35ad None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:53.628778 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce02a20-3f78-4966-93ab-297b901a35ad None admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:53.629595 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce02a20-3f78-4966-93ab-297b901a35ad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:53.629902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce02a20-3f78-4966-93ab-297b901a35ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:53.635502 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce02a20-3f78-4966-93ab-297b901a35ad None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:53.681972 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 419/821] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Jul 26 04:39:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:53.683715 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce02a20-3f78-4966-93ab-297b901a35ad None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:53.723734 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:53.747229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 403/822] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 04:39:53.773412 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bdc91-0245-449c-94ca-3998bf19c0a8 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:53.886602 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce02a20-3f78-4966-93ab-297b901a35ad None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:53.958192 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417255b-001d-4981-a6f5-dc3ca35cc403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:53.958835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417255b-001d-4981-a6f5-dc3ca35cc403 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:53.959132 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417255b-001d-4981-a6f5-dc3ca35cc403 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:53.959411 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417255b-001d-4981-a6f5-dc3ca35cc403 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:53.981857 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bdc91-0245-449c-94ca-3998bf19c0a8 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:54.022440 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:54.049842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417255b-001d-4981-a6f5-dc3ca35cc403 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:54.051635 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417255b-001d-4981-a6f5-dc3ca35cc403 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:54.079384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82543a8c-00d2-4788-827a-00470ea7d1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:54.080245 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82543a8c-00d2-4788-827a-00470ea7d1c5 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:54.080356 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82543a8c-00d2-4788-827a-00470ea7d1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:54.080651 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82543a8c-00d2-4788-827a-00470ea7d1c5 None admin] PATH_INFO: `/v3/services/network` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:54.081299 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82543a8c-00d2-4788-827a-00470ea7d1c5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:54.082828 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82543a8c-00d2-4788-827a-00470ea7d1c5 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:54.107791 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-82543a8c-00d2-4788-827a-00470ea7d1c5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 04:39:54.107791 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:54.107791 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 04:39:54.107791 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 04:39:54.107791 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 04:39:54.107791 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 04:39:54.107791 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 04:39:54.107791 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:39:54.107791 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 04:39:54.107791 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:54.107791 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 04:39:54.107791 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:54.107791 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:54.107791 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:54.107791 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:54.107791 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:54.107791 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:54.108873 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:54.108873 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:54.108873 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:54.108873 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:54.108873 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:54.108873 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:54.108873 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 04:39:54.108873 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 04:39:54.108873 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 04:39:54.108873 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 04:39:54.108873 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:54.108873 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:54.108873 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:54.108873 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:54.108873 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:54.108873 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:54.109712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:54.109712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:54.109712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:54.109712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:54.109712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:54.109712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:54.109712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:54.109712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:54.109712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:54.109712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:54.109712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 04:39:54.109712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:39:54.109712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 26 04:39:54.109712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:54.118470 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 404/823] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:53 2022] GET /identity/v3/services/network => generated 88 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:54.124416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82543a8c-00d2-4788-827a-00470ea7d1c5 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:54.157851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 420/824] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:39:53 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 04:39:54.163205 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417255b-001d-4981-a6f5-dc3ca35cc403 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:54.240175 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:54.281419 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417255b-001d-4981-a6f5-dc3ca35cc403 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:54.286408 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:54.311161 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82543a8c-00d2-4788-827a-00470ea7d1c5 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:54.324091 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe90243-b768-4a44-9c03-7aafbf713ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:54.324841 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe90243-b768-4a44-9c03-7aafbf713ef8 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:54.325188 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe90243-b768-4a44-9c03-7aafbf713ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:54.325818 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe90243-b768-4a44-9c03-7aafbf713ef8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:54.338919 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe90243-b768-4a44-9c03-7aafbf713ef8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:54.341057 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe90243-b768-4a44-9c03-7aafbf713ef8 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:54.351232 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52527d-84ab-4282-8045-7849499551ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:54.352126 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52527d-84ab-4282-8045-7849499551ef None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:54.352630 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52527d-84ab-4282-8045-7849499551ef None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:54.353112 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52527d-84ab-4282-8045-7849499551ef None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:54.354075 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf52527d-84ab-4282-8045-7849499551ef None admin] RBAC: Adding query filter params (name=network) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:54.354560 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf52527d-84ab-4282-8045-7849499551ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:54.356125 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf52527d-84ab-4282-8045-7849499551ef None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:54.357813 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-ffe90243-b768-4a44-9c03-7aafbf713ef8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:54.357813 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:54.357813 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:54.357813 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:54.357813 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:54.357813 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:54.357813 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:54.357813 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:54.357813 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:54.357813 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:54.357813 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:54.357813 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:54.357813 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:54.357813 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:54.357813 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:54.358737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:54.358737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:54.358737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:54.358737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:54.358737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:54.358737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:54.358737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:54.358737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:54.358737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:54.358737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:54.358737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:54.358737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:54.358737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:54.358737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:54.358737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:54.358737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:54.358737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:54.359644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:54.359644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:54.359644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:54.359644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:54.359644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 421/825] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:54.360649 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb93908-e34f-4e40-abcd-b4d32b682e8b None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:54.360929 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb93908-e34f-4e40-abcd-b4d32b682e8b None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:54.361196 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb93908-e34f-4e40-abcd-b4d32b682e8b None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:54.366776 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 422/826] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:54.366776 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb93908-e34f-4e40-abcd-b4d32b682e8b None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:54.369809 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 405/827] 10.222.0.39 () {56 vars in 1112 bytes} [Tue Jul 26 04:39:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:54.371344 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66258b8d-2882-48cf-97e1-e6618ff48908 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:54.371838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66258b8d-2882-48cf-97e1-e6618ff48908 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:54.372358 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66258b8d-2882-48cf-97e1-e6618ff48908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:54.392569 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-66258b8d-2882-48cf-97e1-e6618ff48908 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:54.394290 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-66258b8d-2882-48cf-97e1-e6618ff48908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:54.502381 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 406/828] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:39:54.502381 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66258b8d-2882-48cf-97e1-e6618ff48908 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:54.504916 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb93908-e34f-4e40-abcd-b4d32b682e8b None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:54.548024 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:54.560994 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d6f4f-c4db-4f02-a435-8c24db72ec7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:54.562011 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d6f4f-c4db-4f02-a435-8c24db72ec7e None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:54.562540 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d6f4f-c4db-4f02-a435-8c24db72ec7e None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:54.563025 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d6f4f-c4db-4f02-a435-8c24db72ec7e None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:54.564010 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d6f4f-c4db-4f02-a435-8c24db72ec7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:54.564561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d6f4f-c4db-4f02-a435-8c24db72ec7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:54.566277 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d6f4f-c4db-4f02-a435-8c24db72ec7e None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:54.578919 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:54.580511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 423/829] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:54.581689 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d6f4f-c4db-4f02-a435-8c24db72ec7e None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:54.633523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66258b8d-2882-48cf-97e1-e6618ff48908 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:54.668751 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a800e4-cf7d-4d0b-8fc8-ef4d62dc73a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:54.669393 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a800e4-cf7d-4d0b-8fc8-ef4d62dc73a7 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:54.669942 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a800e4-cf7d-4d0b-8fc8-ef4d62dc73a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:54.670160 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a800e4-cf7d-4d0b-8fc8-ef4d62dc73a7 None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:54.670830 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a800e4-cf7d-4d0b-8fc8-ef4d62dc73a7 None admin] RBAC: Adding query filter params (type=network) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:54.671136 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a800e4-cf7d-4d0b-8fc8-ef4d62dc73a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:54.672540 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a800e4-cf7d-4d0b-8fc8-ef4d62dc73a7 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:54.677934 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 407/830] 10.222.0.39 () {56 vars in 1112 bytes} [Tue Jul 26 04:39:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:54.678871 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a800e4-cf7d-4d0b-8fc8-ef4d62dc73a7 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:54.698936 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d6f4f-c4db-4f02-a435-8c24db72ec7e None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:54.737072 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58af98-8d6c-45b8-a9ac-2abc9e26d8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:54.738166 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58af98-8d6c-45b8-a9ac-2abc9e26d8dc None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:54.738771 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58af98-8d6c-45b8-a9ac-2abc9e26d8dc None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:54.739339 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58af98-8d6c-45b8-a9ac-2abc9e26d8dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:54.752073 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58af98-8d6c-45b8-a9ac-2abc9e26d8dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:54.757684 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-8e58af98-8d6c-45b8-a9ac-2abc9e26d8dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:54.757684 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:54.757684 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:54.757684 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:54.757684 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:54.757684 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:54.757684 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:54.757684 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:54.757684 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:54.757684 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:54.757684 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:54.757684 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:54.757684 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:54.757684 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:54.757684 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:54.757684 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:54.758791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:54.758791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:54.758791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:54.758791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:54.758791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:54.758791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:54.758791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:54.758791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:54.758791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:54.758791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:54.758791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:54.758791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:54.758791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:54.758791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:54.758791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:54.758791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:54.759704 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:54.759704 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:54.759704 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:54.759704 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:54.759704 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:54.759704 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:54.759704 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:54.759704 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:54.759704 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:54.759704 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:54.759704 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:39:54.759704 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:54.767339 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 424/831] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 04:39:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:54.768553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58af98-8d6c-45b8-a9ac-2abc9e26d8dc None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:54.782225 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a800e4-cf7d-4d0b-8fc8-ef4d62dc73a7 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:54.797917 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:54.821311 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f198d-6d0d-4508-94fe-ff1bd2584358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:54.821971 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f198d-6d0d-4508-94fe-ff1bd2584358 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:54.822275 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f198d-6d0d-4508-94fe-ff1bd2584358 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:54.822546 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f198d-6d0d-4508-94fe-ff1bd2584358 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:54.826284 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:54.831595 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f198d-6d0d-4508-94fe-ff1bd2584358 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:54.833114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f198d-6d0d-4508-94fe-ff1bd2584358 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:54.845877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-e40f198d-6d0d-4508-94fe-ff1bd2584358 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:54.845877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:54.845877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:54.845877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:54.845877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:54.845877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:54.845877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:54.845877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:54.845877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:54.845877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:54.845877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:54.845877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:54.845877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:39:54.845877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:39:54.845877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:39:54.846985 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:39:54.846985 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:54.846985 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:54.846985 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:54.846985 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:54.846985 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:54.846985 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:54.846985 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:54.846985 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:54.846985 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:54.846985 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:54.846985 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:54.846985 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:54.846985 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:54.846985 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:54.846985 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:54.846985 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:54.847906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:39:54.847906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:39:54.847906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:39:54.847906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:39:54.847906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:39:54.847906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:39:54.847906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:54.847906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:54.852121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 408/832] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:54.853043 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f198d-6d0d-4508-94fe-ff1bd2584358 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:54.897819 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58af98-8d6c-45b8-a9ac-2abc9e26d8dc None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:54.936083 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcd222-4b3a-4f9b-abff-c8750dce887c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:54.937144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcd222-4b3a-4f9b-abff-c8750dce887c None admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:54.937654 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcd222-4b3a-4f9b-abff-c8750dce887c None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:54.938204 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dcd222-4b3a-4f9b-abff-c8750dce887c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:54.939241 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dcd222-4b3a-4f9b-abff-c8750dce887c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:54.940958 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dcd222-4b3a-4f9b-abff-c8750dce887c None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:54.960066 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f198d-6d0d-4508-94fe-ff1bd2584358 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:54.969237 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 425/833] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:39:54 2022] POST /identity/v3/endpoints => generated 327 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:39:54.971139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcd222-4b3a-4f9b-abff-c8750dce887c None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:55.027489 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01221d34-485a-4469-9ee3-51b5fbc17979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:55.029199 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01221d34-485a-4469-9ee3-51b5fbc17979 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:55.030409 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01221d34-485a-4469-9ee3-51b5fbc17979 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:55.030936 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01221d34-485a-4469-9ee3-51b5fbc17979 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:55.032241 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01221d34-485a-4469-9ee3-51b5fbc17979 None admin] RBAC: Adding query filter params (name=service) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:55.033030 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01221d34-485a-4469-9ee3-51b5fbc17979 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:55.035237 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01221d34-485a-4469-9ee3-51b5fbc17979 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:55.050124 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 409/834] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 04:39:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:55.056286 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01221d34-485a-4469-9ee3-51b5fbc17979 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:55.091778 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:55.093956 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:55.098111 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dcd222-4b3a-4f9b-abff-c8750dce887c None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:55.138355 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29bb77-6e1c-4611-a337-3e8baf4c8a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:55.139293 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29bb77-6e1c-4611-a337-3e8baf4c8a38 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:55.139760 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29bb77-6e1c-4611-a337-3e8baf4c8a38 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:55.140187 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29bb77-6e1c-4611-a337-3e8baf4c8a38 None admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:55.141157 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29bb77-6e1c-4611-a337-3e8baf4c8a38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:55.141709 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29bb77-6e1c-4611-a337-3e8baf4c8a38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:55.143480 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29bb77-6e1c-4611-a337-3e8baf4c8a38 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:55.162144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 426/835] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:39:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:55.164760 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29bb77-6e1c-4611-a337-3e8baf4c8a38 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:55.175797 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01221d34-485a-4469-9ee3-51b5fbc17979 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:55.214931 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8495f-b325-4069-add3-52ac9091c941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:55.215599 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8495f-b325-4069-add3-52ac9091c941 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:55.215978 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8495f-b325-4069-add3-52ac9091c941 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:55.216347 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8495f-b325-4069-add3-52ac9091c941 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:55.229923 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8495f-b325-4069-add3-52ac9091c941 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:55.231593 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8495f-b325-4069-add3-52ac9091c941 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:55.255165 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-91b8495f-b325-4069-add3-52ac9091c941 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:55.255165 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:55.255165 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:55.255165 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:55.255165 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:55.255165 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:55.255165 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:55.255165 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:55.255165 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:55.255165 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:55.255165 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:55.255165 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:55.255165 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:55.255165 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:55.255165 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:55.256227 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:55.256227 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:55.256227 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:55.256227 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:55.256227 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:55.256227 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:55.256227 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:55.256227 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:55.256227 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:55.256227 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:55.256227 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:55.256227 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:55.256227 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:55.256227 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:55.256227 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:55.256227 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:55.256227 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:55.257144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:55.257144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:55.257144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:55.257144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:55.269684 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 410/836] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:55.275381 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8495f-b325-4069-add3-52ac9091c941 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:55.287141 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29bb77-6e1c-4611-a337-3e8baf4c8a38 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:55.326401 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bb090-c390-4359-b3f3-883d46ac3d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:55.327290 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bb090-c390-4359-b3f3-883d46ac3d0d None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:55.327744 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bb090-c390-4359-b3f3-883d46ac3d0d None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:55.328177 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bb090-c390-4359-b3f3-883d46ac3d0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:55.329376 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63bb090-c390-4359-b3f3-883d46ac3d0d None admin] RBAC: Adding query filter params (role.id=2bfdd65b06554a6da967b3939da753c7, scope.project.id=c4d7c29a2b144df6afa96fd6894254a4, user.id=ae8593e125da4b208dd100608aa2b462) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:55.329838 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63bb090-c390-4359-b3f3-883d46ac3d0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:55.331554 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63bb090-c390-4359-b3f3-883d46ac3d0d None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:55.338794 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 427/837] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:39:55 2022] GET /identity/v3/role_assignments?user.id=ae8593e125da4b208dd100608aa2b462&scope.project.id=c4d7c29a2b144df6afa96fd6894254a4&role.id=2bfdd65b06554a6da967b3939da753c7 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:39:55.389407 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601b172-8be2-4b34-9d3e-8f6faec677bf None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:55.390060 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601b172-8be2-4b34-9d3e-8f6faec677bf None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:55.390574 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601b172-8be2-4b34-9d3e-8f6faec677bf None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:55.392552 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 428/838] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:55.397713 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb327cc2-58cd-44fb-afb3-5640e9e3e076 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:55.398418 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb327cc2-58cd-44fb-afb3-5640e9e3e076 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:55.398921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb327cc2-58cd-44fb-afb3-5640e9e3e076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:55.400554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:55.423040 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-fb327cc2-58cd-44fb-afb3-5640e9e3e076 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:55.423247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8495f-b325-4069-add3-52ac9091c941 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:55.424949 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-fb327cc2-58cd-44fb-afb3-5640e9e3e076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:55.448973 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:55.463077 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65dc562-5e9b-41dc-8728-10324752ff45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:55.463732 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65dc562-5e9b-41dc-8728-10324752ff45 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:55.464000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65dc562-5e9b-41dc-8728-10324752ff45 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:55.464272 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65dc562-5e9b-41dc-8728-10324752ff45 None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:55.465067 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65dc562-5e9b-41dc-8728-10324752ff45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:55.465298 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65dc562-5e9b-41dc-8728-10324752ff45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:55.466728 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65dc562-5e9b-41dc-8728-10324752ff45 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:55.482690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 411/839] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:55.488832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65dc562-5e9b-41dc-8728-10324752ff45 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:55.516570 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 429/840] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:39:55.518264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54ae69-9509-4f16-8821-1e10355c1ece None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:55.518789 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54ae69-9509-4f16-8821-1e10355c1ece None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:55.519266 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e54ae69-9509-4f16-8821-1e10355c1ece None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:55.520826 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 430/841] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:55.528329 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bd7da-d0d2-4cf8-92d7-38d27b7be849 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:55.528639 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bd7da-d0d2-4cf8-92d7-38d27b7be849 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:55.529594 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bd7da-d0d2-4cf8-92d7-38d27b7be849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:55.549919 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-4d3bd7da-d0d2-4cf8-92d7-38d27b7be849 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:55.551277 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-4d3bd7da-d0d2-4cf8-92d7-38d27b7be849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:55.619216 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65dc562-5e9b-41dc-8728-10324752ff45 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:55.631218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 431/842] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:39:55.631897 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bd7da-d0d2-4cf8-92d7-38d27b7be849 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:55.658098 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c8588-51ab-49e3-98fd-20d2ed0c52c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:55.658758 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c8588-51ab-49e3-98fd-20d2ed0c52c5 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:55.659040 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c8588-51ab-49e3-98fd-20d2ed0c52c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:55.659309 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c8588-51ab-49e3-98fd-20d2ed0c52c5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:55.667104 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c8588-51ab-49e3-98fd-20d2ed0c52c5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:55.668613 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c8588-51ab-49e3-98fd-20d2ed0c52c5 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:55.681081 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-343c8588-51ab-49e3-98fd-20d2ed0c52c5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 04:39:55.681081 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:55.681081 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:55.681081 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:55.681081 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:55.681081 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:55.681081 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:55.681081 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:55.681081 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:55.681081 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:55.681081 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:55.681081 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:55.681081 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:39:55.681081 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:39:55.681081 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:39:55.681081 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:39:55.682246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:55.682246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:55.682246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:39:55.682246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:55.682246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:39:55.682246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:55.682246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:55.682246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:55.682246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:55.682246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:55.682246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:55.682246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:55.682246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:55.682246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:55.682246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:55.682246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:55.682246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:55.682246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:55.683810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:55.683810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:55.683810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:39:55.683810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:39:55.683810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:39:55.683810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:39:55.683810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:39:55.683810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:39:55.683810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 04:39:55.683810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:55.683810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 412/843] 10.222.0.39 () {56 vars in 1117 bytes} [Tue Jul 26 04:39:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:39:55.683810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c8588-51ab-49e3-98fd-20d2ed0c52c5 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:55.692227 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:55.735837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:55.753432 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bd7da-d0d2-4cf8-92d7-38d27b7be849 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:55.791155 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77170052-351b-4eb9-8e23-5e40ae321a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:55.791800 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77170052-351b-4eb9-8e23-5e40ae321a6a None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:55.792078 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77170052-351b-4eb9-8e23-5e40ae321a6a None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:55.792346 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77170052-351b-4eb9-8e23-5e40ae321a6a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:55.792963 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77170052-351b-4eb9-8e23-5e40ae321a6a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:55.794394 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77170052-351b-4eb9-8e23-5e40ae321a6a None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:55.796922 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c8588-51ab-49e3-98fd-20d2ed0c52c5 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:55.803402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-77170052-351b-4eb9-8e23-5e40ae321a6a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 04:39:55.803402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:55.803402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 04:39:55.803402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 04:39:55.803402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 04:39:55.803402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 04:39:55.803402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 04:39:55.803402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:39:55.803402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 04:39:55.803402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:55.803402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 04:39:55.803402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:55.803402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:55.803402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:55.803402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:55.803402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:55.803402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:55.804374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:55.804374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:55.804374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:55.804374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:55.804374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:55.804374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:55.804374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 04:39:55.804374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 04:39:55.804374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 04:39:55.804374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 04:39:55.804374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:55.804374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:55.804374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:55.804374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:55.804374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:55.804374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:55.805377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:55.805377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:55.805377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:55.805377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:55.805377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:55.805377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:55.805377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:55.805377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:55.805377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:55.805377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:55.805377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 04:39:55.805377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:39:55.805377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 04:39:55.805377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:55.812631 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 432/844] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 04:39:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:55.812631 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77170052-351b-4eb9-8e23-5e40ae321a6a None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:55.833877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46cb303-385c-406f-8e13-601404417cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:55.834992 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cb303-385c-406f-8e13-601404417cfd None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:55.835279 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cb303-385c-406f-8e13-601404417cfd None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:55.835706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cb303-385c-406f-8e13-601404417cfd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:55.846984 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46cb303-385c-406f-8e13-601404417cfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:55.852583 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-f46cb303-385c-406f-8e13-601404417cfd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:39:55.852583 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:55.852583 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:55.852583 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:55.852583 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:55.852583 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:55.852583 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:55.852583 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:55.852583 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:55.852583 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:55.852583 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:55.852583 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:55.852583 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:55.852583 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:55.852583 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:55.852583 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:55.853538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:55.853538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:55.853538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:55.853538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:55.853538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:55.853538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:55.853538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:55.853538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:55.853538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:55.853538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:55.853538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:55.853538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:55.853538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:55.853538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:55.853538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:55.853538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:55.854413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:55.854413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:55.854413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:55.854413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:55.854413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:55.854413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:55.854413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:55.854413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:55.854413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:55.854413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:55.854413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:39:55.854413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:55.854413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 413/845] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:39:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:55.855107 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46cb303-385c-406f-8e13-601404417cfd None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:55.920109 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:55.922960 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77170052-351b-4eb9-8e23-5e40ae321a6a None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:55.962963 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46cb303-385c-406f-8e13-601404417cfd None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:55.963174 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189a402-94da-4101-ab6e-de8fb419d5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:55.963619 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189a402-94da-4101-ab6e-de8fb419d5a2 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:55.963902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189a402-94da-4101-ab6e-de8fb419d5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:55.964177 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189a402-94da-4101-ab6e-de8fb419d5a2 None admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:55.965892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189a402-94da-4101-ab6e-de8fb419d5a2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:55.965892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189a402-94da-4101-ab6e-de8fb419d5a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:55.966986 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189a402-94da-4101-ab6e-de8fb419d5a2 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:55.987129 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 433/846] 10.222.0.39 () {56 vars in 1149 bytes} [Tue Jul 26 04:39:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:55.988436 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189a402-94da-4101-ab6e-de8fb419d5a2 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:55.998635 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:56.008520 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2bd77-fdfc-4a89-b370-e8ec12bbd674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:56.009290 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2bd77-fdfc-4a89-b370-e8ec12bbd674 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:56.009673 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2bd77-fdfc-4a89-b370-e8ec12bbd674 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:56.009955 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2bd77-fdfc-4a89-b370-e8ec12bbd674 None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:56.010678 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2bd77-fdfc-4a89-b370-e8ec12bbd674 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:56.010982 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2bd77-fdfc-4a89-b370-e8ec12bbd674 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:56.012391 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2bd77-fdfc-4a89-b370-e8ec12bbd674 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:56.022026 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 414/847] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 04:39:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:56.022026 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2bd77-fdfc-4a89-b370-e8ec12bbd674 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:56.103132 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189a402-94da-4101-ab6e-de8fb419d5a2 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:56.131188 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2bd77-fdfc-4a89-b370-e8ec12bbd674 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:56.138395 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bb043-e586-4b96-bf0c-0a58bfaafa8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:56.139053 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bb043-e586-4b96-bf0c-0a58bfaafa8d None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:56.139275 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bb043-e586-4b96-bf0c-0a58bfaafa8d None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:56.139538 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bb043-e586-4b96-bf0c-0a58bfaafa8d None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:56.140272 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bb043-e586-4b96-bf0c-0a58bfaafa8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:56.140570 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bb043-e586-4b96-bf0c-0a58bfaafa8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:56.142012 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bb043-e586-4b96-bf0c-0a58bfaafa8d None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:56.155956 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 434/848] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:39:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:56.155956 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bb043-e586-4b96-bf0c-0a58bfaafa8d None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:56.159106 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:56.168390 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10762491-f870-45d4-991a-795fcc12d14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:56.169040 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10762491-f870-45d4-991a-795fcc12d14f None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:56.169320 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10762491-f870-45d4-991a-795fcc12d14f None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:56.169590 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10762491-f870-45d4-991a-795fcc12d14f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:56.226537 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:56.242280 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10762491-f870-45d4-991a-795fcc12d14f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:56.243805 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10762491-f870-45d4-991a-795fcc12d14f None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:56.266598 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bb043-e586-4b96-bf0c-0a58bfaafa8d None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:56.301384 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ec6c7-a068-496e-8384-b7c2c0dd4bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:56.302123 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ec6c7-a068-496e-8384-b7c2c0dd4bbb None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:56.302461 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ec6c7-a068-496e-8384-b7c2c0dd4bbb None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:56.302837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ec6c7-a068-496e-8384-b7c2c0dd4bbb None admin] PATH_INFO: `/v3/services` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:56.303539 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ec6c7-a068-496e-8384-b7c2c0dd4bbb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:56.303901 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ec6c7-a068-496e-8384-b7c2c0dd4bbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:56.305343 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ec6c7-a068-496e-8384-b7c2c0dd4bbb None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:56.310023 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 435/849] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 04:39:56 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:56.310802 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ec6c7-a068-496e-8384-b7c2c0dd4bbb None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:56.372089 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 415/850] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:39:56 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 04:39:56.378504 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10762491-f870-45d4-991a-795fcc12d14f None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:56.410328 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:56.464202 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ec6c7-a068-496e-8384-b7c2c0dd4bbb None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:56.499693 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:56.505447 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10762491-f870-45d4-991a-795fcc12d14f None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:56.505773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcd578-cfe4-40ea-b654-20b4d28a52ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:56.506460 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcd578-cfe4-40ea-b654-20b4d28a52ba None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:56.506739 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcd578-cfe4-40ea-b654-20b4d28a52ba None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:56.507041 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcd578-cfe4-40ea-b654-20b4d28a52ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:56.522897 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bcd578-cfe4-40ea-b654-20b4d28a52ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:56.524742 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bcd578-cfe4-40ea-b654-20b4d28a52ba None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:56.541244 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-b2bcd578-cfe4-40ea-b654-20b4d28a52ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:56.541244 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:56.541244 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:56.541244 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:56.541244 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:56.541244 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:56.541244 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:56.541244 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:56.541244 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:56.541244 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:56.541244 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:56.541244 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:56.541244 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:56.541244 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:56.541244 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:56.542533 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:56.542533 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:56.542533 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:56.542533 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:56.542533 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:56.542533 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:56.542533 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:56.542533 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:56.542533 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:56.542533 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:56.542533 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:56.542533 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:56.542533 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:56.542533 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:56.542533 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:56.542533 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:56.542533 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:56.543437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:56.543437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:56.543437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:56.543437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:56.543437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 436/851] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:56.548553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcd578-cfe4-40ea-b654-20b4d28a52ba None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:56.557216 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f737fa4-0a12-4662-9e5d-1dd39ad8ab2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:56.558251 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f737fa4-0a12-4662-9e5d-1dd39ad8ab2d None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:56.559193 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f737fa4-0a12-4662-9e5d-1dd39ad8ab2d None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:56.559673 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f737fa4-0a12-4662-9e5d-1dd39ad8ab2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:56.573832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f737fa4-0a12-4662-9e5d-1dd39ad8ab2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:56.575802 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f737fa4-0a12-4662-9e5d-1dd39ad8ab2d None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:56.595483 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-2f737fa4-0a12-4662-9e5d-1dd39ad8ab2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:56.595483 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:56.595483 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:56.595483 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:56.595483 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:56.595483 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:56.595483 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:56.595483 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:56.595483 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:56.595483 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:56.595483 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:56.595483 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:56.595483 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:56.595483 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:56.595483 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:56.596623 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:56.596623 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:56.596623 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:56.596623 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:56.596623 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:56.596623 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:56.596623 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:56.596623 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:56.596623 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:56.596623 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:56.596623 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:56.596623 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:56.596623 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:56.596623 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:56.596623 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:56.596623 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:56.596623 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:56.597724 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:56.597724 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:56.597724 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:56.597724 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:56.599978 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 416/852] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:56.605307 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f737fa4-0a12-4662-9e5d-1dd39ad8ab2d None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:56.668639 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcd578-cfe4-40ea-b654-20b4d28a52ba None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:56.704400 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:56.717584 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d318c63-498e-4be6-9f91-bf4fb700da87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:56.719077 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d318c63-498e-4be6-9f91-bf4fb700da87 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:56.719561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d318c63-498e-4be6-9f91-bf4fb700da87 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:56.720106 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d318c63-498e-4be6-9f91-bf4fb700da87 None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:56.721050 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d318c63-498e-4be6-9f91-bf4fb700da87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:56.721727 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d318c63-498e-4be6-9f91-bf4fb700da87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:56.723973 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d318c63-498e-4be6-9f91-bf4fb700da87 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:56.728503 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f737fa4-0a12-4662-9e5d-1dd39ad8ab2d None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:56.740830 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 437/853] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:39:56.746085 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d318c63-498e-4be6-9f91-bf4fb700da87 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:56.769804 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae25028-f4f5-45a7-bcab-f5ed025033b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:56.770556 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae25028-f4f5-45a7-bcab-f5ed025033b4 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:56.770903 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae25028-f4f5-45a7-bcab-f5ed025033b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:56.771469 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae25028-f4f5-45a7-bcab-f5ed025033b4 None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:56.772019 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae25028-f4f5-45a7-bcab-f5ed025033b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:56.772387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae25028-f4f5-45a7-bcab-f5ed025033b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:56.773835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae25028-f4f5-45a7-bcab-f5ed025033b4 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:56.787314 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 417/854] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:39:56.798556 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae25028-f4f5-45a7-bcab-f5ed025033b4 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:56.805001 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:56.864283 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d318c63-498e-4be6-9f91-bf4fb700da87 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:56.900458 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae25028-f4f5-45a7-bcab-f5ed025033b4 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:56.901724 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259c1e3-6ffa-46c7-9849-c6ba9138eeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:56.902661 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259c1e3-6ffa-46c7-9849-c6ba9138eeaa None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:56.903203 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259c1e3-6ffa-46c7-9849-c6ba9138eeaa None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:56.903605 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b259c1e3-6ffa-46c7-9849-c6ba9138eeaa None admin] PATH_INFO: `/v3/users/swift` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:56.911632 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259c1e3-6ffa-46c7-9849-c6ba9138eeaa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:56.913394 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b259c1e3-6ffa-46c7-9849-c6ba9138eeaa None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:56.926496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-b259c1e3-6ffa-46c7-9849-c6ba9138eeaa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 26 04:39:56.926496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:56.926496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:56.926496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:56.926496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:56.926496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:56.926496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:56.926496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:56.926496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:56.926496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:56.926496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:56.926496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:56.926496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:39:56.926496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:39:56.926496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:39:56.926496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:39:56.927686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:56.927686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:56.927686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:39:56.927686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:56.927686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:39:56.927686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:39:56.927686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:56.927686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:56.927686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:56.927686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:56.927686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:56.927686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:56.927686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:56.927686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:56.927686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:56.927686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:56.927686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:56.927686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:56.928882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:56.928882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:56.928882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:39:56.928882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:39:56.928882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:39:56.928882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:39:56.928882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:39:56.928882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:39:56.928882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 26 04:39:56.928882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:56.935672 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 438/855] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:39:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:56.936921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259c1e3-6ffa-46c7-9849-c6ba9138eeaa None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:56.940186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b15287-6300-411d-9e97-ed882f648af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:56.941009 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b15287-6300-411d-9e97-ed882f648af2 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:56.941385 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b15287-6300-411d-9e97-ed882f648af2 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:56.942570 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b15287-6300-411d-9e97-ed882f648af2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:56.950010 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b15287-6300-411d-9e97-ed882f648af2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:56.951673 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b15287-6300-411d-9e97-ed882f648af2 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:56.953897 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:56.965063 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-e8b15287-6300-411d-9e97-ed882f648af2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:56.965063 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:56.965063 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:56.965063 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:56.965063 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:56.965063 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:56.965063 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:56.965063 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:56.965063 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:56.965063 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:56.965063 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:56.965063 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:56.965063 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:39:56.965063 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:39:56.965063 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:39:56.966196 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:39:56.966196 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:56.966196 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:56.966196 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:56.966196 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:56.966196 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:56.966196 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:56.966196 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:56.966196 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:56.966196 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:56.966196 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:56.966196 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:56.966196 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:56.966196 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:56.966196 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:56.966196 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:56.966196 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:56.967289 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:39:56.967289 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:39:56.967289 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:39:56.967289 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:39:56.967289 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:39:56.967289 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:39:56.967289 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:56.967289 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:56.973821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 418/856] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:39:56.975082 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b15287-6300-411d-9e97-ed882f648af2 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:57.053542 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b259c1e3-6ffa-46c7-9849-c6ba9138eeaa None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:57.056360 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:57.085352 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b15287-6300-411d-9e97-ed882f648af2 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:57.090660 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dcccb-818e-432d-8867-15fd68976e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:57.091474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dcccb-818e-432d-8867-15fd68976e38 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:57.091894 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dcccb-818e-432d-8867-15fd68976e38 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:57.092331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22dcccb-818e-432d-8867-15fd68976e38 None admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:57.093268 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22dcccb-818e-432d-8867-15fd68976e38 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:57.093714 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22dcccb-818e-432d-8867-15fd68976e38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:57.095500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22dcccb-818e-432d-8867-15fd68976e38 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:57.119025 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 439/857] 10.222.0.39 () {56 vars in 1135 bytes} [Tue Jul 26 04:39:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:57.120269 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dcccb-818e-432d-8867-15fd68976e38 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:57.124195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c5095-3948-4e09-bef1-020d070a9e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:57.125759 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c5095-3948-4e09-bef1-020d070a9e83 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:57.125759 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c5095-3948-4e09-bef1-020d070a9e83 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:57.125759 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c5095-3948-4e09-bef1-020d070a9e83 None admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:57.126410 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c5095-3948-4e09-bef1-020d070a9e83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:57.126780 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c5095-3948-4e09-bef1-020d070a9e83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:57.128401 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c5095-3948-4e09-bef1-020d070a9e83 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:57.142019 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 419/858] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:39:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:57.147451 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c5095-3948-4e09-bef1-020d070a9e83 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:57.217257 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:57.244775 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22dcccb-818e-432d-8867-15fd68976e38 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:57.258982 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c5095-3948-4e09-bef1-020d070a9e83 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:57.282917 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1e5cf-276f-4690-9dca-bdde45f70e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:57.284380 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1e5cf-276f-4690-9dca-bdde45f70e31 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:57.284887 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1e5cf-276f-4690-9dca-bdde45f70e31 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:57.285485 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1e5cf-276f-4690-9dca-bdde45f70e31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:57.303716 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6acd2e-1631-4044-9045-2949b997decf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:57.304452 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6acd2e-1631-4044-9045-2949b997decf None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:57.304803 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6acd2e-1631-4044-9045-2949b997decf None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:57.305129 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6acd2e-1631-4044-9045-2949b997decf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:57.306004 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6acd2e-1631-4044-9045-2949b997decf None admin] RBAC: Adding query filter params (role.id=a22f1a3785a746048e38205d1996764b, scope.project.id=c4d7c29a2b144df6afa96fd6894254a4, user.id=b613dee1148c4822af2e7847b28cf4aa) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:57.306393 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6acd2e-1631-4044-9045-2949b997decf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:57.307912 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6acd2e-1631-4044-9045-2949b997decf None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:57.322013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 420/859] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:39:57 2022] GET /identity/v3/role_assignments?user.id=b613dee1148c4822af2e7847b28cf4aa&scope.project.id=c4d7c29a2b144df6afa96fd6894254a4&role.id=a22f1a3785a746048e38205d1996764b => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:39:57.333939 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:57.374951 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae1e5cf-276f-4690-9dca-bdde45f70e31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:57.376567 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae1e5cf-276f-4690-9dca-bdde45f70e31 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:57.428582 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fe926-75c4-46d5-8faa-94b554ab3844 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:57.428861 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fe926-75c4-46d5-8faa-94b554ab3844 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:57.429170 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fe926-75c4-46d5-8faa-94b554ab3844 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:57.431984 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 421/860] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:39:57.436520 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b389bb-413a-49df-8144-1f5f5d1a10d4 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:57.436800 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b389bb-413a-49df-8144-1f5f5d1a10d4 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:57.437075 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b389bb-413a-49df-8144-1f5f5d1a10d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:57.460164 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-f3b389bb-413a-49df-8144-1f5f5d1a10d4 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:57.460164 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-f3b389bb-413a-49df-8144-1f5f5d1a10d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:57.510922 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 440/861] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:39:57 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 04:39:57.511849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1e5cf-276f-4690-9dca-bdde45f70e31 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:57.560247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 422/862] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 04:39:57.582738 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b389bb-413a-49df-8144-1f5f5d1a10d4 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:57.583763 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:57.630481 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1e5cf-276f-4690-9dca-bdde45f70e31 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:57.649628 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:57.676394 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b34e47-a437-44c8-b6f6-7cd4405e7667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:57.677300 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b34e47-a437-44c8-b6f6-7cd4405e7667 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:57.677747 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b34e47-a437-44c8-b6f6-7cd4405e7667 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:57.678199 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b34e47-a437-44c8-b6f6-7cd4405e7667 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:57.691742 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b34e47-a437-44c8-b6f6-7cd4405e7667 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:57.694280 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b34e47-a437-44c8-b6f6-7cd4405e7667 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:57.706293 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b389bb-413a-49df-8144-1f5f5d1a10d4 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:57.712943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-c9b34e47-a437-44c8-b6f6-7cd4405e7667 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:57.712943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:57.712943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:57.712943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:57.712943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:57.712943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:57.712943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:57.712943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:57.712943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:57.712943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:57.712943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:57.712943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:57.712943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:39:57.712943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:39:57.712943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:39:57.714034 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:39:57.714034 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:57.714034 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:57.714034 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:57.714034 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:57.714034 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:57.714034 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:57.714034 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:57.714034 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:57.714034 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:57.714034 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:57.714034 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:57.714034 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:57.714034 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:57.714034 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:57.714034 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:57.714034 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:57.715176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:39:57.715176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:39:57.715176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:39:57.715176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:57.717455 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 441/863] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:57.723434 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b34e47-a437-44c8-b6f6-7cd4405e7667 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:57.746482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3a42b-b212-4ec3-8795-8fcf1af9e7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:57.747173 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3a42b-b212-4ec3-8795-8fcf1af9e7ee None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:57.747450 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3a42b-b212-4ec3-8795-8fcf1af9e7ee None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:57.747714 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3a42b-b212-4ec3-8795-8fcf1af9e7ee None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:57.748552 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c3a42b-b212-4ec3-8795-8fcf1af9e7ee None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:57.751283 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c3a42b-b212-4ec3-8795-8fcf1af9e7ee None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:57.767511 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-28c3a42b-b212-4ec3-8795-8fcf1af9e7ee None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 04:39:57.767511 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:57.767511 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 04:39:57.767511 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 04:39:57.767511 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 04:39:57.767511 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 04:39:57.767511 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 04:39:57.767511 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:39:57.767511 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 04:39:57.767511 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:57.767511 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 04:39:57.767511 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:57.767511 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:57.767511 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:57.767511 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:57.767511 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:57.768690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:57.768690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:57.768690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:57.768690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:57.768690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:57.768690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:57.768690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:57.768690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 04:39:57.768690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 04:39:57.768690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 04:39:57.768690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 04:39:57.768690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:57.768690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:57.768690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:57.768690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:57.768690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:57.769727 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:57.769727 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:57.769727 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:57.769727 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:57.769727 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:57.769727 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:57.769727 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:57.769727 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:57.769727 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:57.769727 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:57.769727 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:57.769727 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 04:39:57.769727 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:39:57.769727 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 04:39:57.769727 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:39:57.772399 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 423/864] 10.222.0.39 () {56 vars in 1132 bytes} [Tue Jul 26 04:39:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:57.778421 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3a42b-b212-4ec3-8795-8fcf1af9e7ee None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:57.843755 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b34e47-a437-44c8-b6f6-7cd4405e7667 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:57.859086 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:57.881774 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aaf3c2-689d-47bf-942a-a0e2795d7aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:57.882480 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aaf3c2-689d-47bf-942a-a0e2795d7aa9 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:57.882870 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aaf3c2-689d-47bf-942a-a0e2795d7aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:57.883236 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aaf3c2-689d-47bf-942a-a0e2795d7aa9 None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:57.884024 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aaf3c2-689d-47bf-942a-a0e2795d7aa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:57.884420 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aaf3c2-689d-47bf-942a-a0e2795d7aa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:57.885508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3a42b-b212-4ec3-8795-8fcf1af9e7ee None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:57.886020 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aaf3c2-689d-47bf-942a-a0e2795d7aa9 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:57.898975 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 442/865] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:57.904290 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aaf3c2-689d-47bf-942a-a0e2795d7aa9 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:57.906426 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:57.926889 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df339845-ed49-419a-9bae-044039e59d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:57.927981 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df339845-ed49-419a-9bae-044039e59d9a None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:57.928497 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df339845-ed49-419a-9bae-044039e59d9a None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:57.928965 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df339845-ed49-419a-9bae-044039e59d9a None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:57.929831 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df339845-ed49-419a-9bae-044039e59d9a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:57.930415 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df339845-ed49-419a-9bae-044039e59d9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:57.931998 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df339845-ed49-419a-9bae-044039e59d9a None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:57.942333 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 424/866] 10.222.0.39 () {56 vars in 1126 bytes} [Tue Jul 26 04:39:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:39:57.943567 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df339845-ed49-419a-9bae-044039e59d9a None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:58.023247 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aaf3c2-689d-47bf-942a-a0e2795d7aa9 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:58.060732 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ea17f-6ff3-4d85-93f7-8486a6fcfe17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:58.061174 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df339845-ed49-419a-9bae-044039e59d9a None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:58.062003 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ea17f-6ff3-4d85-93f7-8486a6fcfe17 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:58.062478 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ea17f-6ff3-4d85-93f7-8486a6fcfe17 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:58.062940 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ea17f-6ff3-4d85-93f7-8486a6fcfe17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:58.070938 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ea17f-6ff3-4d85-93f7-8486a6fcfe17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:58.072718 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ea17f-6ff3-4d85-93f7-8486a6fcfe17 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:58.084723 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-a71ea17f-6ff3-4d85-93f7-8486a6fcfe17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:58.084723 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:58.084723 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:58.084723 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:58.084723 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:58.084723 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:58.084723 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:58.084723 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:58.084723 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:58.084723 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:58.084723 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:58.084723 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:58.084723 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:39:58.084723 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:39:58.084723 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:39:58.085665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:39:58.085665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:58.085665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:58.085665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:58.085665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:58.085665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:58.085665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:58.085665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:58.085665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:58.085665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:58.085665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:58.085665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:58.085665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:58.085665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:58.085665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:58.085665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:58.085665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:58.086600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:39:58.086600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:39:58.086600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:39:58.086600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:39:58.086600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:39:58.086600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:39:58.086600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:39:58.086600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:58.089021 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 443/867] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:39:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:39:58.095335 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ea17f-6ff3-4d85-93f7-8486a6fcfe17 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:58.102428 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0be8ec-e469-46cc-8d06-58bed3c1194a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:58.103062 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0be8ec-e469-46cc-8d06-58bed3c1194a None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:58.103339 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0be8ec-e469-46cc-8d06-58bed3c1194a None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:58.103607 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0be8ec-e469-46cc-8d06-58bed3c1194a None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:58.104292 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0be8ec-e469-46cc-8d06-58bed3c1194a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:58.104594 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0be8ec-e469-46cc-8d06-58bed3c1194a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:58.106034 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0be8ec-e469-46cc-8d06-58bed3c1194a None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:58.118005 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 425/868] 10.222.0.39 () {56 vars in 1126 bytes} [Tue Jul 26 04:39:57 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:58.144180 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:58.225383 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ea17f-6ff3-4d85-93f7-8486a6fcfe17 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:58.264631 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b9759-63bc-408a-9f78-0a87a2728fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:58.266194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b9759-63bc-408a-9f78-0a87a2728fe8 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:58.266800 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b9759-63bc-408a-9f78-0a87a2728fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:58.267276 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b9759-63bc-408a-9f78-0a87a2728fe8 None admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:58.268273 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b9759-63bc-408a-9f78-0a87a2728fe8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:58.268794 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b9759-63bc-408a-9f78-0a87a2728fe8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:58.270637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b9759-63bc-408a-9f78-0a87a2728fe8 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:58.286648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 444/869] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:39:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:39:58.294275 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0be8ec-e469-46cc-8d06-58bed3c1194a None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:58.345851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:58.403171 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0be8ec-e469-46cc-8d06-58bed3c1194a None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:58.410222 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c09c15-3b1d-4314-8e55-8ebd94218aaf None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:58.410825 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c09c15-3b1d-4314-8e55-8ebd94218aaf None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:58.411290 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c09c15-3b1d-4314-8e55-8ebd94218aaf None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:58.412826 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 445/870] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:39:58.419129 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb82f8-9818-42a2-b9b2-10fa93574bc4 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:58.419663 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb82f8-9818-42a2-b9b2-10fa93574bc4 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:58.420192 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb82f8-9818-42a2-b9b2-10fa93574bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:58.439029 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-97eb82f8-9818-42a2-b9b2-10fa93574bc4 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:58.440813 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bfaf1-3f63-49ca-a17a-1c097a3ea022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:58.441080 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-97eb82f8-9818-42a2-b9b2-10fa93574bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:58.441445 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bfaf1-3f63-49ca-a17a-1c097a3ea022 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:58.441721 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bfaf1-3f63-49ca-a17a-1c097a3ea022 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:58.442004 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bfaf1-3f63-49ca-a17a-1c097a3ea022 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:58.442811 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844bfaf1-3f63-49ca-a17a-1c097a3ea022 None admin] RBAC: Adding query filter params (role.id=2bfdd65b06554a6da967b3939da753c7, scope.project.id=c4d7c29a2b144df6afa96fd6894254a4, user.id=0e089e39e9de419b9e2fb1d7fc2d245a) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:58.443121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844bfaf1-3f63-49ca-a17a-1c097a3ea022 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:58.444937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844bfaf1-3f63-49ca-a17a-1c097a3ea022 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:58.455889 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 426/871] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:39:58 2022] GET /identity/v3/role_assignments?user.id=0e089e39e9de419b9e2fb1d7fc2d245a&scope.project.id=c4d7c29a2b144df6afa96fd6894254a4&role.id=2bfdd65b06554a6da967b3939da753c7 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:58.524173 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 446/872] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 04:39:58.549348 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bfaf1-3f63-49ca-a17a-1c097a3ea022 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:58.669268 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bfaf1-3f63-49ca-a17a-1c097a3ea022 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:58.679593 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:58.707628 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f6783c-4855-4035-a6a2-aaf4388b6597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:58.708256 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6783c-4855-4035-a6a2-aaf4388b6597 None admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:58.708532 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6783c-4855-4035-a6a2-aaf4388b6597 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:58.708802 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6783c-4855-4035-a6a2-aaf4388b6597 None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:58.709510 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f6783c-4855-4035-a6a2-aaf4388b6597 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:58.710924 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f6783c-4855-4035-a6a2-aaf4388b6597 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:58.729925 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 427/873] 10.222.0.39 () {60 vars in 1141 bytes} [Tue Jul 26 04:39:58 2022] POST /identity/v3/services => generated 251 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:39:59.534687 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e05a33-f42b-4e10-b06b-d85b34aa4a9e None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:59.535198 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e05a33-f42b-4e10-b06b-d85b34aa4a9e None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:59.535198 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e05a33-f42b-4e10-b06b-d85b34aa4a9e None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:59.536731 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 447/874] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:39:59.541987 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51d876-452f-4a03-8d44-6fb0e298e493 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:59.542392 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51d876-452f-4a03-8d44-6fb0e298e493 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:59.542599 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51d876-452f-4a03-8d44-6fb0e298e493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:59.560812 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-5e51d876-452f-4a03-8d44-6fb0e298e493 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:39:59.562009 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-5e51d876-452f-4a03-8d44-6fb0e298e493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:39:59.634569 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 428/875] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:39:59 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 04:39:59.657442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e05a33-f42b-4e10-b06b-d85b34aa4a9e None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:59.683495 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:59.761060 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e05a33-f42b-4e10-b06b-d85b34aa4a9e None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:59.799205 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e44f15-33b8-4ce5-8648-90e2f217957a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:59.800210 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e44f15-33b8-4ce5-8648-90e2f217957a None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:59.800711 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e44f15-33b8-4ce5-8648-90e2f217957a None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:59.801180 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e44f15-33b8-4ce5-8648-90e2f217957a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:59.812296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e44f15-33b8-4ce5-8648-90e2f217957a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:39:59.817683 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-10e44f15-33b8-4ce5-8648-90e2f217957a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 04:39:59.817683 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:39:59.817683 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:39:59.817683 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:39:59.817683 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:39:59.817683 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:39:59.817683 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:39:59.817683 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:39:59.817683 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:39:59.817683 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:39:59.817683 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:39:59.817683 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:39:59.817683 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:39:59.817683 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:39:59.817683 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:39:59.817683 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:39:59.818634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:39:59.818634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:39:59.818634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:39:59.818634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:39:59.818634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:39:59.818634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:39:59.818634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:39:59.818634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:39:59.818634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:39:59.818634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:39:59.818634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:39:59.818634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:39:59.818634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:39:59.818634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:39:59.818634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:39:59.818634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:39:59.819836 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:39:59.819836 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:39:59.819836 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:39:59.819836 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:39:59.819836 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:39:59.819836 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:39:59.819836 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:39:59.819836 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:39:59.819836 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:39:59.819836 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:39:59.819836 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 04:39:59.819836 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:39:59.822572 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 448/876] 10.222.0.39 () {56 vars in 1120 bytes} [Tue Jul 26 04:39:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:39:59.828320 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51d876-452f-4a03-8d44-6fb0e298e493 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:39:59.934369 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:39:59.940784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51d876-452f-4a03-8d44-6fb0e298e493 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:39:59.977256 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61546a-194e-47ae-8317-1fd324d66d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:39:59.978283 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61546a-194e-47ae-8317-1fd324d66d11 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:39:59.978789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61546a-194e-47ae-8317-1fd324d66d11 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:39:59.979261 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61546a-194e-47ae-8317-1fd324d66d11 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:39:59.980200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b61546a-194e-47ae-8317-1fd324d66d11 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:39:59.980664 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b61546a-194e-47ae-8317-1fd324d66d11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:39:59.982235 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b61546a-194e-47ae-8317-1fd324d66d11 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:39:59.991670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 429/877] 10.222.0.39 () {56 vars in 1115 bytes} [Tue Jul 26 04:39:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:39:59.999094 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e44f15-33b8-4ce5-8648-90e2f217957a None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:00.087978 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:00.105852 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e44f15-33b8-4ce5-8648-90e2f217957a None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:00.140715 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32a046-3b72-4421-80a4-ec742c51f21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:00.141756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32a046-3b72-4421-80a4-ec742c51f21b None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:00.142245 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32a046-3b72-4421-80a4-ec742c51f21b None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:00.142699 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32a046-3b72-4421-80a4-ec742c51f21b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:00.153673 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32a046-3b72-4421-80a4-ec742c51f21b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:00.155436 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32a046-3b72-4421-80a4-ec742c51f21b None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:00.170968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-9f32a046-3b72-4421-80a4-ec742c51f21b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:40:00.170968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:00.170968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:00.170968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:00.170968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:00.170968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:00.170968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:00.170968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:00.170968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:00.170968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:00.170968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:00.170968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:00.170968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:40:00.170968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:40:00.170968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:40:00.171921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:40:00.171921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:00.171921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:00.171921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:00.171921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:00.171921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:00.171921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:00.171921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:00.171921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:00.171921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:00.171921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:00.171921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:00.171921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:00.171921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:00.171921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:00.171921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:00.171921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:00.173007 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:40:00.173007 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:40:00.173007 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:40:00.173007 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:00.174960 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 449/878] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:00.183083 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61546a-194e-47ae-8317-1fd324d66d11 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:00.271657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac602242-7012-44ae-b0fb-eb8bb384962c None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:00.271940 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac602242-7012-44ae-b0fb-eb8bb384962c None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:00.272219 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac602242-7012-44ae-b0fb-eb8bb384962c None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:00.274036 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 450/879] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:40:00.278533 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3dbcf-c2fb-4fa4-bb80-a52fd30c00c8 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:00.278818 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3dbcf-c2fb-4fa4-bb80-a52fd30c00c8 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:00.279149 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3dbcf-c2fb-4fa4-bb80-a52fd30c00c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:00.296432 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61546a-194e-47ae-8317-1fd324d66d11 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:00.304443 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-a0c3dbcf-c2fb-4fa4-bb80-a52fd30c00c8 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:00.305850 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-a0c3dbcf-c2fb-4fa4-bb80-a52fd30c00c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:00.331831 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b2c67-a954-4903-afb9-dd8621d10118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:00.332807 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b2c67-a954-4903-afb9-dd8621d10118 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:00.333313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b2c67-a954-4903-afb9-dd8621d10118 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:00.333812 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b2c67-a954-4903-afb9-dd8621d10118 None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:00.334724 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b2c67-a954-4903-afb9-dd8621d10118 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:00.335223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b2c67-a954-4903-afb9-dd8621d10118 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:00.336796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b2c67-a954-4903-afb9-dd8621d10118 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:00.350127 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 430/880] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:00.359100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b2c67-a954-4903-afb9-dd8621d10118 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:00.378667 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:00.391519 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 451/881] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:00 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 04:40:00.414012 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3dbcf-c2fb-4fa4-bb80-a52fd30c00c8 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:00.484031 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b2c67-a954-4903-afb9-dd8621d10118 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:00.489020 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:00.527121 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3dbcf-c2fb-4fa4-bb80-a52fd30c00c8 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:00.529104 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ea887-8bc0-4186-b462-aba487ed0c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:00.529790 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ea887-8bc0-4186-b462-aba487ed0c43 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:00.530111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ea887-8bc0-4186-b462-aba487ed0c43 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:00.530388 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ea887-8bc0-4186-b462-aba487ed0c43 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:00.539933 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ea887-8bc0-4186-b462-aba487ed0c43 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:00.541712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ea887-8bc0-4186-b462-aba487ed0c43 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:00.557030 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-678ea887-8bc0-4186-b462-aba487ed0c43 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 04:40:00.557030 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:00.557030 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:00.557030 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:00.557030 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:00.557030 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:00.557030 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:00.557030 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:00.557030 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:00.557030 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:00.557030 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:00.557030 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:00.557030 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:40:00.557030 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:40:00.557030 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:40:00.557030 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:40:00.558523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:00.558523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:00.558523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:40:00.558523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:40:00.558523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:40:00.558523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:40:00.558523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:00.558523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:00.558523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:00.558523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:00.558523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:00.558523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:00.558523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:00.558523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:00.558523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:00.558523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:00.558523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:00.558523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:00.559482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:00.559482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:00.559482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:40:00.559482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:40:00.559482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:40:00.559482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:40:00.559482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:40:00.559482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:40:00.559482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 04:40:00.559482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:00.562064 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 431/882] 10.222.0.39 () {56 vars in 1117 bytes} [Tue Jul 26 04:40:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:00.565135 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ea887-8bc0-4186-b462-aba487ed0c43 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:00.572658 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644e0d6-8ef3-4066-afaf-c2f42be7ee71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:00.573294 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644e0d6-8ef3-4066-afaf-c2f42be7ee71 None admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:00.573574 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644e0d6-8ef3-4066-afaf-c2f42be7ee71 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:00.573853 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644e0d6-8ef3-4066-afaf-c2f42be7ee71 None admin] PATH_INFO: `/v3/services` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:00.574790 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644e0d6-8ef3-4066-afaf-c2f42be7ee71 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:00.576001 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644e0d6-8ef3-4066-afaf-c2f42be7ee71 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:00.595771 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 452/883] 10.222.0.39 () {60 vars in 1141 bytes} [Tue Jul 26 04:40:00 2022] POST /identity/v3/services => generated 269 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:40:00.597405 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b831cc3-55f3-49fc-a539-30ade681ec28 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:00.597961 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b831cc3-55f3-49fc-a539-30ade681ec28 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:00.598532 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b831cc3-55f3-49fc-a539-30ade681ec28 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:00.600393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 453/884] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:00.611522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2794e-aab6-4d11-a2b3-086c018e1547 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:00.611820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2794e-aab6-4d11-a2b3-086c018e1547 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:00.612244 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2794e-aab6-4d11-a2b3-086c018e1547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:00.645588 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-b1d2794e-aab6-4d11-a2b3-086c018e1547 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:00.646963 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-b1d2794e-aab6-4d11-a2b3-086c018e1547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:00.665495 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:00.698481 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ea887-8bc0-4186-b462-aba487ed0c43 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:00.746077 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c16c39-b633-49da-821d-c834e954e6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:00.747218 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c16c39-b633-49da-821d-c834e954e6d8 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:00.747707 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c16c39-b633-49da-821d-c834e954e6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:00.748191 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c16c39-b633-49da-821d-c834e954e6d8 None admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:00.748369 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 454/885] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:40:00.749364 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c16c39-b633-49da-821d-c834e954e6d8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:00.749673 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c16c39-b633-49da-821d-c834e954e6d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:00.754281 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c16c39-b633-49da-821d-c834e954e6d8 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:00.769703 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2794e-aab6-4d11-a2b3-086c018e1547 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:00.773456 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 432/886] 10.222.0.39 () {56 vars in 1149 bytes} [Tue Jul 26 04:40:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:00.779633 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c16c39-b633-49da-821d-c834e954e6d8 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:00.846164 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:00.893271 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c16c39-b633-49da-821d-c834e954e6d8 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:00.894965 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2794e-aab6-4d11-a2b3-086c018e1547 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:00.923949 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:00.931238 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a30401-70ca-43f3-b645-ff97c13d2920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:00.931563 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4647f-779a-4994-8c18-42ac99879b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:00.931870 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a30401-70ca-43f3-b645-ff97c13d2920 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:00.932149 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a30401-70ca-43f3-b645-ff97c13d2920 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:00.932248 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4647f-779a-4994-8c18-42ac99879b20 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:00.932419 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a30401-70ca-43f3-b645-ff97c13d2920 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:00.932528 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4647f-779a-4994-8c18-42ac99879b20 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:00.932703 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4647f-779a-4994-8c18-42ac99879b20 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:00.933336 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4647f-779a-4994-8c18-42ac99879b20 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:00.934749 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4647f-779a-4994-8c18-42ac99879b20 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:00.946644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-d8d4647f-779a-4994-8c18-42ac99879b20 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 04:40:00.946644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:00.946644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 04:40:00.946644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 04:40:00.946644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 04:40:00.946644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 04:40:00.946644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 04:40:00.946644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:40:00.946644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 04:40:00.946644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:00.946644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 04:40:00.946644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:00.946644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:00.946644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:00.946644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:00.946644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:00.946644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:00.947679 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:00.947679 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:00.947679 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:00.947679 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:00.947679 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:00.947679 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:00.947679 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 04:40:00.947679 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 04:40:00.947679 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 04:40:00.947679 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 04:40:00.947679 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:00.947679 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:00.947679 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:00.947679 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:00.947679 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:00.947679 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:00.948522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:00.948522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:00.948522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:00.948522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:00.948522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:00.948522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:00.948522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:00.948522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:00.948522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:00.948522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:00.948522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 04:40:00.948522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:40:00.948522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 04:40:00.948522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:00.948522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 455/887] 10.222.0.39 () {56 vars in 1126 bytes} [Tue Jul 26 04:40:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:00.950054 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7653b-2e63-4503-a6dd-a26f594cf3ff None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:00.950054 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7653b-2e63-4503-a6dd-a26f594cf3ff None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:00.950232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7653b-2e63-4503-a6dd-a26f594cf3ff None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:00.951479 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 456/888] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:00.954852 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7653b-2e63-4503-a6dd-a26f594cf3ff None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:01.011724 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a30401-70ca-43f3-b645-ff97c13d2920 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:01.013197 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a30401-70ca-43f3-b645-ff97c13d2920 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:01.068223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7653b-2e63-4503-a6dd-a26f594cf3ff None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:01.090989 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:01.105969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff8893-2722-44d0-b09c-638d58515a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:01.106389 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff8893-2722-44d0-b09c-638d58515a82 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:01.106671 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff8893-2722-44d0-b09c-638d58515a82 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:01.106945 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff8893-2722-44d0-b09c-638d58515a82 None admin] PATH_INFO: `/v3/services` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:01.107698 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff8893-2722-44d0-b09c-638d58515a82 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:01.108032 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff8893-2722-44d0-b09c-638d58515a82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:01.109492 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff8893-2722-44d0-b09c-638d58515a82 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:01.115123 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 457/889] 10.222.0.39 () {56 vars in 1122 bytes} [Tue Jul 26 04:40:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:01.116299 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb68b9-cc03-4ccd-8bcd-718f9857a16e None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:01.116586 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb68b9-cc03-4ccd-8bcd-718f9857a16e None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:01.116861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb68b9-cc03-4ccd-8bcd-718f9857a16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:01.127379 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 433/890] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:40:00 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 04:40:01.127379 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a30401-70ca-43f3-b645-ff97c13d2920 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:01.137200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-68eb68b9-cc03-4ccd-8bcd-718f9857a16e None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:01.138426 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-68eb68b9-cc03-4ccd-8bcd-718f9857a16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:01.161388 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:01.208225 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 458/891] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:40:01.209382 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb68b9-cc03-4ccd-8bcd-718f9857a16e None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:01.245041 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a30401-70ca-43f3-b645-ff97c13d2920 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:01.288537 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737640f-25c4-4913-b65e-9bd7159c9672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:01.289455 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737640f-25c4-4913-b65e-9bd7159c9672 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:01.289571 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737640f-25c4-4913-b65e-9bd7159c9672 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:01.289794 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737640f-25c4-4913-b65e-9bd7159c9672 None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:01.290507 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737640f-25c4-4913-b65e-9bd7159c9672 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:01.290809 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737640f-25c4-4913-b65e-9bd7159c9672 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:01.292188 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737640f-25c4-4913-b65e-9bd7159c9672 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:01.306032 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 434/892] 10.222.0.39 () {56 vars in 1122 bytes} [Tue Jul 26 04:40:01 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:01.306032 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737640f-25c4-4913-b65e-9bd7159c9672 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:01.332475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb68b9-cc03-4ccd-8bcd-718f9857a16e None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:01.349604 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:01.375001 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a8c4b-899e-4a59-8883-b9278415d677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:01.375754 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a8c4b-899e-4a59-8883-b9278415d677 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:01.376034 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a8c4b-899e-4a59-8883-b9278415d677 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:01.376307 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a8c4b-899e-4a59-8883-b9278415d677 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:01.388135 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a8c4b-899e-4a59-8883-b9278415d677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:01.389639 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a8c4b-899e-4a59-8883-b9278415d677 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:01.406235 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-6b3a8c4b-899e-4a59-8883-b9278415d677 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:40:01.406235 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:01.406235 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:01.406235 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:01.406235 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:01.406235 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:01.406235 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:01.406235 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:01.406235 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:01.406235 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:01.406235 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:01.406235 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:01.406235 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:40:01.406235 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:40:01.406235 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:40:01.407318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:40:01.407318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:01.407318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:01.407318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:01.407318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:01.407318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:01.407318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:01.407318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:01.407318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:01.407318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:01.407318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:01.407318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:01.407318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:01.407318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:01.407318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:01.407318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:01.407318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:01.408394 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:40:01.408394 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:40:01.408394 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:40:01.408394 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:01.408394 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 459/893] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:01.413521 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a8c4b-899e-4a59-8883-b9278415d677 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:01.434565 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:01.446419 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737640f-25c4-4913-b65e-9bd7159c9672 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:01.496097 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8018bc5-6783-4198-b43b-56daf38495fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:01.496810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8018bc5-6783-4198-b43b-56daf38495fe None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:01.497078 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8018bc5-6783-4198-b43b-56daf38495fe None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:01.497391 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8018bc5-6783-4198-b43b-56daf38495fe None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:01.499083 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8018bc5-6783-4198-b43b-56daf38495fe None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:01.500016 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8018bc5-6783-4198-b43b-56daf38495fe None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:01.511848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-e8018bc5-6783-4198-b43b-56daf38495fe None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 04:40:01.511848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:01.511848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 04:40:01.511848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 04:40:01.511848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 04:40:01.511848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 04:40:01.511848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 04:40:01.511848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:40:01.511848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 04:40:01.511848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:01.511848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 04:40:01.511848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:01.511848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:01.511848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:01.511848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:01.511848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:01.511848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:01.512877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:01.512877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:01.512877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:01.512877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:01.512877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:01.512877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:01.512877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 04:40:01.512877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 04:40:01.512877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 04:40:01.512877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 04:40:01.512877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:01.512877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:01.512877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:01.512877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:01.512877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:01.512877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:01.514250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:01.514250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:01.514250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:01.514250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:01.514250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:01.514250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:01.514250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:01.514250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:01.514250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:01.514250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:01.514250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 04:40:01.514250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:40:01.514250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 04:40:01.514250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:01.514250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 435/894] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 04:40:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:01.520211 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8018bc5-6783-4198-b43b-56daf38495fe None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:01.533790 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a8c4b-899e-4a59-8883-b9278415d677 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:01.577771 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57851b-1a8f-4ab3-9b19-2e920643da68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:01.578738 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57851b-1a8f-4ab3-9b19-2e920643da68 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:01.579027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57851b-1a8f-4ab3-9b19-2e920643da68 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:01.579309 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57851b-1a8f-4ab3-9b19-2e920643da68 None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:01.580021 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57851b-1a8f-4ab3-9b19-2e920643da68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:01.580584 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57851b-1a8f-4ab3-9b19-2e920643da68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:01.582644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57851b-1a8f-4ab3-9b19-2e920643da68 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:01.599018 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 460/895] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:01.604097 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57851b-1a8f-4ab3-9b19-2e920643da68 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:01.632095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:01.646950 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8018bc5-6783-4198-b43b-56daf38495fe None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:01.685828 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9e750-e9a9-4a95-b4e2-d07d9ea5dda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:01.686794 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9e750-e9a9-4a95-b4e2-d07d9ea5dda6 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:01.687244 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9e750-e9a9-4a95-b4e2-d07d9ea5dda6 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:01.687751 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9e750-e9a9-4a95-b4e2-d07d9ea5dda6 None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:01.688711 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9e750-e9a9-4a95-b4e2-d07d9ea5dda6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:01.689186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9e750-e9a9-4a95-b4e2-d07d9ea5dda6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:01.690899 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9e750-e9a9-4a95-b4e2-d07d9ea5dda6 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:01.701886 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 436/896] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 04:40:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:40:01.703520 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9e750-e9a9-4a95-b4e2-d07d9ea5dda6 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:01.709490 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57851b-1a8f-4ab3-9b19-2e920643da68 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:01.731749 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:01.745416 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf7162-e642-4031-9715-725271b95466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:01.746863 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf7162-e642-4031-9715-725271b95466 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:01.746863 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf7162-e642-4031-9715-725271b95466 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:01.746863 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf7162-e642-4031-9715-725271b95466 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:01.754139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf7162-e642-4031-9715-725271b95466 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:01.755680 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf7162-e642-4031-9715-725271b95466 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:01.767773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-cbbf7162-e642-4031-9715-725271b95466 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:40:01.767773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:01.767773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:01.767773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:01.767773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:01.767773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:01.767773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:01.767773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:01.767773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:01.767773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:01.767773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:01.767773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:01.767773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:40:01.767773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:40:01.767773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:40:01.768768 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:40:01.768768 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:01.768768 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:01.768768 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:01.768768 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:01.768768 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:01.768768 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:01.768768 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:01.768768 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:01.768768 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:01.768768 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:01.768768 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:01.768768 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:01.768768 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:01.768768 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:01.768768 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:01.768768 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:01.769677 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:40:01.769677 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:40:01.769677 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:40:01.769677 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:40:01.769677 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:40:01.769677 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:40:01.769677 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:40:01.769677 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:01.774202 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 461/897] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:40:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:40:01.775425 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf7162-e642-4031-9715-725271b95466 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:01.825966 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9e750-e9a9-4a95-b4e2-d07d9ea5dda6 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:01.872975 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda31bd5-5883-4d73-8951-feae060edb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:01.874160 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda31bd5-5883-4d73-8951-feae060edb28 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:01.875070 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda31bd5-5883-4d73-8951-feae060edb28 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:01.875696 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda31bd5-5883-4d73-8951-feae060edb28 None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:01.876677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda31bd5-5883-4d73-8951-feae060edb28 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:01.877181 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda31bd5-5883-4d73-8951-feae060edb28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:01.878787 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:01.880402 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda31bd5-5883-4d73-8951-feae060edb28 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:01.893218 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 437/898] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 04:40:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:01.894831 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda31bd5-5883-4d73-8951-feae060edb28 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:01.905004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf7162-e642-4031-9715-725271b95466 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:01.951196 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cf973-09fb-4a9c-bde8-eb6e0875bf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:01.952200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cf973-09fb-4a9c-bde8-eb6e0875bf0b None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:01.953178 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cf973-09fb-4a9c-bde8-eb6e0875bf0b None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:01.953763 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cf973-09fb-4a9c-bde8-eb6e0875bf0b None admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:01.955013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118cf973-09fb-4a9c-bde8-eb6e0875bf0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:01.955583 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118cf973-09fb-4a9c-bde8-eb6e0875bf0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:01.958001 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118cf973-09fb-4a9c-bde8-eb6e0875bf0b None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:01.975265 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 462/899] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:40:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:01.981851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cf973-09fb-4a9c-bde8-eb6e0875bf0b None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:01.997753 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:02.018256 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda31bd5-5883-4d73-8951-feae060edb28 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:02.061104 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e50c5-abaf-4ca4-93f3-213414de6da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:02.061750 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e50c5-abaf-4ca4-93f3-213414de6da2 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:02.062060 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e50c5-abaf-4ca4-93f3-213414de6da2 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:02.062338 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4e50c5-abaf-4ca4-93f3-213414de6da2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:02.063459 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e50c5-abaf-4ca4-93f3-213414de6da2 None admin] RBAC: Adding query filter params (interface=public, service_id=9c0c71f5713f4fcfba3fe4dbdd3b7d05, region_id=RegionOne) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:02.063770 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e50c5-abaf-4ca4-93f3-213414de6da2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:02.065315 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4e50c5-abaf-4ca4-93f3-213414de6da2 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:02.080087 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 438/900] 10.222.0.39 () {56 vars in 1251 bytes} [Tue Jul 26 04:40:01 2022] GET /identity/v3/endpoints?service_id=9c0c71f5713f4fcfba3fe4dbdd3b7d05&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:02.081540 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e50c5-abaf-4ca4-93f3-213414de6da2 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:02.106660 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cf973-09fb-4a9c-bde8-eb6e0875bf0b None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:02.146088 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b922c704-af94-4d5e-8756-e26293fb71ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:02.147180 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922c704-af94-4d5e-8756-e26293fb71ca None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:02.147687 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922c704-af94-4d5e-8756-e26293fb71ca None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:02.148163 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b922c704-af94-4d5e-8756-e26293fb71ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:02.149302 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b922c704-af94-4d5e-8756-e26293fb71ca None admin] RBAC: Adding query filter params (role.id=b3d30de53787435faa1f35bb788dcefd, scope.project.id=c4d7c29a2b144df6afa96fd6894254a4, user.id=b613dee1148c4822af2e7847b28cf4aa) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:02.149830 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b922c704-af94-4d5e-8756-e26293fb71ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:02.151556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b922c704-af94-4d5e-8756-e26293fb71ca None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:02.162444 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 463/901] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:40:01 2022] GET /identity/v3/role_assignments?user.id=b613dee1148c4822af2e7847b28cf4aa&scope.project.id=c4d7c29a2b144df6afa96fd6894254a4&role.id=b3d30de53787435faa1f35bb788dcefd => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:40:02.209867 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4e50c5-abaf-4ca4-93f3-213414de6da2 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:02.249654 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053905a-c416-46d6-8b1b-00f93764745e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:02.250399 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053905a-c416-46d6-8b1b-00f93764745e None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:02.250674 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053905a-c416-46d6-8b1b-00f93764745e None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:02.250939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053905a-c416-46d6-8b1b-00f93764745e None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:02.251772 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053905a-c416-46d6-8b1b-00f93764745e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:02.253198 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053905a-c416-46d6-8b1b-00f93764745e None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:02.260271 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 439/902] 10.222.0.39 () {56 vars in 1087 bytes} [Tue Jul 26 04:40:02 2022] GET /identity/v3/services => generated 1268 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:40:02.688803 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540a4ba-58d0-47be-9386-40d2fe7b2ee7 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:02.689311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540a4ba-58d0-47be-9386-40d2fe7b2ee7 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:02.689311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540a4ba-58d0-47be-9386-40d2fe7b2ee7 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:02.690901 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 464/903] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:02.696738 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97afcab-3321-4b10-be69-589248f4d4fd None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:02.697216 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97afcab-3321-4b10-be69-589248f4d4fd None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:02.697298 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97afcab-3321-4b10-be69-589248f4d4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:02.715871 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-f97afcab-3321-4b10-be69-589248f4d4fd None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:02.717063 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-f97afcab-3321-4b10-be69-589248f4d4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:02.727204 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:02.791628 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 440/904] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:40:02.815420 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540a4ba-58d0-47be-9386-40d2fe7b2ee7 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:02.829736 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:02.926263 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540a4ba-58d0-47be-9386-40d2fe7b2ee7 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:02.963865 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284288a-774f-4341-86c4-8a2942a7ebc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:02.964529 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284288a-774f-4341-86c4-8a2942a7ebc7 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:02.964808 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284288a-774f-4341-86c4-8a2942a7ebc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:02.965088 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284288a-774f-4341-86c4-8a2942a7ebc7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:02.965729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4284288a-774f-4341-86c4-8a2942a7ebc7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:02.967141 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4284288a-774f-4341-86c4-8a2942a7ebc7 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:02.976940 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-4284288a-774f-4341-86c4-8a2942a7ebc7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 04:40:02.976940 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:02.976940 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 04:40:02.976940 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 04:40:02.976940 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 04:40:02.976940 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 04:40:02.976940 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 04:40:02.976940 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:40:02.976940 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 04:40:02.976940 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:02.976940 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 04:40:02.976940 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:02.976940 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:02.976940 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:02.976940 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:02.976940 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:02.977935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:02.977935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:02.977935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:02.977935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:02.977935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:02.977935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:02.977935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:02.977935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 04:40:02.977935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 04:40:02.977935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 04:40:02.977935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 04:40:02.977935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:02.977935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:02.977935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:02.977935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:02.977935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:02.978877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:02.978877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:02.978877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:02.978877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:02.978877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:02.978877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:02.978877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:02.978877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:02.978877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:02.978877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:02.978877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:02.978877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 04:40:02.978877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:40:02.978877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 04:40:02.978877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:02.978877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 465/905] 10.222.0.39 () {56 vars in 1132 bytes} [Tue Jul 26 04:40:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:02.986944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97afcab-3321-4b10-be69-589248f4d4fd None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:03.090051 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97afcab-3321-4b10-be69-589248f4d4fd None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:03.124386 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28535a4-90c1-4b03-88b3-c18d17bdcdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:03.125014 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28535a4-90c1-4b03-88b3-c18d17bdcdc5 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:03.125398 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28535a4-90c1-4b03-88b3-c18d17bdcdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:03.125671 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28535a4-90c1-4b03-88b3-c18d17bdcdc5 None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:03.126385 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28535a4-90c1-4b03-88b3-c18d17bdcdc5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:03.126687 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28535a4-90c1-4b03-88b3-c18d17bdcdc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:03.128063 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28535a4-90c1-4b03-88b3-c18d17bdcdc5 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:03.133250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 441/906] 10.222.0.39 () {56 vars in 1126 bytes} [Tue Jul 26 04:40:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:03.139008 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284288a-774f-4341-86c4-8a2942a7ebc7 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:03.220707 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:03.247329 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284288a-774f-4341-86c4-8a2942a7ebc7 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:03.283011 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84fe83-eb9f-4005-8e64-294f1818d491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:03.283651 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84fe83-eb9f-4005-8e64-294f1818d491 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:03.283981 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84fe83-eb9f-4005-8e64-294f1818d491 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:03.284250 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84fe83-eb9f-4005-8e64-294f1818d491 None admin] PATH_INFO: `/v3/services` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:03.284942 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84fe83-eb9f-4005-8e64-294f1818d491 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:03.285245 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84fe83-eb9f-4005-8e64-294f1818d491 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:03.286731 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84fe83-eb9f-4005-8e64-294f1818d491 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:03.292611 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 466/907] 10.222.0.39 () {56 vars in 1126 bytes} [Tue Jul 26 04:40:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:03.299120 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28535a4-90c1-4b03-88b3-c18d17bdcdc5 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:03.310755 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:03.381355 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6504a-7519-41c5-b376-b801e9ce110e None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:03.381691 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6504a-7519-41c5-b376-b801e9ce110e None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:03.381915 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c6504a-7519-41c5-b376-b801e9ce110e None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:03.384797 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 467/908] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:40:03.389475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fbf4a-d3c9-40b8-8653-9d1b632ae40d None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:03.389755 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fbf4a-d3c9-40b8-8653-9d1b632ae40d None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:03.390069 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fbf4a-d3c9-40b8-8653-9d1b632ae40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:03.412006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-3d0fbf4a-d3c9-40b8-8653-9d1b632ae40d None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:03.413453 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-3d0fbf4a-d3c9-40b8-8653-9d1b632ae40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:03.413806 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28535a4-90c1-4b03-88b3-c18d17bdcdc5 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:03.459191 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac5129-e488-4dca-a8f3-b455dcfd01f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:03.459820 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac5129-e488-4dca-a8f3-b455dcfd01f4 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:03.460562 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac5129-e488-4dca-a8f3-b455dcfd01f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:03.460850 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac5129-e488-4dca-a8f3-b455dcfd01f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:03.461614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac5129-e488-4dca-a8f3-b455dcfd01f4 None admin] RBAC: Adding query filter params (interface=public, service_id=19a7c0d5f3a04afba2d1d7a741a4a712, region_id=RegionOne) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:03.461925 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac5129-e488-4dca-a8f3-b455dcfd01f4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:03.464040 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac5129-e488-4dca-a8f3-b455dcfd01f4 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:03.471560 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 442/909] 10.222.0.39 () {56 vars in 1251 bytes} [Tue Jul 26 04:40:03 2022] GET /identity/v3/endpoints?service_id=19a7c0d5f3a04afba2d1d7a741a4a712&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:03.476632 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac5129-e488-4dca-a8f3-b455dcfd01f4 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:03.491406 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 468/910] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 04:40:03.513073 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fbf4a-d3c9-40b8-8653-9d1b632ae40d None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:03.582072 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:03.582536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:03.612867 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac5129-e488-4dca-a8f3-b455dcfd01f4 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:03.622243 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fbf4a-d3c9-40b8-8653-9d1b632ae40d None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:03.658231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd5a93-9acb-4018-8d74-659c01b10e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:03.659046 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd5a93-9acb-4018-8d74-659c01b10e1c None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:03.659423 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd5a93-9acb-4018-8d74-659c01b10e1c None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:03.659799 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd5a93-9acb-4018-8d74-659c01b10e1c None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:03.660579 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd5a93-9acb-4018-8d74-659c01b10e1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:03.662089 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd5a93-9acb-4018-8d74-659c01b10e1c None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:03.662298 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a45a0-12c7-4ff4-ba36-3cacb36b23e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:03.663081 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a45a0-12c7-4ff4-ba36-3cacb36b23e5 None admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:03.663595 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a45a0-12c7-4ff4-ba36-3cacb36b23e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:03.664012 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a45a0-12c7-4ff4-ba36-3cacb36b23e5 None admin] PATH_INFO: `/v3/services` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:03.664951 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a45a0-12c7-4ff4-ba36-3cacb36b23e5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:03.666516 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a45a0-12c7-4ff4-ba36-3cacb36b23e5 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:03.674118 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 443/911] 10.222.0.39 () {56 vars in 1087 bytes} [Tue Jul 26 04:40:03 2022] GET /identity/v3/services => generated 1268 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:40:03.702212 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 469/912] 10.222.0.39 () {60 vars in 1141 bytes} [Tue Jul 26 04:40:03 2022] POST /identity/v3/services => generated 241 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:40:04.267812 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdef802-6725-44d4-a759-9cee8e15075f None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:04.268371 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdef802-6725-44d4-a759-9cee8e15075f None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:04.268371 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdef802-6725-44d4-a759-9cee8e15075f None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:04.272047 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 444/913] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:04.277634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529a710-c2f5-458b-97fc-f406b20ad39b None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:04.277923 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529a710-c2f5-458b-97fc-f406b20ad39b None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:04.284062 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529a710-c2f5-458b-97fc-f406b20ad39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:04.303359 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-0529a710-c2f5-458b-97fc-f406b20ad39b None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:04.304885 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-0529a710-c2f5-458b-97fc-f406b20ad39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:04.324810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4fc0a-5e3f-494f-b151-531fce4a8b17 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:04.325117 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4fc0a-5e3f-494f-b151-531fce4a8b17 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:04.325368 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4fc0a-5e3f-494f-b151-531fce4a8b17 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:04.327018 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 445/914] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:40:04.332987 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7986f-5801-45ce-a86b-4d9dd7f0a0d7 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:04.333274 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7986f-5801-45ce-a86b-4d9dd7f0a0d7 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:04.333578 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7986f-5801-45ce-a86b-4d9dd7f0a0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:04.356635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-eac7986f-5801-45ce-a86b-4d9dd7f0a0d7 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:04.358173 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-eac7986f-5801-45ce-a86b-4d9dd7f0a0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:04.388552 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 470/915] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:40:04.410440 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529a710-c2f5-458b-97fc-f406b20ad39b None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:04.464146 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 446/916] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:40:04.470408 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:04.504354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7986f-5801-45ce-a86b-4d9dd7f0a0d7 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:04.523528 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529a710-c2f5-458b-97fc-f406b20ad39b None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:04.559634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070eaa7-e50c-45cd-a24d-a878d6049ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:04.560995 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070eaa7-e50c-45cd-a24d-a878d6049ee0 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:04.561774 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070eaa7-e50c-45cd-a24d-a878d6049ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:04.562374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070eaa7-e50c-45cd-a24d-a878d6049ee0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:04.576083 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070eaa7-e50c-45cd-a24d-a878d6049ee0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:40:04.583210 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-b070eaa7-e50c-45cd-a24d-a878d6049ee0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 04:40:04.583210 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:04.583210 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:04.583210 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:04.583210 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:04.583210 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:04.583210 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:04.583210 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:04.583210 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:04.583210 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:04.583210 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:04.583210 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:04.583210 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:40:04.583210 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:40:04.583210 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:40:04.583210 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:40:04.584162 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:40:04.584162 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:40:04.584162 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:40:04.584162 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:40:04.584162 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:04.584162 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:04.584162 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:04.584162 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:04.584162 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:04.584162 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:04.584162 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:04.584162 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:04.584162 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:04.584162 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:04.584162 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:04.584162 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:04.585046 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:04.585046 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:04.585046 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:04.585046 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:04.585046 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:40:04.585046 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:40:04.585046 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:40:04.585046 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:40:04.585046 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:40:04.585046 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:40:04.585046 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 04:40:04.585046 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:04.585698 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:04.593799 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 471/917] 10.222.0.39 () {56 vars in 1120 bytes} [Tue Jul 26 04:40:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:40:04.594704 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070eaa7-e50c-45cd-a24d-a878d6049ee0 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:04.643617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7986f-5801-45ce-a86b-4d9dd7f0a0d7 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:04.686532 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f5a80-cc17-450a-b16c-da56c8b8f6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:04.687715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f5a80-cc17-450a-b16c-da56c8b8f6bd None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:04.688007 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f5a80-cc17-450a-b16c-da56c8b8f6bd None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:04.688282 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f5a80-cc17-450a-b16c-da56c8b8f6bd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:04.688922 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f5a80-cc17-450a-b16c-da56c8b8f6bd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:04.690607 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f5a80-cc17-450a-b16c-da56c8b8f6bd None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:04.702597 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-ea3f5a80-cc17-450a-b16c-da56c8b8f6bd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 04:40:04.702597 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:04.702597 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 04:40:04.702597 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 04:40:04.702597 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 04:40:04.702597 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 04:40:04.702597 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 04:40:04.702597 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:40:04.702597 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 04:40:04.702597 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:04.702597 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 04:40:04.702597 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:04.702597 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:04.702597 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:04.702597 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:04.702597 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:04.702597 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:04.703825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:04.703825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:04.703825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:04.703825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:04.703825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:04.703825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:04.703825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 04:40:04.703825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 04:40:04.703825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 04:40:04.703825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 04:40:04.703825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:04.703825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:04.703825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:04.703825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:04.703825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:04.703825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:04.704777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:04.704777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:04.704777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:04.704777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:04.704777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:04.704777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:04.704777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:04.704777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:04.704777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:04.704777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:04.704777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 04:40:04.704777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:40:04.704777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 26 04:40:04.704777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:04.709213 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 447/918] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 04:40:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:04.710137 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f5a80-cc17-450a-b16c-da56c8b8f6bd None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:04.735396 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070eaa7-e50c-45cd-a24d-a878d6049ee0 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:04.755104 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:04.782423 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77986f1-77dc-43f9-bf4b-e493eea1849d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:04.784105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77986f1-77dc-43f9-bf4b-e493eea1849d None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:04.784878 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77986f1-77dc-43f9-bf4b-e493eea1849d None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:04.785380 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77986f1-77dc-43f9-bf4b-e493eea1849d None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:04.786584 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77986f1-77dc-43f9-bf4b-e493eea1849d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:04.787470 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77986f1-77dc-43f9-bf4b-e493eea1849d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:04.789663 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77986f1-77dc-43f9-bf4b-e493eea1849d None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:04.802027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 472/919] 10.222.0.39 () {56 vars in 1115 bytes} [Tue Jul 26 04:40:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:40:04.807231 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77986f1-77dc-43f9-bf4b-e493eea1849d None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:04.845498 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f5a80-cc17-450a-b16c-da56c8b8f6bd None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:04.878257 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:04.886295 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba280964-5d0a-43ee-a7c5-1513fa0c0992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:04.887356 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba280964-5d0a-43ee-a7c5-1513fa0c0992 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:04.887847 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba280964-5d0a-43ee-a7c5-1513fa0c0992 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:04.888339 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba280964-5d0a-43ee-a7c5-1513fa0c0992 None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:04.889232 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba280964-5d0a-43ee-a7c5-1513fa0c0992 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:04.889743 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba280964-5d0a-43ee-a7c5-1513fa0c0992 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:04.891494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba280964-5d0a-43ee-a7c5-1513fa0c0992 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:04.897374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 448/920] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 04:40:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:04.904022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba280964-5d0a-43ee-a7c5-1513fa0c0992 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:04.944011 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77986f1-77dc-43f9-bf4b-e493eea1849d None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:04.990344 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f63a27-fd8a-409a-9869-dda83ff22834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:04.991386 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f63a27-fd8a-409a-9869-dda83ff22834 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:04.991865 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f63a27-fd8a-409a-9869-dda83ff22834 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:04.992350 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f63a27-fd8a-409a-9869-dda83ff22834 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:05.007221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f63a27-fd8a-409a-9869-dda83ff22834 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:05.009637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f63a27-fd8a-409a-9869-dda83ff22834 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:05.020866 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba280964-5d0a-43ee-a7c5-1513fa0c0992 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:05.029607 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-a7f63a27-fd8a-409a-9869-dda83ff22834 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:40:05.029607 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:05.029607 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:05.029607 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:05.029607 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:05.029607 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:05.029607 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:05.029607 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:05.029607 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:05.029607 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:05.029607 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:05.029607 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:05.029607 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:40:05.029607 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:40:05.029607 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:40:05.031079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:40:05.031079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:05.031079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:05.031079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:05.031079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:05.031079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:05.031079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:05.031079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:05.031079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:05.031079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:05.031079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:05.031079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:05.031079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:05.031079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:05.031079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:05.031079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:05.031079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:05.032068 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:40:05.032068 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:40:05.032068 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:40:05.032068 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:05.039103 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 473/921] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:05.043137 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f63a27-fd8a-409a-9869-dda83ff22834 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:05.062126 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe854d-8d96-4e46-9e17-86675bc0eb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:05.062842 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe854d-8d96-4e46-9e17-86675bc0eb4c None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:05.063119 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe854d-8d96-4e46-9e17-86675bc0eb4c None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:05.063389 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe854d-8d96-4e46-9e17-86675bc0eb4c None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:05.064065 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe854d-8d96-4e46-9e17-86675bc0eb4c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:05.064368 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe854d-8d96-4e46-9e17-86675bc0eb4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:05.065798 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe854d-8d96-4e46-9e17-86675bc0eb4c None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:05.076190 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 449/922] 10.222.0.39 () {56 vars in 1114 bytes} [Tue Jul 26 04:40:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:05.077236 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe854d-8d96-4e46-9e17-86675bc0eb4c None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:05.084568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:05.157276 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:05.162415 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f63a27-fd8a-409a-9869-dda83ff22834 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:05.204101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463be6f6-a535-4009-a90f-741043b5572d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:05.204861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463be6f6-a535-4009-a90f-741043b5572d None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:05.205208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463be6f6-a535-4009-a90f-741043b5572d None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:05.205546 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463be6f6-a535-4009-a90f-741043b5572d None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:05.206402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463be6f6-a535-4009-a90f-741043b5572d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:05.206855 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463be6f6-a535-4009-a90f-741043b5572d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:05.208414 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463be6f6-a535-4009-a90f-741043b5572d None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:05.219968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe854d-8d96-4e46-9e17-86675bc0eb4c None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:05.226246 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 474/923] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:05.228912 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463be6f6-a535-4009-a90f-741043b5572d None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:05.263069 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e34fe8-13d2-4903-81f2-7bf2227f633f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:05.263786 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e34fe8-13d2-4903-81f2-7bf2227f633f None admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:05.264074 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e34fe8-13d2-4903-81f2-7bf2227f633f None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:05.264342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e34fe8-13d2-4903-81f2-7bf2227f633f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:05.265310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e34fe8-13d2-4903-81f2-7bf2227f633f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:05.267482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e34fe8-13d2-4903-81f2-7bf2227f633f None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:05.306098 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 450/924] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:40:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:40:05.346091 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:05.366008 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463be6f6-a535-4009-a90f-741043b5572d None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:05.420380 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348fbe3-aced-44a0-8bfd-651b88831ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:05.421131 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348fbe3-aced-44a0-8bfd-651b88831ff7 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:05.421414 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348fbe3-aced-44a0-8bfd-651b88831ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:05.421684 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348fbe3-aced-44a0-8bfd-651b88831ff7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:05.430925 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348fbe3-aced-44a0-8bfd-651b88831ff7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:05.432489 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348fbe3-aced-44a0-8bfd-651b88831ff7 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:05.447221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-6348fbe3-aced-44a0-8bfd-651b88831ff7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 04:40:05.447221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:05.447221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:05.447221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:05.447221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:05.447221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:05.447221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:05.447221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:05.447221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:05.447221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:05.447221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:05.447221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:05.447221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:40:05.447221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:40:05.447221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:40:05.447221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:40:05.448659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:05.448659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:05.448659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:40:05.448659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:40:05.448659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:40:05.448659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:40:05.448659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:05.448659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:05.448659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:05.448659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:05.448659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:05.448659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:05.448659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:05.448659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:05.448659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:05.448659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:05.448659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:05.448659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:05.449634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:05.449634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:05.449634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:40:05.449634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:40:05.449634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:40:05.449634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:40:05.449634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:40:05.449634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:40:05.449634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 04:40:05.449634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:05.449634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 475/925] 10.222.0.39 () {56 vars in 1117 bytes} [Tue Jul 26 04:40:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:05.457053 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e34fe8-13d2-4903-81f2-7bf2227f633f None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:05.571779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e34fe8-13d2-4903-81f2-7bf2227f633f None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:05.588385 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:05.614330 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52786ce-433e-4e73-ab3a-dc191d3fbc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:05.615057 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52786ce-433e-4e73-ab3a-dc191d3fbc48 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:05.615339 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52786ce-433e-4e73-ab3a-dc191d3fbc48 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:05.615611 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52786ce-433e-4e73-ab3a-dc191d3fbc48 None admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:05.616448 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52786ce-433e-4e73-ab3a-dc191d3fbc48 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:05.616757 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52786ce-433e-4e73-ab3a-dc191d3fbc48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:05.618298 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52786ce-433e-4e73-ab3a-dc191d3fbc48 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:05.639706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 451/926] 10.222.0.39 () {56 vars in 1149 bytes} [Tue Jul 26 04:40:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:05.645728 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348fbe3-aced-44a0-8bfd-651b88831ff7 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:05.767739 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348fbe3-aced-44a0-8bfd-651b88831ff7 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:05.773854 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7079f4-655c-46c4-ae84-c4b27f478590 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:05.774222 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7079f4-655c-46c4-ae84-c4b27f478590 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:05.774510 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7079f4-655c-46c4-ae84-c4b27f478590 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:05.776237 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 452/927] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:40:05.781767 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9547229-5002-4ff1-95e2-672c713b66a6 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:05.782090 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9547229-5002-4ff1-95e2-672c713b66a6 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:05.782361 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9547229-5002-4ff1-95e2-672c713b66a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:05.802828 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-a9547229-5002-4ff1-95e2-672c713b66a6 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:05.803643 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-a9547229-5002-4ff1-95e2-672c713b66a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:05.808184 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371fe59-e009-42bf-984d-483f5b316604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:05.808840 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371fe59-e009-42bf-984d-483f5b316604 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:05.809123 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371fe59-e009-42bf-984d-483f5b316604 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:05.809877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371fe59-e009-42bf-984d-483f5b316604 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:05.822398 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371fe59-e009-42bf-984d-483f5b316604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:05.823905 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371fe59-e009-42bf-984d-483f5b316604 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:05.826693 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:05.841175 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-5371fe59-e009-42bf-984d-483f5b316604 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:40:05.841175 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:05.841175 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:05.841175 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:05.841175 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:05.841175 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:05.841175 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:05.841175 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:05.841175 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:05.841175 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:05.841175 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:05.841175 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:05.841175 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:40:05.841175 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:40:05.841175 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:40:05.842200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:40:05.842200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:05.842200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:05.842200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:05.842200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:05.842200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:05.842200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:05.842200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:05.842200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:05.842200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:05.842200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:05.842200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:05.842200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:05.842200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:05.842200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:05.842200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:05.842200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:05.843107 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:40:05.843107 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:40:05.843107 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:40:05.843107 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:05.843107 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 476/928] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:40:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:05.844743 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbaf64a-61bf-4741-adde-ceebefd70545 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:05.844743 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbaf64a-61bf-4741-adde-ceebefd70545 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:05.844743 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbaf64a-61bf-4741-adde-ceebefd70545 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:05.848704 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 477/929] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:05.850523 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbaf64a-61bf-4741-adde-ceebefd70545 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:05.882346 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 453/930] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:40:05.884033 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1035e7-01ff-4776-9336-41530ecdca37 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:05.884372 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1035e7-01ff-4776-9336-41530ecdca37 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:05.884711 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1035e7-01ff-4776-9336-41530ecdca37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:05.904237 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-cd1035e7-01ff-4776-9336-41530ecdca37 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:05.905527 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-cd1035e7-01ff-4776-9336-41530ecdca37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:05.970299 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbaf64a-61bf-4741-adde-ceebefd70545 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:05.977282 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 454/931] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:40:05.978599 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1035e7-01ff-4776-9336-41530ecdca37 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:06.006359 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194d1d7-c521-406d-9716-037930cfc92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:06.007515 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194d1d7-c521-406d-9716-037930cfc92a None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:06.007958 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194d1d7-c521-406d-9716-037930cfc92a None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:06.008508 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194d1d7-c521-406d-9716-037930cfc92a None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:06.009644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194d1d7-c521-406d-9716-037930cfc92a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:06.010128 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194d1d7-c521-406d-9716-037930cfc92a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:06.011745 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194d1d7-c521-406d-9716-037930cfc92a None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:06.022814 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:06.033586 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 478/932] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:40:06.035070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194d1d7-c521-406d-9716-037930cfc92a None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:06.101051 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:06.105721 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1035e7-01ff-4776-9336-41530ecdca37 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:06.148215 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb1743-5f42-46e8-ae30-028a144b7589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:06.148985 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb1743-5f42-46e8-ae30-028a144b7589 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:06.149266 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb1743-5f42-46e8-ae30-028a144b7589 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:06.149490 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194d1d7-c521-406d-9716-037930cfc92a None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:06.149598 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb1743-5f42-46e8-ae30-028a144b7589 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:06.150183 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb1743-5f42-46e8-ae30-028a144b7589 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:06.151562 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb1743-5f42-46e8-ae30-028a144b7589 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:06.160956 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-5efb1743-5f42-46e8-ae30-028a144b7589 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 04:40:06.160956 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:06.160956 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 04:40:06.160956 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 04:40:06.160956 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 04:40:06.160956 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 04:40:06.160956 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 04:40:06.160956 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:40:06.160956 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 04:40:06.160956 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:06.160956 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 04:40:06.160956 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:06.160956 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:06.160956 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:06.160956 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:06.160956 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:06.162013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:06.162013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:06.162013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:06.162013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:06.162013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:06.162013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:06.162013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:06.162013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 04:40:06.162013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 04:40:06.162013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 04:40:06.162013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 04:40:06.162013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:06.162013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:06.162013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:06.162013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:06.162013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:06.162872 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:06.162872 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:06.162872 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:06.162872 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:06.162872 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:06.162872 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:06.162872 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:06.162872 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:06.162872 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:06.162872 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:06.162872 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:06.162872 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 04:40:06.162872 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:40:06.162872 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 26 04:40:06.162872 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:06.162872 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 455/933] 10.222.0.39 () {56 vars in 1132 bytes} [Tue Jul 26 04:40:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:06.163829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb1743-5f42-46e8-ae30-028a144b7589 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:06.195109 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fdf026-a74e-4c28-9e3f-ef6728c1afbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:06.195756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdf026-a74e-4c28-9e3f-ef6728c1afbd None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:06.196032 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdf026-a74e-4c28-9e3f-ef6728c1afbd None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:06.196299 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdf026-a74e-4c28-9e3f-ef6728c1afbd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:06.196924 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fdf026-a74e-4c28-9e3f-ef6728c1afbd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:06.198346 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fdf026-a74e-4c28-9e3f-ef6728c1afbd None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:06.208705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-88fdf026-a74e-4c28-9e3f-ef6728c1afbd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 04:40:06.208705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:06.208705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 04:40:06.208705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 04:40:06.208705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 04:40:06.208705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 04:40:06.208705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 04:40:06.208705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:40:06.208705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 04:40:06.208705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:06.208705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 04:40:06.208705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:06.208705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:06.208705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:06.208705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:06.208705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:06.208705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:06.209835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:06.209835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:06.209835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:06.209835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:06.209835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:06.209835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:06.209835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 04:40:06.209835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 04:40:06.209835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 04:40:06.209835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 04:40:06.209835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:06.209835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:06.209835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:06.209835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:06.209835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:06.209835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:06.211098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:06.211098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:06.211098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:06.211098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:06.211098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:06.211098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:06.211098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:06.211098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:06.211098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:06.211098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:06.211098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 04:40:06.211098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:40:06.211098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 04:40:06.211098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:06.212515 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 479/934] 10.222.0.39 () {56 vars in 1126 bytes} [Tue Jul 26 04:40:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:06.213366 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fdf026-a74e-4c28-9e3f-ef6728c1afbd None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:06.272152 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:06.279476 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb1743-5f42-46e8-ae30-028a144b7589 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:06.314757 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03f7ca-f070-4270-aa3b-5f1074a36120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:06.315416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03f7ca-f070-4270-aa3b-5f1074a36120 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:06.315675 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03f7ca-f070-4270-aa3b-5f1074a36120 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:06.315947 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03f7ca-f070-4270-aa3b-5f1074a36120 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:06.323286 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03f7ca-f070-4270-aa3b-5f1074a36120 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:06.324742 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03f7ca-f070-4270-aa3b-5f1074a36120 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:06.328763 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fdf026-a74e-4c28-9e3f-ef6728c1afbd None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:06.337384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-4e03f7ca-f070-4270-aa3b-5f1074a36120 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:40:06.337384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:06.337384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:06.337384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:06.337384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:06.337384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:06.337384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:06.337384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:06.337384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:06.337384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:06.337384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:06.337384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:06.337384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:40:06.337384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:40:06.337384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:40:06.338384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:40:06.338384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:06.338384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:06.338384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:06.338384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:06.338384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:06.338384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:06.338384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:06.338384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:06.338384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:06.338384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:06.338384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:06.338384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:06.338384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:06.338384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:06.338384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:06.338384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:06.339310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:40:06.339310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:40:06.339310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:40:06.339310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:40:06.339310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:40:06.339310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:40:06.339310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:40:06.339310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:06.340455 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 456/935] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:40:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:06.341275 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03f7ca-f070-4270-aa3b-5f1074a36120 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:06.356890 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:06.373351 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ffac5-c6c6-4094-888d-05f81ea29e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:06.374042 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ffac5-c6c6-4094-888d-05f81ea29e22 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:06.374435 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ffac5-c6c6-4094-888d-05f81ea29e22 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:06.374710 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ffac5-c6c6-4094-888d-05f81ea29e22 None admin] PATH_INFO: `/v3/services` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:06.375509 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ffac5-c6c6-4094-888d-05f81ea29e22 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:06.375809 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ffac5-c6c6-4094-888d-05f81ea29e22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:06.377218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ffac5-c6c6-4094-888d-05f81ea29e22 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:06.386693 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 480/936] 10.222.0.39 () {56 vars in 1126 bytes} [Tue Jul 26 04:40:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:06.388612 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ffac5-c6c6-4094-888d-05f81ea29e22 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:06.450763 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03f7ca-f070-4270-aa3b-5f1074a36120 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:06.487988 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92e620-07e3-4285-b2a9-95f5fa9c28a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:06.488656 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92e620-07e3-4285-b2a9-95f5fa9c28a0 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:06.488931 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92e620-07e3-4285-b2a9-95f5fa9c28a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:06.489195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92e620-07e3-4285-b2a9-95f5fa9c28a0 None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:06.489872 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92e620-07e3-4285-b2a9-95f5fa9c28a0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:06.490204 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92e620-07e3-4285-b2a9-95f5fa9c28a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:06.491595 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92e620-07e3-4285-b2a9-95f5fa9c28a0 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:06.501724 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 457/937] 10.222.0.39 () {56 vars in 1122 bytes} [Tue Jul 26 04:40:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:06.501724 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92e620-07e3-4285-b2a9-95f5fa9c28a0 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:06.504617 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ffac5-c6c6-4094-888d-05f81ea29e22 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:06.528045 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:06.542095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c6391-2b9f-421c-a0fe-523cd99332b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:06.542730 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c6391-2b9f-421c-a0fe-523cd99332b4 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:06.543007 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c6391-2b9f-421c-a0fe-523cd99332b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:06.543276 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c6391-2b9f-421c-a0fe-523cd99332b4 None admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:06.544041 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c6391-2b9f-421c-a0fe-523cd99332b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:06.544350 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c6391-2b9f-421c-a0fe-523cd99332b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:06.545842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c6391-2b9f-421c-a0fe-523cd99332b4 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:06.559898 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 481/938] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:40:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:06.560717 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c6391-2b9f-421c-a0fe-523cd99332b4 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:06.616380 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:06.619551 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92e620-07e3-4285-b2a9-95f5fa9c28a0 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:06.662338 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54a825-5e48-4f1b-abb6-ca7e2ff0bd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:06.662979 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54a825-5e48-4f1b-abb6-ca7e2ff0bd5a None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:06.663764 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54a825-5e48-4f1b-abb6-ca7e2ff0bd5a None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:06.664049 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54a825-5e48-4f1b-abb6-ca7e2ff0bd5a None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:06.664732 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54a825-5e48-4f1b-abb6-ca7e2ff0bd5a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:06.665036 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54a825-5e48-4f1b-abb6-ca7e2ff0bd5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:06.666462 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54a825-5e48-4f1b-abb6-ca7e2ff0bd5a None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:06.676847 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 458/939] 10.222.0.39 () {56 vars in 1126 bytes} [Tue Jul 26 04:40:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:06.676847 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54a825-5e48-4f1b-abb6-ca7e2ff0bd5a None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:06.680564 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c6391-2b9f-421c-a0fe-523cd99332b4 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:06.716013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cad49-68aa-4d00-9c26-e936c164489a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:06.716647 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cad49-68aa-4d00-9c26-e936c164489a None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:06.716927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cad49-68aa-4d00-9c26-e936c164489a None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:06.717199 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cad49-68aa-4d00-9c26-e936c164489a None admin] PATH_INFO: `/v3/services` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:06.717882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54cad49-68aa-4d00-9c26-e936c164489a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:06.718215 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54cad49-68aa-4d00-9c26-e936c164489a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:06.719687 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54cad49-68aa-4d00-9c26-e936c164489a None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:06.729505 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 482/940] 10.222.0.39 () {56 vars in 1122 bytes} [Tue Jul 26 04:40:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:06.729505 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cad49-68aa-4d00-9c26-e936c164489a None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:06.770256 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:06.786669 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54a825-5e48-4f1b-abb6-ca7e2ff0bd5a None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:06.824234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cecaff-431f-46b3-9701-05887a33b901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:06.824940 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cecaff-431f-46b3-9701-05887a33b901 None admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:06.825219 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cecaff-431f-46b3-9701-05887a33b901 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:06.825499 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cecaff-431f-46b3-9701-05887a33b901 None admin] PATH_INFO: `/v3/projects/c4d7c29a2b144df6afa96fd6894254a4/users/b613dee1148c4822af2e7847b28cf4aa/roles/b3d30de53787435faa1f35bb788dcefd` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:06.827800 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cecaff-431f-46b3-9701-05887a33b901 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4d7c29a2b144df6afa96fd6894254a4, user_id=b613dee1148c4822af2e7847b28cf4aa, role_id=b3d30de53787435faa1f35bb788dcefd)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:06.829344 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cecaff-431f-46b3-9701-05887a33b901 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:06.837896 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cad49-68aa-4d00-9c26-e936c164489a None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:06.854040 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 459/941] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 04:40:06 2022] PUT /identity/v3/projects/c4d7c29a2b144df6afa96fd6894254a4/users/b613dee1148c4822af2e7847b28cf4aa/roles/b3d30de53787435faa1f35bb788dcefd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:40:06.854040 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cecaff-431f-46b3-9701-05887a33b901 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:06.858169 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:06.900353 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad77e5b-f640-48de-a168-428c5b609224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:06.901087 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad77e5b-f640-48de-a168-428c5b609224 None admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:06.901469 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad77e5b-f640-48de-a168-428c5b609224 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:06.901892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad77e5b-f640-48de-a168-428c5b609224 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:06.902820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad77e5b-f640-48de-a168-428c5b609224 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:06.904452 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad77e5b-f640-48de-a168-428c5b609224 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:06.942483 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 483/942] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:40:06 2022] POST /identity/v3/endpoints => generated 347 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:40:07.006803 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cecaff-431f-46b3-9701-05887a33b901 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:07.079144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c163402-16f8-4223-b4c1-e2b60bb79d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:07.079801 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c163402-16f8-4223-b4c1-e2b60bb79d51 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:07.080084 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c163402-16f8-4223-b4c1-e2b60bb79d51 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:07.080348 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c163402-16f8-4223-b4c1-e2b60bb79d51 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:07.081130 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c163402-16f8-4223-b4c1-e2b60bb79d51 None admin] RBAC: Adding query filter params (interface=public, service_id=6f916a74f3aa43d1b7b519e3279a6c07, region_id=RegionOne) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:07.081479 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c163402-16f8-4223-b4c1-e2b60bb79d51 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:07.082941 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c163402-16f8-4223-b4c1-e2b60bb79d51 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:07.090263 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 460/943] 10.222.0.39 () {56 vars in 1251 bytes} [Tue Jul 26 04:40:06 2022] GET /identity/v3/endpoints?service_id=6f916a74f3aa43d1b7b519e3279a6c07&interface=public®ion_id=RegionOne => generated 194 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:07.096270 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad77e5b-f640-48de-a168-428c5b609224 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:07.213016 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad77e5b-f640-48de-a168-428c5b609224 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:07.250016 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d01e5-c71c-47ac-a414-7f81ca4af520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:07.250878 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d01e5-c71c-47ac-a414-7f81ca4af520 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:07.251158 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d01e5-c71c-47ac-a414-7f81ca4af520 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:07.251430 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d01e5-c71c-47ac-a414-7f81ca4af520 None admin] PATH_INFO: `/v3/services` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:07.252099 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d01e5-c71c-47ac-a414-7f81ca4af520 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:07.253569 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d01e5-c71c-47ac-a414-7f81ca4af520 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:07.260606 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 484/944] 10.222.0.39 () {56 vars in 1087 bytes} [Tue Jul 26 04:40:07 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:40:07.476725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646c506-939a-44d9-a66f-8a10d1605c9d None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:07.477242 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646c506-939a-44d9-a66f-8a10d1605c9d None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:07.477242 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646c506-939a-44d9-a66f-8a10d1605c9d None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:07.478861 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 461/945] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:07.484487 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ac0cf-e43a-48c0-9668-996e3ab70901 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:07.484771 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ac0cf-e43a-48c0-9668-996e3ab70901 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:07.485046 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ac0cf-e43a-48c0-9668-996e3ab70901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:07.507504 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-985ac0cf-e43a-48c0-9668-996e3ab70901 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:07.508699 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-985ac0cf-e43a-48c0-9668-996e3ab70901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:07.550450 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:07.613734 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 485/946] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:40:07.636221 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646c506-939a-44d9-a66f-8a10d1605c9d None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:07.640486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:07.751279 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646c506-939a-44d9-a66f-8a10d1605c9d None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:07.796971 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76e4d2-31e1-48ca-bc5b-093033514253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:07.797613 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76e4d2-31e1-48ca-bc5b-093033514253 None admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:07.797893 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76e4d2-31e1-48ca-bc5b-093033514253 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:07.798195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76e4d2-31e1-48ca-bc5b-093033514253 None admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:07.798903 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76e4d2-31e1-48ca-bc5b-093033514253 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:07.800371 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f76e4d2-31e1-48ca-bc5b-093033514253 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:07.803081 dv-cinder-850574-1-smb devstack@keystone.service[86745]: WARNING keystone.server.flask.common [None req-9f76e4d2-31e1-48ca-bc5b-093033514253 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 26 04:40:07.824391 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.sql.core [None req-9f76e4d2-31e1-48ca-bc5b-093033514253 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 04:40:07.824391 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 26 04:40:07.824391 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [parameters: {'id': 'c65d576e3eb846389f87fdbc74fb91cb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 26 04:40:07.824391 dv-cinder-850574-1-smb devstack@keystone.service[86745]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86745) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 04:40:07.836546 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-9f76e4d2-31e1-48ca-bc5b-093033514253 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c65d576e3eb846389f87fdbc74fb91cb.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c65d576e3eb846389f87fdbc74fb91cb. Jul 26 04:40:07.836546 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:07.836546 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 04:40:07.836546 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 04:40:07.836546 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 04:40:07.836546 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 04:40:07.836546 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 04:40:07.836546 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 04:40:07.836546 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 04:40:07.836546 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application conn.query(q) Jul 26 04:40:07.836546 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 04:40:07.836546 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 04:40:07.836546 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 04:40:07.837590 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application result.read() Jul 26 04:40:07.837590 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 04:40:07.837590 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 04:40:07.837590 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 04:40:07.837590 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 04:40:07.837590 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 04:40:07.837590 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 04:40:07.837590 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 04:40:07.837590 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 04:40:07.837590 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 04:40:07.837590 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:07.837590 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 04:40:07.837590 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:07.837590 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:07.837590 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 04:40:07.837590 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 04:40:07.837590 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 26 04:40:07.837590 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 26 04:40:07.838671 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 04:40:07.838671 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application next(self.gen) Jul 26 04:40:07.838671 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 04:40:07.838671 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application yield resource Jul 26 04:40:07.838671 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 04:40:07.838671 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application next(self.gen) Jul 26 04:40:07.838671 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 04:40:07.838671 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 04:40:07.838671 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:40:07.838671 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 04:40:07.838671 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:40:07.838671 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise self.value Jul 26 04:40:07.838671 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 04:40:07.838671 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 04:40:07.838671 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 04:40:07.838671 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application session.commit() Jul 26 04:40:07.838671 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 04:40:07.839781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 04:40:07.839781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 04:40:07.839781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 04:40:07.839781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 04:40:07.839781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self.session.flush() Jul 26 04:40:07.839781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 04:40:07.839781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 04:40:07.839781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 04:40:07.839781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 04:40:07.839781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 04:40:07.839781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application compat.raise_( Jul 26 04:40:07.839781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 04:40:07.839781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception Jul 26 04:40:07.839781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 04:40:07.839781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 04:40:07.839781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 04:40:07.839781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 04:40:07.840682 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 04:40:07.840682 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 04:40:07.840682 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 04:40:07.840682 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 04:40:07.840682 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 26 04:40:07.840682 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 26 04:40:07.840682 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 04:40:07.840682 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 04:40:07.840682 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 04:40:07.840682 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 04:40:07.840682 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 04:40:07.840682 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 04:40:07.840682 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 04:40:07.840682 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 04:40:07.840682 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 04:40:07.841481 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 04:40:07.841481 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 04:40:07.841481 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception Jul 26 04:40:07.841481 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 04:40:07.841481 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 04:40:07.841481 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 04:40:07.841481 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 04:40:07.841481 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 04:40:07.841481 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 04:40:07.841481 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 04:40:07.841481 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application conn.query(q) Jul 26 04:40:07.841481 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 04:40:07.841481 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 04:40:07.841481 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 04:40:07.841481 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application result.read() Jul 26 04:40:07.841481 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 04:40:07.841481 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 04:40:07.842430 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 04:40:07.842430 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 04:40:07.842430 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 04:40:07.842430 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 04:40:07.842430 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 04:40:07.842430 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 04:40:07.842430 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 26 04:40:07.842430 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 26 04:40:07.842430 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [parameters: {'id': 'c65d576e3eb846389f87fdbc74fb91cb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 26 04:40:07.842430 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 04:40:07.842430 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:07.842430 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 04:40:07.842430 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:07.842430 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:07.842430 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 26 04:40:07.846231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 26 04:40:07.846231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 04:40:07.846231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 04:40:07.846231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 26 04:40:07.846231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:07.846231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 04:40:07.846231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:07.846231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:07.846231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:07.846231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:07.846231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:07.846231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:07.846231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:07.846231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:07.846231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:07.846231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:07.846231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:07.848473 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:07.848473 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 26 04:40:07.848473 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 26 04:40:07.848473 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:07.848473 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:07.848473 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 26 04:40:07.848473 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 26 04:40:07.848473 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c65d576e3eb846389f87fdbc74fb91cb. Jul 26 04:40:07.848473 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:07.848473 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 462/947] 10.222.0.39 () {60 vars in 1140 bytes} [Tue Jul 26 04:40:07 2022] POST /identity/v3/projects => generated 262 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:07.849414 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ac0cf-e43a-48c0-9668-996e3ab70901 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:07.965558 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ac0cf-e43a-48c0-9668-996e3ab70901 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:08.001665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc3b34-178d-4b74-a71a-2599d0ffc870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:08.002287 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc3b34-178d-4b74-a71a-2599d0ffc870 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:08.002567 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc3b34-178d-4b74-a71a-2599d0ffc870 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:08.002839 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc3b34-178d-4b74-a71a-2599d0ffc870 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:08.010484 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc3b34-178d-4b74-a71a-2599d0ffc870 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:08.011984 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc3b34-178d-4b74-a71a-2599d0ffc870 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:08.024490 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-c4dc3b34-178d-4b74-a71a-2599d0ffc870 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:40:08.024490 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:08.024490 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:08.024490 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:08.024490 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:08.024490 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:08.024490 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:08.024490 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:08.024490 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:08.024490 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:08.024490 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:08.024490 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:08.024490 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:40:08.024490 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:40:08.024490 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:40:08.025445 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:40:08.025445 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:08.025445 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:08.025445 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:08.025445 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:08.025445 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:08.025445 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:08.025445 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:08.025445 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:08.025445 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:08.025445 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:08.025445 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:08.025445 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:08.025445 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:08.025445 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:08.025445 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:08.025445 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:08.026804 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:40:08.026804 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:40:08.026804 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:40:08.026804 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:40:08.026804 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:40:08.026804 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:40:08.026804 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:40:08.026804 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:08.026804 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 486/948] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:40:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:08.032624 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76e4d2-31e1-48ca-bc5b-093033514253 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:08.113047 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:08.164583 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76e4d2-31e1-48ca-bc5b-093033514253 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:08.219417 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b497e-bdd7-4abc-9b9f-eaa179967b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:08.220073 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b497e-bdd7-4abc-9b9f-eaa179967b0c None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:08.220349 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b497e-bdd7-4abc-9b9f-eaa179967b0c None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:08.220623 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b497e-bdd7-4abc-9b9f-eaa179967b0c None admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:08.221371 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b497e-bdd7-4abc-9b9f-eaa179967b0c None admin] RBAC: Adding query filter params (name=service) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:08.221684 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b497e-bdd7-4abc-9b9f-eaa179967b0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:08.223421 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b497e-bdd7-4abc-9b9f-eaa179967b0c None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:08.247374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 463/949] 10.222.0.39 () {56 vars in 1112 bytes} [Tue Jul 26 04:40:08 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:08.987802 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10303e43-7420-49dd-8960-0bf16b091ad2 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:08.988344 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10303e43-7420-49dd-8960-0bf16b091ad2 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:08.988344 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10303e43-7420-49dd-8960-0bf16b091ad2 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:08.990077 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 487/950] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:08.995836 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebb4de-84db-4964-b99e-8d77c9c446d9 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:08.996357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebb4de-84db-4964-b99e-8d77c9c446d9 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:08.996435 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebb4de-84db-4964-b99e-8d77c9c446d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:09.017802 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-afebb4de-84db-4964-b99e-8d77c9c446d9 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:09.019379 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-afebb4de-84db-4964-b99e-8d77c9c446d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:09.104294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 464/951] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:40:09.129106 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10303e43-7420-49dd-8960-0bf16b091ad2 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:09.139541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909e65a-909f-45ef-9451-92cc076dbcef None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:09.140262 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909e65a-909f-45ef-9451-92cc076dbcef None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:09.140262 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909e65a-909f-45ef-9451-92cc076dbcef None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:09.141675 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 465/952] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:40:09.147498 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8f3ef-6923-4c62-9b39-895b0017fb76 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:09.147781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8f3ef-6923-4c62-9b39-895b0017fb76 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:09.148046 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8f3ef-6923-4c62-9b39-895b0017fb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:09.162430 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:09.177170 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-87b8f3ef-6923-4c62-9b39-895b0017fb76 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:09.177170 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-87b8f3ef-6923-4c62-9b39-895b0017fb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:09.232174 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:09.262088 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 466/953] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:40:09.281444 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8f3ef-6923-4c62-9b39-895b0017fb76 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:09.300800 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10303e43-7420-49dd-8960-0bf16b091ad2 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:09.352035 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94ec93-4073-4f5b-a068-2f819b31a1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:09.353071 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94ec93-4073-4f5b-a068-2f819b31a1df None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:09.353633 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94ec93-4073-4f5b-a068-2f819b31a1df None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:09.354385 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94ec93-4073-4f5b-a068-2f819b31a1df None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:09.369333 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94ec93-4073-4f5b-a068-2f819b31a1df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:40:09.374442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-6d94ec93-4073-4f5b-a068-2f819b31a1df None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 04:40:09.374442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:09.374442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:09.374442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:09.374442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:09.374442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:09.374442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:09.374442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:09.374442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:09.374442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:09.374442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:09.374442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:09.374442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:40:09.374442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:40:09.374442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:40:09.374442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:40:09.375442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:40:09.375442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:40:09.375442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:40:09.375442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:40:09.375442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:09.375442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:09.375442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:09.375442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:09.375442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:09.375442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:09.375442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:09.375442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:09.375442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:09.375442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:09.375442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:09.375442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:09.376486 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:09.376486 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:09.376486 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:09.376486 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:09.376486 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:40:09.376486 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:40:09.376486 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:40:09.376486 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:40:09.376486 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:40:09.376486 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:40:09.376486 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 04:40:09.376486 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:09.380817 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 488/954] 10.222.0.39 () {56 vars in 1120 bytes} [Tue Jul 26 04:40:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:09.381779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94ec93-4073-4f5b-a068-2f819b31a1df None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:09.411532 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8f3ef-6923-4c62-9b39-895b0017fb76 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:09.462654 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964789f-21f6-4593-817a-04b13428981a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:09.463320 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964789f-21f6-4593-817a-04b13428981a None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:09.463596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964789f-21f6-4593-817a-04b13428981a None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:09.463869 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964789f-21f6-4593-817a-04b13428981a None admin] PATH_INFO: `/v3/services/compute` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:09.464507 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964789f-21f6-4593-817a-04b13428981a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:09.465897 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964789f-21f6-4593-817a-04b13428981a None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:09.473648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:09.477100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-d964789f-21f6-4593-817a-04b13428981a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 04:40:09.477100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:09.477100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 04:40:09.477100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 04:40:09.477100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 04:40:09.477100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 04:40:09.477100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 04:40:09.477100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:40:09.477100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 04:40:09.477100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:09.477100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 04:40:09.477100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:09.477100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:09.477100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:09.477100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:09.477100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:09.477100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:09.478647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:09.478647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:09.478647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:09.478647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:09.478647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:09.478647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:09.478647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 04:40:09.478647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 04:40:09.478647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 04:40:09.478647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 04:40:09.478647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:09.478647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:09.478647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:09.478647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:09.478647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:09.478647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:09.479685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:09.479685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:09.479685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:09.479685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:09.479685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:09.479685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:09.479685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:09.479685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:09.479685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:09.479685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:09.479685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 04:40:09.479685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:40:09.479685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 04:40:09.479685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:09.479685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 467/955] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:40:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:40:09.480586 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff9220-1bfc-4d36-8265-28ed0afc3025 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:09.480586 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff9220-1bfc-4d36-8265-28ed0afc3025 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:09.480586 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff9220-1bfc-4d36-8265-28ed0afc3025 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:09.485934 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 468/956] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:09.485934 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff9220-1bfc-4d36-8265-28ed0afc3025 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:09.513471 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94ec93-4073-4f5b-a068-2f819b31a1df None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:09.550778 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:09.558024 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adaaae-b99e-45e4-bdad-bf3757bf78a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:09.558641 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adaaae-b99e-45e4-bdad-bf3757bf78a7 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:09.558919 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adaaae-b99e-45e4-bdad-bf3757bf78a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:09.559190 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adaaae-b99e-45e4-bdad-bf3757bf78a7 None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:09.559919 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adaaae-b99e-45e4-bdad-bf3757bf78a7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:09.560222 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adaaae-b99e-45e4-bdad-bf3757bf78a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:09.561629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adaaae-b99e-45e4-bdad-bf3757bf78a7 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:09.570853 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 489/957] 10.222.0.39 () {56 vars in 1115 bytes} [Tue Jul 26 04:40:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:09.572081 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecfe99-98c2-403c-b845-603d47054d0f None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:09.572365 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecfe99-98c2-403c-b845-603d47054d0f None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:09.572637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecfe99-98c2-403c-b845-603d47054d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:09.591112 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-a7ecfe99-98c2-403c-b845-603d47054d0f None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:09.592311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-a7ecfe99-98c2-403c-b845-603d47054d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:09.628213 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff9220-1bfc-4d36-8265-28ed0afc3025 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:09.663127 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 490/958] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:40:09.663986 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ecfe99-98c2-403c-b845-603d47054d0f None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:09.667504 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eda176-c64b-4322-b6d6-141705b9b134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:09.667766 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eda176-c64b-4322-b6d6-141705b9b134 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:09.668029 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eda176-c64b-4322-b6d6-141705b9b134 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:09.668297 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eda176-c64b-4322-b6d6-141705b9b134 None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:09.668992 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eda176-c64b-4322-b6d6-141705b9b134 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:09.669295 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eda176-c64b-4322-b6d6-141705b9b134 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:09.670779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eda176-c64b-4322-b6d6-141705b9b134 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:09.684681 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 469/959] 10.222.0.39 () {56 vars in 1112 bytes} [Tue Jul 26 04:40:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:09.686369 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eda176-c64b-4322-b6d6-141705b9b134 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:09.758880 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:09.793773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ecfe99-98c2-403c-b845-603d47054d0f None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:09.816063 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eda176-c64b-4322-b6d6-141705b9b134 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:09.829135 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:09.839941 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b64ce-22b2-4e78-8be6-3d871192608d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:09.840932 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b64ce-22b2-4e78-8be6-3d871192608d None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:09.841614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b64ce-22b2-4e78-8be6-3d871192608d None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:09.841614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b64ce-22b2-4e78-8be6-3d871192608d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:09.855593 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b64ce-22b2-4e78-8be6-3d871192608d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:09.857305 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b64ce-22b2-4e78-8be6-3d871192608d None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:09.860603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b90268-cd23-442b-94e7-5d1a5fabb47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:09.861247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b90268-cd23-442b-94e7-5d1a5fabb47d None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:09.861529 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b90268-cd23-442b-94e7-5d1a5fabb47d None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:09.861871 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b90268-cd23-442b-94e7-5d1a5fabb47d None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:09.862595 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b90268-cd23-442b-94e7-5d1a5fabb47d None admin] RBAC: Adding query filter params (type=compute) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:09.862899 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b90268-cd23-442b-94e7-5d1a5fabb47d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:09.864299 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b90268-cd23-442b-94e7-5d1a5fabb47d None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:09.870593 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 470/960] 10.222.0.39 () {56 vars in 1112 bytes} [Tue Jul 26 04:40:09 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:40:09.871282 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b90268-cd23-442b-94e7-5d1a5fabb47d None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:09.880970 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-043b64ce-22b2-4e78-8be6-3d871192608d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:40:09.880970 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:09.880970 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:09.880970 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:09.880970 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:09.880970 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:09.880970 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:09.880970 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:09.880970 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:09.880970 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:09.880970 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:09.880970 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:09.880970 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:40:09.880970 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:40:09.880970 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:40:09.882022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:40:09.882022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:09.882022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:09.882022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:09.882022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:09.882022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:09.882022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:09.882022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:09.882022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:09.882022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:09.882022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:09.882022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:09.882022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:09.882022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:09.882022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:09.882022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:09.882022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:09.882932 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:40:09.882932 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:40:09.882932 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:40:09.882932 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:09.889075 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 491/961] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:40:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:09.891141 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b64ce-22b2-4e78-8be6-3d871192608d None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:10.023036 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b90268-cd23-442b-94e7-5d1a5fabb47d None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:10.053570 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b64ce-22b2-4e78-8be6-3d871192608d None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:10.080321 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:10.080699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48585ce-3f2e-4dcd-8f72-0b46aad521ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:10.081374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48585ce-3f2e-4dcd-8f72-0b46aad521ae None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:10.082086 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48585ce-3f2e-4dcd-8f72-0b46aad521ae None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:10.082377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48585ce-3f2e-4dcd-8f72-0b46aad521ae None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:10.083284 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48585ce-3f2e-4dcd-8f72-0b46aad521ae None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:10.084886 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48585ce-3f2e-4dcd-8f72-0b46aad521ae None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:10.097158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-c48585ce-3f2e-4dcd-8f72-0b46aad521ae None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 04:40:10.097158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:10.097158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 04:40:10.097158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 04:40:10.097158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 04:40:10.097158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 04:40:10.097158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 04:40:10.097158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:40:10.097158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 04:40:10.097158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:10.097158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 04:40:10.097158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:10.097158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:10.097158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:10.097158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:10.097158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:10.097158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:10.098322 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:10.098322 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:10.098322 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:10.098322 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:10.098322 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:10.098322 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:10.098322 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 04:40:10.098322 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 04:40:10.098322 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 04:40:10.098322 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 04:40:10.098322 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:10.098322 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:10.098322 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:10.098322 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:10.098322 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:10.098322 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:10.099166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:10.099166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:10.099166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:10.099166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:10.099166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:10.099166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:10.099166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:10.099166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:10.099166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:10.099166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:10.099166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 04:40:10.099166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:40:10.099166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 04:40:10.099166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:10.105412 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 471/962] 10.222.0.39 () {56 vars in 1126 bytes} [Tue Jul 26 04:40:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:10.105490 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbb266-cb4c-4211-8cd5-5824cbe56e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:10.106157 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbb266-cb4c-4211-8cd5-5824cbe56e55 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:10.106367 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbb266-cb4c-4211-8cd5-5824cbe56e55 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:10.106637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdbb266-cb4c-4211-8cd5-5824cbe56e55 None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:10.107384 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdbb266-cb4c-4211-8cd5-5824cbe56e55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:10.107692 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdbb266-cb4c-4211-8cd5-5824cbe56e55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:10.109198 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdbb266-cb4c-4211-8cd5-5824cbe56e55 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:10.111606 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48585ce-3f2e-4dcd-8f72-0b46aad521ae None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:10.124808 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 492/963] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:10.132107 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbb266-cb4c-4211-8cd5-5824cbe56e55 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:10.161126 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:10.262434 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48585ce-3f2e-4dcd-8f72-0b46aad521ae None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:10.274369 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdbb266-cb4c-4211-8cd5-5824cbe56e55 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:10.311592 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39311e85-51fa-4318-8670-ed88077b96d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:10.312386 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39311e85-51fa-4318-8670-ed88077b96d4 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:10.312759 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39311e85-51fa-4318-8670-ed88077b96d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:10.313126 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39311e85-51fa-4318-8670-ed88077b96d4 None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:10.313927 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39311e85-51fa-4318-8670-ed88077b96d4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:10.314355 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39311e85-51fa-4318-8670-ed88077b96d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:10.315344 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48749352-155e-4a5f-9e44-4dd98b85b0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:10.316010 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48749352-155e-4a5f-9e44-4dd98b85b0d6 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:10.316163 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39311e85-51fa-4318-8670-ed88077b96d4 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:10.316267 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48749352-155e-4a5f-9e44-4dd98b85b0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:10.316538 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48749352-155e-4a5f-9e44-4dd98b85b0d6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:10.322914 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 472/964] 10.222.0.39 () {56 vars in 1122 bytes} [Tue Jul 26 04:40:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:10.329498 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39311e85-51fa-4318-8670-ed88077b96d4 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:10.331065 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48749352-155e-4a5f-9e44-4dd98b85b0d6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:10.333114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48749352-155e-4a5f-9e44-4dd98b85b0d6 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:10.350031 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-48749352-155e-4a5f-9e44-4dd98b85b0d6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 04:40:10.350031 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:10.350031 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:10.350031 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:10.350031 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:10.350031 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:10.350031 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:10.350031 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:10.350031 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:10.350031 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:10.350031 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:10.350031 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:10.350031 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:40:10.350031 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:40:10.350031 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:40:10.350031 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:40:10.351100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:10.351100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:10.351100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:40:10.351100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:40:10.351100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:40:10.351100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:40:10.351100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:10.351100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:10.351100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:10.351100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:10.351100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:10.351100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:10.351100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:10.351100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:10.351100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:10.351100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:10.351100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:10.351100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:10.352070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:10.352070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:10.352070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:40:10.352070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:40:10.352070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:40:10.352070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:40:10.352070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:40:10.352070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:40:10.352070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 26 04:40:10.352070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:10.352070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 493/965] 10.222.0.39 () {56 vars in 1117 bytes} [Tue Jul 26 04:40:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:40:10.355535 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81ca0d-a854-4220-9883-d39d161da2f5 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:10.355800 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81ca0d-a854-4220-9883-d39d161da2f5 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:10.356437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81ca0d-a854-4220-9883-d39d161da2f5 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:10.357817 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 494/966] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:10.358553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81ca0d-a854-4220-9883-d39d161da2f5 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:10.412702 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:10.459355 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:10.466130 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39311e85-51fa-4318-8670-ed88077b96d4 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:10.493724 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81ca0d-a854-4220-9883-d39d161da2f5 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:10.504026 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4630c0-a0e4-4b52-8582-0dd2416fdc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:10.504662 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4630c0-a0e4-4b52-8582-0dd2416fdc01 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:10.505249 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4630c0-a0e4-4b52-8582-0dd2416fdc01 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:10.505524 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4630c0-a0e4-4b52-8582-0dd2416fdc01 None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:10.506398 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4630c0-a0e4-4b52-8582-0dd2416fdc01 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:10.506701 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4630c0-a0e4-4b52-8582-0dd2416fdc01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:10.508087 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4630c0-a0e4-4b52-8582-0dd2416fdc01 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:10.513581 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 473/967] 10.222.0.39 () {56 vars in 1122 bytes} [Tue Jul 26 04:40:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:10.520044 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca56376-f23e-420d-8a38-a197af53b9ef None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:10.520484 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca56376-f23e-420d-8a38-a197af53b9ef None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:10.520883 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca56376-f23e-420d-8a38-a197af53b9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:10.532853 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05714d-f9cc-4b80-bcd8-28ba6e1fbfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:10.533474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05714d-f9cc-4b80-bcd8-28ba6e1fbfcf None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:10.533773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05714d-f9cc-4b80-bcd8-28ba6e1fbfcf None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:10.534072 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05714d-f9cc-4b80-bcd8-28ba6e1fbfcf None admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:10.534887 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05714d-f9cc-4b80-bcd8-28ba6e1fbfcf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:10.535202 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05714d-f9cc-4b80-bcd8-28ba6e1fbfcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:10.536793 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05714d-f9cc-4b80-bcd8-28ba6e1fbfcf None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:10.542104 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-dca56376-f23e-420d-8a38-a197af53b9ef None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:10.543304 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-dca56376-f23e-420d-8a38-a197af53b9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:10.557793 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 495/968] 10.222.0.39 () {56 vars in 1149 bytes} [Tue Jul 26 04:40:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:10.558868 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05714d-f9cc-4b80-bcd8-28ba6e1fbfcf None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:10.643789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 474/969] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:40:10.644393 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca56376-f23e-420d-8a38-a197af53b9ef None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:10.685032 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:10.688246 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05714d-f9cc-4b80-bcd8-28ba6e1fbfcf None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:10.725053 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa9af8-26c1-41e8-a5c9-010cfa216865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:10.725766 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa9af8-26c1-41e8-a5c9-010cfa216865 None admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:10.726093 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa9af8-26c1-41e8-a5c9-010cfa216865 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:10.726432 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa9af8-26c1-41e8-a5c9-010cfa216865 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:10.727147 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa9af8-26c1-41e8-a5c9-010cfa216865 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:10.728541 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa9af8-26c1-41e8-a5c9-010cfa216865 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:10.753009 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 496/970] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:40:10 2022] POST /identity/v3/endpoints => generated 349 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:40:10.754193 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa9af8-26c1-41e8-a5c9-010cfa216865 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:10.788614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:10.799006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca56376-f23e-420d-8a38-a197af53b9ef None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:10.850686 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7fbda5-0191-4374-b10f-6d195e6ed0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:10.851325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7fbda5-0191-4374-b10f-6d195e6ed0dc None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:10.851601 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7fbda5-0191-4374-b10f-6d195e6ed0dc None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:10.851916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7fbda5-0191-4374-b10f-6d195e6ed0dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:10.903851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa9af8-26c1-41e8-a5c9-010cfa216865 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:10.945775 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7fbda5-0191-4374-b10f-6d195e6ed0dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:10.947604 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7fbda5-0191-4374-b10f-6d195e6ed0dc None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:10.971360 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0980f1-ce3f-42d4-bbad-2677f9ed8719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:10.972185 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0980f1-ce3f-42d4-bbad-2677f9ed8719 None admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:10.972475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0980f1-ce3f-42d4-bbad-2677f9ed8719 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:10.973276 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0980f1-ce3f-42d4-bbad-2677f9ed8719 None admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:10.973455 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0980f1-ce3f-42d4-bbad-2677f9ed8719 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:10.976338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0980f1-ce3f-42d4-bbad-2677f9ed8719 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:10.979817 dv-cinder-850574-1-smb devstack@keystone.service[86744]: WARNING keystone.server.flask.common [None req-9a0980f1-ce3f-42d4-bbad-2677f9ed8719 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 26 04:40:10.997310 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.sql.core [None req-9a0980f1-ce3f-42d4-bbad-2677f9ed8719 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 04:40:10.997310 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 26 04:40:10.997310 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [parameters: {'user_id': 'cbbfe81b0efc4d2382aea56d99009f36', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 26 04:40:10.997310 dv-cinder-850574-1-smb devstack@keystone.service[86744]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86744) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 26 04:40:11.021882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-9a0980f1-ce3f-42d4-bbad-2677f9ed8719 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 26 04:40:11.021882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:11.021882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 04:40:11.021882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 04:40:11.021882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 04:40:11.021882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 04:40:11.021882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 04:40:11.021882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 04:40:11.021882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 04:40:11.021882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application conn.query(q) Jul 26 04:40:11.021882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 04:40:11.021882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 04:40:11.021882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 04:40:11.021882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application result.read() Jul 26 04:40:11.021882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 04:40:11.023105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 04:40:11.023105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 04:40:11.023105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 04:40:11.023105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 04:40:11.023105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 04:40:11.023105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 04:40:11.023105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 04:40:11.023105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 04:40:11.023105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:11.023105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 26 04:40:11.023105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:11.023105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:11.023105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 26 04:40:11.023105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 26 04:40:11.023105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 26 04:40:11.023105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 26 04:40:11.023105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 04:40:11.023105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application next(self.gen) Jul 26 04:40:11.024228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 26 04:40:11.024228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application yield resource Jul 26 04:40:11.024228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 26 04:40:11.024228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application next(self.gen) Jul 26 04:40:11.024228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 26 04:40:11.024228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application self.session.rollback() Jul 26 04:40:11.024228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 26 04:40:11.024228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application self.force_reraise() Jul 26 04:40:11.024228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 26 04:40:11.024228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise self.value Jul 26 04:40:11.024228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 26 04:40:11.024228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 26 04:40:11.024228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 26 04:40:11.024228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application session.commit() Jul 26 04:40:11.024228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 26 04:40:11.024228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 26 04:40:11.024228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 26 04:40:11.025470 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application self._prepare_impl() Jul 26 04:40:11.025470 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 26 04:40:11.025470 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application self.session.flush() Jul 26 04:40:11.025470 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 26 04:40:11.025470 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application self._flush(objects) Jul 26 04:40:11.025470 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 26 04:40:11.025470 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 26 04:40:11.025470 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 26 04:40:11.025470 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application compat.raise_( Jul 26 04:40:11.025470 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 04:40:11.025470 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception Jul 26 04:40:11.025470 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 26 04:40:11.025470 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application flush_context.execute() Jul 26 04:40:11.025470 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 26 04:40:11.025470 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rec.execute(self) Jul 26 04:40:11.025470 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 26 04:40:11.025470 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 26 04:40:11.026659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 26 04:40:11.026659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 26 04:40:11.026659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 26 04:40:11.026659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 26 04:40:11.026659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 26 04:40:11.026659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 26 04:40:11.026659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 26 04:40:11.026659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 26 04:40:11.026659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 26 04:40:11.026659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 26 04:40:11.026659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 26 04:40:11.026659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 26 04:40:11.026659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 26 04:40:11.026659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 26 04:40:11.026659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 26 04:40:11.026659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception Jul 26 04:40:11.027728 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 26 04:40:11.027728 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 26 04:40:11.027728 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 26 04:40:11.027728 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 26 04:40:11.027728 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 26 04:40:11.027728 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application result = self._query(query) Jul 26 04:40:11.027728 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 26 04:40:11.027728 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application conn.query(q) Jul 26 04:40:11.027728 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 26 04:40:11.027728 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 26 04:40:11.027728 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 26 04:40:11.027728 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application result.read() Jul 26 04:40:11.027728 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 26 04:40:11.027728 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 26 04:40:11.027728 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 26 04:40:11.027728 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 26 04:40:11.028788 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 26 04:40:11.028788 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 26 04:40:11.028788 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 26 04:40:11.028788 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 26 04:40:11.028788 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 26 04:40:11.028788 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 26 04:40:11.028788 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [parameters: {'user_id': 'cbbfe81b0efc4d2382aea56d99009f36', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 26 04:40:11.028788 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 26 04:40:11.028788 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:11.028788 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 04:40:11.028788 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:11.028788 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:11.028788 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:11.028788 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:11.028788 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:11.029805 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:11.029805 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:11.029805 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:11.029805 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:11.029805 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:11.029805 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:11.029805 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:11.029805 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 26 04:40:11.029805 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 26 04:40:11.029805 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:11.029805 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:11.029805 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:40:11.029805 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:40:11.029805 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:40:11.029805 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:40:11.029805 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 26 04:40:11.029805 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 26 04:40:11.031006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 26 04:40:11.031006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 26 04:40:11.031006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 26 04:40:11.031006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 26 04:40:11.031006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 26 04:40:11.031006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:11.031006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 497/971] 10.222.0.39 () {60 vars in 1131 bytes} [Tue Jul 26 04:40:10 2022] POST /identity/v3/users => generated 160 bytes in 269 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:11.031006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0980f1-ce3f-42d4-bbad-2677f9ed8719 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:11.089092 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:11.114393 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:11.136580 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 475/972] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:40:10 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 04:40:11.144157 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7fbda5-0191-4374-b10f-6d195e6ed0dc None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:11.257324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7fbda5-0191-4374-b10f-6d195e6ed0dc None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:11.301423 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0980f1-ce3f-42d4-bbad-2677f9ed8719 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:11.303860 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbc819-7837-4ba2-bef6-8649b931533c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:11.304824 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbc819-7837-4ba2-bef6-8649b931533c None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:11.305310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbc819-7837-4ba2-bef6-8649b931533c None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:11.305782 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbc819-7837-4ba2-bef6-8649b931533c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:11.319199 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbc819-7837-4ba2-bef6-8649b931533c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:11.321103 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbc819-7837-4ba2-bef6-8649b931533c None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:11.338111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-4cfbc819-7837-4ba2-bef6-8649b931533c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:40:11.338111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:11.338111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:11.338111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:11.338111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:11.338111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:11.338111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:11.338111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:11.338111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:11.338111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:11.338111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:11.338111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:11.338111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:40:11.338111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:40:11.338111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:40:11.339076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:40:11.339076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:11.339076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:11.339076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:11.339076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:11.339076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:11.339076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:11.339076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:11.339076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:11.339076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:11.339076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:11.339076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:11.339076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:11.339076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:11.339076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:11.339076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:11.339076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:11.340070 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:40:11.340070 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:40:11.340070 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:40:11.340070 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:11.342434 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 476/973] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:40:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:11.351945 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbc819-7837-4ba2-bef6-8649b931533c None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:11.357880 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44727e7-8246-47b7-a600-ffef637473ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:11.360021 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44727e7-8246-47b7-a600-ffef637473ca None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:11.360522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44727e7-8246-47b7-a600-ffef637473ca None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:11.364283 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44727e7-8246-47b7-a600-ffef637473ca None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:11.386243 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44727e7-8246-47b7-a600-ffef637473ca None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:11.389448 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44727e7-8246-47b7-a600-ffef637473ca None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:11.417629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-c44727e7-8246-47b7-a600-ffef637473ca None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 04:40:11.417629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:11.417629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:11.417629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:11.417629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:11.417629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:11.417629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:11.417629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:11.417629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:11.417629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:11.417629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:11.417629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:11.417629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:40:11.417629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:40:11.417629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:40:11.417629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:40:11.418716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:11.418716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:11.418716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:40:11.418716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:40:11.418716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:40:11.418716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:40:11.418716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:11.418716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:11.418716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:11.418716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:11.418716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:11.418716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:11.418716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:11.418716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:11.418716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:11.418716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:11.418716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:11.418716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:11.419688 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:11.419688 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:11.419688 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:40:11.419688 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:40:11.419688 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:40:11.419688 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:40:11.419688 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:40:11.419688 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:40:11.419688 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 26 04:40:11.419688 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:11.424069 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 498/974] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:40:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:11.426866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44727e7-8246-47b7-a600-ffef637473ca None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:11.440105 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:11.506931 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbc819-7837-4ba2-bef6-8649b931533c None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:11.545001 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566616ed-8ac9-4908-8fb1-1979e935506a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:11.546050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566616ed-8ac9-4908-8fb1-1979e935506a None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:11.546677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566616ed-8ac9-4908-8fb1-1979e935506a None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:11.547154 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566616ed-8ac9-4908-8fb1-1979e935506a None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:11.548082 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566616ed-8ac9-4908-8fb1-1979e935506a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:11.548725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566616ed-8ac9-4908-8fb1-1979e935506a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:11.550428 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566616ed-8ac9-4908-8fb1-1979e935506a None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:11.569187 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 477/975] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:40:11.570546 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566616ed-8ac9-4908-8fb1-1979e935506a None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:11.574372 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:11.598781 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44727e7-8246-47b7-a600-ffef637473ca None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:11.634683 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee31abb-c2ab-4159-a2a9-b5d765f81952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:11.635310 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee31abb-c2ab-4159-a2a9-b5d765f81952 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:11.635586 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee31abb-c2ab-4159-a2a9-b5d765f81952 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:11.635856 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee31abb-c2ab-4159-a2a9-b5d765f81952 None admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:11.636619 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee31abb-c2ab-4159-a2a9-b5d765f81952 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:11.636922 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee31abb-c2ab-4159-a2a9-b5d765f81952 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:11.638413 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee31abb-c2ab-4159-a2a9-b5d765f81952 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:11.683561 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566616ed-8ac9-4908-8fb1-1979e935506a None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:11.685831 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:11.686126 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 499/976] 10.222.0.39 () {56 vars in 1101 bytes} [Tue Jul 26 04:40:11 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:11.728475 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a40b9-35e8-4a3c-ad97-418938d3e846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:11.729585 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a40b9-35e8-4a3c-ad97-418938d3e846 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:11.730172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a40b9-35e8-4a3c-ad97-418938d3e846 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:11.730655 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a40b9-35e8-4a3c-ad97-418938d3e846 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:11.739672 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a40b9-35e8-4a3c-ad97-418938d3e846 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:11.741604 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a40b9-35e8-4a3c-ad97-418938d3e846 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:11.755640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-9b2a40b9-35e8-4a3c-ad97-418938d3e846 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:40:11.755640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:11.755640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:11.755640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:11.755640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:11.755640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:11.755640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:11.755640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:11.755640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:11.755640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:11.755640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:11.755640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:11.755640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:40:11.755640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:40:11.755640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:40:11.756670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:40:11.756670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:11.756670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:11.756670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:11.756670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:11.756670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:11.756670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:11.756670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:11.756670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:11.756670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:11.756670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:11.756670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:11.756670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:11.756670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:11.756670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:11.756670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:11.756670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:11.757585 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:40:11.757585 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:40:11.757585 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:40:11.757585 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:40:11.757585 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:40:11.757585 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:40:11.757585 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:40:11.757585 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:11.760316 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 478/977] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:40:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:11.766843 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee31abb-c2ab-4159-a2a9-b5d765f81952 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:11.880486 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee31abb-c2ab-4159-a2a9-b5d765f81952 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:11.916753 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8a327-e695-434c-af5b-7cb9fedd2b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:11.917776 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8a327-e695-434c-af5b-7cb9fedd2b69 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:11.918287 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8a327-e695-434c-af5b-7cb9fedd2b69 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:11.918792 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8a327-e695-434c-af5b-7cb9fedd2b69 None admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:11.919761 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8a327-e695-434c-af5b-7cb9fedd2b69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:11.920301 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8a327-e695-434c-af5b-7cb9fedd2b69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:11.922063 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8a327-e695-434c-af5b-7cb9fedd2b69 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:11.925528 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:11.937680 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 500/978] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:40:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:11.944197 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a40b9-35e8-4a3c-ad97-418938d3e846 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:11.969728 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcf663-7bd6-406a-a3c7-c0f61994334a None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:11.970093 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcf663-7bd6-406a-a3c7-c0f61994334a None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:11.970315 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bcf663-7bd6-406a-a3c7-c0f61994334a None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:11.971780 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 501/979] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:11.977740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea48b6-55b3-414e-b005-2d86e223cad9 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:11.978192 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea48b6-55b3-414e-b005-2d86e223cad9 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:11.978554 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea48b6-55b3-414e-b005-2d86e223cad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:11.999924 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-15ea48b6-55b3-414e-b005-2d86e223cad9 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:12.001711 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-15ea48b6-55b3-414e-b005-2d86e223cad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:12.068996 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a40b9-35e8-4a3c-ad97-418938d3e846 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:12.074025 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 502/980] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 04:40:12.094327 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea48b6-55b3-414e-b005-2d86e223cad9 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:12.107840 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b5613-f3d0-4c9b-a9d2-e2d985a95c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:12.108461 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b5613-f3d0-4c9b-a9d2-e2d985a95c1f None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:12.108815 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b5613-f3d0-4c9b-a9d2-e2d985a95c1f None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:12.109046 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b5613-f3d0-4c9b-a9d2-e2d985a95c1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:12.109830 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b5613-f3d0-4c9b-a9d2-e2d985a95c1f None admin] RBAC: Adding query filter params (role.id=b3d30de53787435faa1f35bb788dcefd, scope.project.id=c4d7c29a2b144df6afa96fd6894254a4, user.id=b613dee1148c4822af2e7847b28cf4aa) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:12.110168 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b5613-f3d0-4c9b-a9d2-e2d985a95c1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:12.111704 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b5613-f3d0-4c9b-a9d2-e2d985a95c1f None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:12.118076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 479/981] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:40:11 2022] GET /identity/v3/role_assignments?user.id=b613dee1148c4822af2e7847b28cf4aa&scope.project.id=c4d7c29a2b144df6afa96fd6894254a4&role.id=b3d30de53787435faa1f35bb788dcefd => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:12.215880 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ea48b6-55b3-414e-b005-2d86e223cad9 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:12.243793 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:12.254660 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f3185-e86f-4224-94b0-c61a013ce22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:12.255300 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f3185-e86f-4224-94b0-c61a013ce22f None admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:12.255574 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f3185-e86f-4224-94b0-c61a013ce22f None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:12.255840 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f3185-e86f-4224-94b0-c61a013ce22f None admin] PATH_INFO: `/v3/services` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:12.256530 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3f3185-e86f-4224-94b0-c61a013ce22f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:12.257970 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3f3185-e86f-4224-94b0-c61a013ce22f None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:12.282023 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 503/982] 10.222.0.39 () {60 vars in 1141 bytes} [Tue Jul 26 04:40:12 2022] POST /identity/v3/services => generated 242 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:40:12.872969 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd1dd1-9c1a-4fb2-9d76-3daf59ca6d3c None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:12.873323 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd1dd1-9c1a-4fb2-9d76-3daf59ca6d3c None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:12.873647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd1dd1-9c1a-4fb2-9d76-3daf59ca6d3c None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:12.875185 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 480/983] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:12.880583 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182aee9-f413-4376-9bd5-81795e550cf0 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:12.880911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182aee9-f413-4376-9bd5-81795e550cf0 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:12.881112 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182aee9-f413-4376-9bd5-81795e550cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:12.900343 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-a182aee9-f413-4376-9bd5-81795e550cf0 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:12.901554 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-a182aee9-f413-4376-9bd5-81795e550cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:12.988057 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 504/984] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:40:13.010100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd1dd1-9c1a-4fb2-9d76-3daf59ca6d3c None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:13.040980 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:13.118674 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd1dd1-9c1a-4fb2-9d76-3daf59ca6d3c None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:13.152736 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8db557-8f90-4f59-8623-f9c715ad998f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:13.153292 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8db557-8f90-4f59-8623-f9c715ad998f None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:13.153576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8db557-8f90-4f59-8623-f9c715ad998f None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:13.153840 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8db557-8f90-4f59-8623-f9c715ad998f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:13.154487 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8db557-8f90-4f59-8623-f9c715ad998f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:13.155910 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8db557-8f90-4f59-8623-f9c715ad998f None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:13.165130 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-1a8db557-8f90-4f59-8623-f9c715ad998f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 04:40:13.165130 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:13.165130 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 04:40:13.165130 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 04:40:13.165130 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 04:40:13.165130 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 04:40:13.165130 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 04:40:13.165130 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:40:13.165130 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 04:40:13.165130 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:13.165130 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 04:40:13.165130 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:13.165130 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:13.165130 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:13.165130 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:13.165130 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:13.165130 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:13.166212 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:13.166212 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:13.166212 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:13.166212 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:13.166212 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:13.166212 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:13.166212 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 04:40:13.166212 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 04:40:13.166212 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 04:40:13.166212 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 04:40:13.166212 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:13.166212 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:13.166212 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:13.166212 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:13.166212 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:13.166212 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:13.167154 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:13.167154 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:13.167154 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:13.167154 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:13.167154 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:13.167154 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:13.167154 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:13.167154 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:13.167154 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:13.167154 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:13.167154 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 04:40:13.167154 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:40:13.167154 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 04:40:13.167154 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:13.167154 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 481/985] 10.222.0.39 () {56 vars in 1126 bytes} [Tue Jul 26 04:40:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:13.174484 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182aee9-f413-4376-9bd5-81795e550cf0 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:13.287996 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182aee9-f413-4376-9bd5-81795e550cf0 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:13.303381 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:13.327719 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab2d91-4b97-45b6-bd05-0f9e2650116c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:13.328391 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab2d91-4b97-45b6-bd05-0f9e2650116c None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:13.328671 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab2d91-4b97-45b6-bd05-0f9e2650116c None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:13.328940 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab2d91-4b97-45b6-bd05-0f9e2650116c None admin] PATH_INFO: `/v3/services` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:13.329622 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab2d91-4b97-45b6-bd05-0f9e2650116c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:13.329924 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab2d91-4b97-45b6-bd05-0f9e2650116c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:13.331421 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab2d91-4b97-45b6-bd05-0f9e2650116c None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:13.341347 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 505/986] 10.222.0.39 () {56 vars in 1122 bytes} [Tue Jul 26 04:40:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:40:13.342368 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8db557-8f90-4f59-8623-f9c715ad998f None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:13.440917 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:13.452493 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8db557-8f90-4f59-8623-f9c715ad998f None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:13.486827 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420f56f-6c36-407d-ad5d-dd5147a54d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:13.487445 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420f56f-6c36-407d-ad5d-dd5147a54d77 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:13.487718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420f56f-6c36-407d-ad5d-dd5147a54d77 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:13.487984 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420f56f-6c36-407d-ad5d-dd5147a54d77 None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:13.488650 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420f56f-6c36-407d-ad5d-dd5147a54d77 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:13.488946 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420f56f-6c36-407d-ad5d-dd5147a54d77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:13.490353 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420f56f-6c36-407d-ad5d-dd5147a54d77 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:13.495404 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 482/987] 10.222.0.39 () {56 vars in 1122 bytes} [Tue Jul 26 04:40:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:40:13.501435 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab2d91-4b97-45b6-bd05-0f9e2650116c None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:13.606025 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab2d91-4b97-45b6-bd05-0f9e2650116c None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:13.641440 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5bfc5e-4dea-458c-b6ec-37def155c0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:13.642079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bfc5e-4dea-458c-b6ec-37def155c0a8 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:13.642365 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bfc5e-4dea-458c-b6ec-37def155c0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:13.642654 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5bfc5e-4dea-458c-b6ec-37def155c0a8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:13.643430 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5bfc5e-4dea-458c-b6ec-37def155c0a8 None admin] RBAC: Adding query filter params (interface=admin, service_id=6f916a74f3aa43d1b7b519e3279a6c07, region_id=RegionOne) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:13.643744 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5bfc5e-4dea-458c-b6ec-37def155c0a8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:13.645145 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5bfc5e-4dea-458c-b6ec-37def155c0a8 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:13.650678 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 506/988] 10.222.0.39 () {56 vars in 1249 bytes} [Tue Jul 26 04:40:13 2022] GET /identity/v3/endpoints?service_id=6f916a74f3aa43d1b7b519e3279a6c07&interface=admin®ion_id=RegionOne => generated 193 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:13.656224 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420f56f-6c36-407d-ad5d-dd5147a54d77 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:13.764163 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420f56f-6c36-407d-ad5d-dd5147a54d77 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:13.798742 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7ac62-bfb2-4066-af4f-2d516c1d082f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:13.799371 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7ac62-bfb2-4066-af4f-2d516c1d082f None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:13.799646 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7ac62-bfb2-4066-af4f-2d516c1d082f None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:13.799916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7ac62-bfb2-4066-af4f-2d516c1d082f None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:13.800559 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe7ac62-bfb2-4066-af4f-2d516c1d082f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:13.801936 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe7ac62-bfb2-4066-af4f-2d516c1d082f None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:13.808676 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 483/989] 10.222.0.39 () {56 vars in 1087 bytes} [Tue Jul 26 04:40:13 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:40:14.171320 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1a11b-fb3d-44b6-a545-6e3b63a44385 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:14.171501 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1a11b-fb3d-44b6-a545-6e3b63a44385 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:14.171779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1a11b-fb3d-44b6-a545-6e3b63a44385 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:14.173204 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 507/990] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:14.178452 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232570e0-7112-4a71-a9a1-9fb09b42709d None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:14.178934 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232570e0-7112-4a71-a9a1-9fb09b42709d None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:14.179031 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232570e0-7112-4a71-a9a1-9fb09b42709d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:14.198754 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-232570e0-7112-4a71-a9a1-9fb09b42709d None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:14.199950 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-232570e0-7112-4a71-a9a1-9fb09b42709d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:14.213490 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:14.270978 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 484/991] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:40:14.273616 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796966f-6e6b-4360-988b-6f7b794ced67 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:14.274103 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796966f-6e6b-4360-988b-6f7b794ced67 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:14.274179 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796966f-6e6b-4360-988b-6f7b794ced67 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:14.278026 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 508/992] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:14.280914 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85b2e9-9641-4af2-99b4-ad605df63118 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:14.281197 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85b2e9-9641-4af2-99b4-ad605df63118 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:14.281463 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85b2e9-9641-4af2-99b4-ad605df63118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:14.295516 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796966f-6e6b-4360-988b-6f7b794ced67 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:14.300039 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-3b85b2e9-9641-4af2-99b4-ad605df63118 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:14.301263 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-3b85b2e9-9641-4af2-99b4-ad605df63118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:14.342947 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:14.372458 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 485/993] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:40:14.394366 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85b2e9-9641-4af2-99b4-ad605df63118 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:14.404243 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796966f-6e6b-4360-988b-6f7b794ced67 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:14.441735 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ae4eb-317f-47a2-80f9-e6fe2e946c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:14.442787 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ae4eb-317f-47a2-80f9-e6fe2e946c8d None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:14.443069 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ae4eb-317f-47a2-80f9-e6fe2e946c8d None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:14.443353 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ae4eb-317f-47a2-80f9-e6fe2e946c8d None admin] PATH_INFO: `/v3/services/image` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:14.444005 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ae4eb-317f-47a2-80f9-e6fe2e946c8d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:14.445413 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ae4eb-317f-47a2-80f9-e6fe2e946c8d None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:14.454556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-0e1ae4eb-317f-47a2-80f9-e6fe2e946c8d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 04:40:14.454556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:14.454556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 04:40:14.454556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 04:40:14.454556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 04:40:14.454556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 04:40:14.454556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 04:40:14.454556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:40:14.454556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 04:40:14.454556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:14.454556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 04:40:14.454556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:14.454556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:14.454556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:14.454556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:14.454556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:14.454556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:14.455604 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:14.455604 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:14.455604 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:14.455604 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:14.455604 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:14.455604 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:14.455604 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 04:40:14.455604 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 04:40:14.455604 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 04:40:14.455604 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 04:40:14.455604 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:14.455604 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:14.455604 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:14.455604 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:14.455604 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:14.455604 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:14.456705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:14.456705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:14.456705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:14.456705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:14.456705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:14.456705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:14.456705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:14.456705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:14.456705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:14.456705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:14.456705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 04:40:14.456705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:40:14.456705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 04:40:14.456705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:14.456705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 509/994] 10.222.0.39 () {56 vars in 1105 bytes} [Tue Jul 26 04:40:14 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:40:14.461676 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ae4eb-317f-47a2-80f9-e6fe2e946c8d None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:14.481148 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:14.504981 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85b2e9-9641-4af2-99b4-ad605df63118 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:14.540891 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244a652-4f5d-4d21-b1ae-0cdacd87f519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:14.541543 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244a652-4f5d-4d21-b1ae-0cdacd87f519 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:14.541817 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244a652-4f5d-4d21-b1ae-0cdacd87f519 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:14.542112 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244a652-4f5d-4d21-b1ae-0cdacd87f519 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:14.542732 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244a652-4f5d-4d21-b1ae-0cdacd87f519 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:14.544117 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244a652-4f5d-4d21-b1ae-0cdacd87f519 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:14.553233 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-6244a652-4f5d-4d21-b1ae-0cdacd87f519 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 04:40:14.553233 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:14.553233 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 04:40:14.553233 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 04:40:14.553233 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 04:40:14.553233 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 04:40:14.553233 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 04:40:14.553233 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:40:14.553233 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 04:40:14.553233 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:14.553233 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 04:40:14.553233 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:14.553233 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:14.553233 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:14.553233 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:14.553233 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:14.553233 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:14.554325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:14.554325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:14.554325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:14.554325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:14.554325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:14.554325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:14.554325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 04:40:14.554325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 04:40:14.554325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 04:40:14.554325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 04:40:14.554325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:14.554325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:14.554325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:14.554325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:14.554325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:14.554325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:14.555214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:14.555214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:14.555214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:14.555214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:14.555214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:14.555214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:14.555214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:14.555214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:14.555214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:14.555214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:14.555214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 04:40:14.555214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:40:14.555214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 04:40:14.555214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:14.555214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 486/995] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:40:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:40:14.560515 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244a652-4f5d-4d21-b1ae-0cdacd87f519 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:14.570024 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ae4eb-317f-47a2-80f9-e6fe2e946c8d None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:14.573729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:14.611094 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdb5b4-d5d3-42f0-92e5-ba893b69d271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:14.611799 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdb5b4-d5d3-42f0-92e5-ba893b69d271 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:14.612039 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdb5b4-d5d3-42f0-92e5-ba893b69d271 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:14.612275 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdb5b4-d5d3-42f0-92e5-ba893b69d271 None admin] PATH_INFO: `/v3/services` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:14.612986 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efdb5b4-d5d3-42f0-92e5-ba893b69d271 None admin] RBAC: Adding query filter params (name=image) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:14.613265 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efdb5b4-d5d3-42f0-92e5-ba893b69d271 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:14.614828 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efdb5b4-d5d3-42f0-92e5-ba893b69d271 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:14.625788 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 510/996] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:40:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:40:14.626703 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdb5b4-d5d3-42f0-92e5-ba893b69d271 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:14.681631 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244a652-4f5d-4d21-b1ae-0cdacd87f519 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:14.719979 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dafb4c9-3f41-448a-b518-6d36875e00a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:14.720601 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafb4c9-3f41-448a-b518-6d36875e00a4 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:14.720965 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafb4c9-3f41-448a-b518-6d36875e00a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:14.721301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafb4c9-3f41-448a-b518-6d36875e00a4 None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:14.722060 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dafb4c9-3f41-448a-b518-6d36875e00a4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:14.722426 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dafb4c9-3f41-448a-b518-6d36875e00a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:14.724258 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dafb4c9-3f41-448a-b518-6d36875e00a4 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:14.733532 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 487/997] 10.222.0.39 () {56 vars in 1112 bytes} [Tue Jul 26 04:40:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:40:14.734610 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dafb4c9-3f41-448a-b518-6d36875e00a4 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:14.744725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:14.762224 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdb5b4-d5d3-42f0-92e5-ba893b69d271 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:14.798555 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e8fb5-04ec-4517-8290-f13cc872f2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:14.799180 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e8fb5-04ec-4517-8290-f13cc872f2ca None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:14.799462 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e8fb5-04ec-4517-8290-f13cc872f2ca None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:14.799812 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e8fb5-04ec-4517-8290-f13cc872f2ca None admin] PATH_INFO: `/v3/services` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:14.800422 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e8fb5-04ec-4517-8290-f13cc872f2ca None admin] RBAC: Adding query filter params (type=image) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:14.800762 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e8fb5-04ec-4517-8290-f13cc872f2ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:14.802163 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e8fb5-04ec-4517-8290-f13cc872f2ca None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:14.807011 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 511/998] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:40:14 2022] GET /identity/v3/services?type=image => generated 122 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:14.850857 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dafb4c9-3f41-448a-b518-6d36875e00a4 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:14.890921 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7027493-5dad-4f44-8f84-26969917ee31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:14.891572 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7027493-5dad-4f44-8f84-26969917ee31 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:14.891851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7027493-5dad-4f44-8f84-26969917ee31 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:14.892123 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7027493-5dad-4f44-8f84-26969917ee31 None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:14.892832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7027493-5dad-4f44-8f84-26969917ee31 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:14.893137 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7027493-5dad-4f44-8f84-26969917ee31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:14.894629 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7027493-5dad-4f44-8f84-26969917ee31 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:14.905645 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 488/999] 10.222.0.39 () {56 vars in 1112 bytes} [Tue Jul 26 04:40:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:14.906800 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e8fb5-04ec-4517-8290-f13cc872f2ca None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:14.944972 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:15.032627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e8fb5-04ec-4517-8290-f13cc872f2ca None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:15.068355 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114795de-3b49-411c-8d3b-34c8c7aa011c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:15.069016 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114795de-3b49-411c-8d3b-34c8c7aa011c None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:15.069297 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114795de-3b49-411c-8d3b-34c8c7aa011c None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:15.069568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114795de-3b49-411c-8d3b-34c8c7aa011c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:15.070363 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114795de-3b49-411c-8d3b-34c8c7aa011c None admin] RBAC: Adding query filter params (interface=public, service_id=dbe3b827a5fa4bf78662688252915b19, region_id=RegionOne) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:15.070675 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114795de-3b49-411c-8d3b-34c8c7aa011c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:15.072078 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114795de-3b49-411c-8d3b-34c8c7aa011c None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:15.077784 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 512/1000] 10.222.0.39 () {56 vars in 1251 bytes} [Tue Jul 26 04:40:14 2022] GET /identity/v3/endpoints?service_id=dbe3b827a5fa4bf78662688252915b19&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:15.083470 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7027493-5dad-4f44-8f84-26969917ee31 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:15.154927 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:15.187088 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7027493-5dad-4f44-8f84-26969917ee31 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:15.222609 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380a7b9-6576-433f-9379-bb1f65e606a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:15.223230 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380a7b9-6576-433f-9379-bb1f65e606a8 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:15.223513 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380a7b9-6576-433f-9379-bb1f65e606a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:15.223781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380a7b9-6576-433f-9379-bb1f65e606a8 None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:15.224434 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3380a7b9-6576-433f-9379-bb1f65e606a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:15.225824 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3380a7b9-6576-433f-9379-bb1f65e606a8 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:15.232773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 489/1001] 10.222.0.39 () {56 vars in 1087 bytes} [Tue Jul 26 04:40:15 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:40:15.809562 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a9fb5-3c80-4284-a64a-a43daf3efc9a None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:15.810177 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a9fb5-3c80-4284-a64a-a43daf3efc9a None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:15.810177 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a9fb5-3c80-4284-a64a-a43daf3efc9a None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:15.811727 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 513/1002] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:15.816746 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccc2a1-e9b3-4a23-ab10-e2c0f1f70ce7 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:15.817014 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccc2a1-e9b3-4a23-ab10-e2c0f1f70ce7 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:15.817672 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccc2a1-e9b3-4a23-ab10-e2c0f1f70ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:15.837040 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-f8ccc2a1-e9b3-4a23-ab10-e2c0f1f70ce7 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:15.838272 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-f8ccc2a1-e9b3-4a23-ab10-e2c0f1f70ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:15.910560 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 490/1003] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:40:15.932749 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a9fb5-3c80-4284-a64a-a43daf3efc9a None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:16.031746 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:16.039496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a9fb5-3c80-4284-a64a-a43daf3efc9a None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:16.072911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ad819-d127-4acb-8664-d334280f5f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:16.073491 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ad819-d127-4acb-8664-d334280f5f3c None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:16.073771 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ad819-d127-4acb-8664-d334280f5f3c None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:16.074077 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ad819-d127-4acb-8664-d334280f5f3c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:16.074706 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ad819-d127-4acb-8664-d334280f5f3c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:16.076104 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ad819-d127-4acb-8664-d334280f5f3c None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:16.085008 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-fe5ad819-d127-4acb-8664-d334280f5f3c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 04:40:16.085008 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:16.085008 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 04:40:16.085008 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 04:40:16.085008 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 04:40:16.085008 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 04:40:16.085008 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 04:40:16.085008 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:40:16.085008 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 04:40:16.085008 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:16.085008 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 04:40:16.085008 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:16.085008 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:16.085008 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:16.085008 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:16.085008 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:16.085008 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:16.086264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:16.086264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:16.086264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:16.086264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:16.086264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:16.086264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:16.086264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 04:40:16.086264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 04:40:16.086264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 04:40:16.086264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 04:40:16.086264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:16.086264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:16.086264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:16.086264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:16.086264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:16.086264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:16.087411 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:16.087411 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:16.087411 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:16.087411 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:16.087411 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:16.087411 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:16.087411 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:16.087411 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:16.087411 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:16.087411 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:16.087411 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 04:40:16.087411 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:40:16.087411 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 26 04:40:16.087411 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:16.090331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 514/1004] 10.222.0.39 () {56 vars in 1126 bytes} [Tue Jul 26 04:40:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:16.092170 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccc2a1-e9b3-4a23-ab10-e2c0f1f70ce7 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:16.153726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:16.191920 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccc2a1-e9b3-4a23-ab10-e2c0f1f70ce7 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:16.225921 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90377067-4cc7-49dd-b727-22fbecc9ec6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:16.226571 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90377067-4cc7-49dd-b727-22fbecc9ec6e None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:16.226850 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90377067-4cc7-49dd-b727-22fbecc9ec6e None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:16.227120 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90377067-4cc7-49dd-b727-22fbecc9ec6e None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:16.227793 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90377067-4cc7-49dd-b727-22fbecc9ec6e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:16.228091 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90377067-4cc7-49dd-b727-22fbecc9ec6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:16.229461 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90377067-4cc7-49dd-b727-22fbecc9ec6e None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:16.235191 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 491/1005] 10.222.0.39 () {56 vars in 1122 bytes} [Tue Jul 26 04:40:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:16.240679 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ad819-d127-4acb-8664-d334280f5f3c None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:16.351687 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ad819-d127-4acb-8664-d334280f5f3c None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:16.385924 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a764d5-606c-49f7-b866-537ef372f7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:16.386628 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a764d5-606c-49f7-b866-537ef372f7ce None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:16.386910 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a764d5-606c-49f7-b866-537ef372f7ce None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:16.387181 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a764d5-606c-49f7-b866-537ef372f7ce None admin] PATH_INFO: `/v3/services` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:16.387907 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a764d5-606c-49f7-b866-537ef372f7ce None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:16.388209 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a764d5-606c-49f7-b866-537ef372f7ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:16.389638 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a764d5-606c-49f7-b866-537ef372f7ce None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:16.394925 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 515/1006] 10.222.0.39 () {56 vars in 1122 bytes} [Tue Jul 26 04:40:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:16.400500 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90377067-4cc7-49dd-b727-22fbecc9ec6e None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:16.501773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90377067-4cc7-49dd-b727-22fbecc9ec6e None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:16.529530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:16.538584 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c5ca1-8929-45fb-b746-3192f7ca5b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:16.539208 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c5ca1-8929-45fb-b746-3192f7ca5b22 None admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:16.539484 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c5ca1-8929-45fb-b746-3192f7ca5b22 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:16.539853 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c5ca1-8929-45fb-b746-3192f7ca5b22 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:16.540576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c5ca1-8929-45fb-b746-3192f7ca5b22 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:16.541956 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c5ca1-8929-45fb-b746-3192f7ca5b22 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:16.559020 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 492/1007] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:40:16 2022] POST /identity/v3/endpoints => generated 325 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:40:16.820612 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c13b5-c8b6-44a5-b4e2-be24754300d9 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:16.821165 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c13b5-c8b6-44a5-b4e2-be24754300d9 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:16.821165 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c13b5-c8b6-44a5-b4e2-be24754300d9 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:16.822534 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 516/1008] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:16.828325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5c9af-7e32-4b6c-9e08-8b48c071a852 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:16.828707 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5c9af-7e32-4b6c-9e08-8b48c071a852 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:16.828878 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e5c9af-7e32-4b6c-9e08-8b48c071a852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:16.848105 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-45e5c9af-7e32-4b6c-9e08-8b48c071a852 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:16.849359 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-45e5c9af-7e32-4b6c-9e08-8b48c071a852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:16.931443 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 493/1009] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:16 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:40:16.954216 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c13b5-c8b6-44a5-b4e2-be24754300d9 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:16.980625 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:17.060720 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c13b5-c8b6-44a5-b4e2-be24754300d9 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:17.096289 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5da96-a219-494c-94ed-502264a839aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:17.096841 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5da96-a219-494c-94ed-502264a839aa None admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:17.097100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5da96-a219-494c-94ed-502264a839aa None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:17.097459 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5da96-a219-494c-94ed-502264a839aa None admin] PATH_INFO: `/v3/services` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:17.098198 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5da96-a219-494c-94ed-502264a839aa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:17.099684 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5da96-a219-494c-94ed-502264a839aa None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:17.122030 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 517/1010] 10.222.0.39 () {60 vars in 1141 bytes} [Tue Jul 26 04:40:16 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:40:17.208250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2a911-c1aa-4f9e-9d02-5ad911a1f8e1 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:17.208780 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2a911-c1aa-4f9e-9d02-5ad911a1f8e1 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:17.208780 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2a911-c1aa-4f9e-9d02-5ad911a1f8e1 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:17.210322 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 494/1011] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:17.216119 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81a5dd-47a8-42b9-b708-b3017531e653 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:17.216440 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81a5dd-47a8-42b9-b708-b3017531e653 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:17.216644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81a5dd-47a8-42b9-b708-b3017531e653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:17.236140 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-ee81a5dd-47a8-42b9-b708-b3017531e653 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:17.237369 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-ee81a5dd-47a8-42b9-b708-b3017531e653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:17.322220 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 518/1012] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:17 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:40:17.344877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2a911-c1aa-4f9e-9d02-5ad911a1f8e1 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:17.452675 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2a911-c1aa-4f9e-9d02-5ad911a1f8e1 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:17.467277 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:17.494422 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d0694-8ea4-4eb5-93cf-540311ceb6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:17.495095 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d0694-8ea4-4eb5-93cf-540311ceb6fd None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:17.495445 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d0694-8ea4-4eb5-93cf-540311ceb6fd None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:17.495724 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d0694-8ea4-4eb5-93cf-540311ceb6fd None admin] PATH_INFO: `/v3/services/compute` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:17.496354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d0694-8ea4-4eb5-93cf-540311ceb6fd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:17.497780 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d0694-8ea4-4eb5-93cf-540311ceb6fd None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:17.506968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-f09d0694-8ea4-4eb5-93cf-540311ceb6fd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 04:40:17.506968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:17.506968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 04:40:17.506968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 04:40:17.506968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 04:40:17.506968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 04:40:17.506968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 04:40:17.506968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:40:17.506968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 04:40:17.506968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:17.506968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 04:40:17.506968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:17.506968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:17.506968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:17.506968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:17.506968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:17.506968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:17.508050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:17.508050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:17.508050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:17.508050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:17.508050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:17.508050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:17.508050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 04:40:17.508050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 04:40:17.508050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 04:40:17.508050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 04:40:17.508050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:17.508050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:17.508050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:17.508050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:17.508050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:17.508050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:17.508900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:17.508900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:17.508900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:17.508900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:17.508900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:17.508900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:17.508900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:17.508900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:17.508900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:17.508900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:17.508900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 04:40:17.508900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:40:17.508900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 26 04:40:17.508900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:17.510360 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 495/1013] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:40:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:17.514582 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81a5dd-47a8-42b9-b708-b3017531e653 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:17.526471 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:17.621747 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81a5dd-47a8-42b9-b708-b3017531e653 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:17.656510 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5547c-bf50-441c-a857-977b508387b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:17.657141 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5547c-bf50-441c-a857-977b508387b5 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:17.657416 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5547c-bf50-441c-a857-977b508387b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:17.657684 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5547c-bf50-441c-a857-977b508387b5 None admin] PATH_INFO: `/v3/services` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:17.658397 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5547c-bf50-441c-a857-977b508387b5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:17.658699 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5547c-bf50-441c-a857-977b508387b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:17.660104 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5547c-bf50-441c-a857-977b508387b5 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:17.665559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 519/1014] 10.222.0.39 () {56 vars in 1112 bytes} [Tue Jul 26 04:40:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:17.671678 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d0694-8ea4-4eb5-93cf-540311ceb6fd None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:17.780454 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d0694-8ea4-4eb5-93cf-540311ceb6fd None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:17.815608 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c63cb3-f166-4193-b600-74459a9bde0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:17.816221 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c63cb3-f166-4193-b600-74459a9bde0d None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:17.816500 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c63cb3-f166-4193-b600-74459a9bde0d None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:17.816770 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c63cb3-f166-4193-b600-74459a9bde0d None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:17.817800 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c63cb3-f166-4193-b600-74459a9bde0d None admin] RBAC: Adding query filter params (type=compute) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:17.818146 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c63cb3-f166-4193-b600-74459a9bde0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:17.819656 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c63cb3-f166-4193-b600-74459a9bde0d None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:17.824977 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 496/1015] 10.222.0.39 () {56 vars in 1112 bytes} [Tue Jul 26 04:40:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:17.831172 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5547c-bf50-441c-a857-977b508387b5 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:17.909067 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:17.936428 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5547c-bf50-441c-a857-977b508387b5 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:17.971265 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e7c032-6ae1-4d78-b860-c207eb1ea604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:17.971889 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7c032-6ae1-4d78-b860-c207eb1ea604 None admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:17.972162 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7c032-6ae1-4d78-b860-c207eb1ea604 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:17.972431 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e7c032-6ae1-4d78-b860-c207eb1ea604 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:17.973136 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7c032-6ae1-4d78-b860-c207eb1ea604 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:17.974565 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e7c032-6ae1-4d78-b860-c207eb1ea604 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:17.995628 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 520/1016] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:40:17 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:40:18.565169 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f281c84-e7ea-4217-a766-c274f7cd9f69 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:18.565689 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f281c84-e7ea-4217-a766-c274f7cd9f69 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:18.565689 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f281c84-e7ea-4217-a766-c274f7cd9f69 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:18.567344 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 497/1017] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:18.573020 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65b032-95c0-48be-bc2c-63dc3934da62 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:18.573279 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65b032-95c0-48be-bc2c-63dc3934da62 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:18.573713 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65b032-95c0-48be-bc2c-63dc3934da62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:18.595076 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-1d65b032-95c0-48be-bc2c-63dc3934da62 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:18.596275 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-1d65b032-95c0-48be-bc2c-63dc3934da62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:18.677110 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 521/1018] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:40:18.699952 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f281c84-e7ea-4217-a766-c274f7cd9f69 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:18.747570 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:18.807221 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f281c84-e7ea-4217-a766-c274f7cd9f69 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:18.845522 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539493a-086f-47f4-9e82-66dee29ce6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:18.846119 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539493a-086f-47f4-9e82-66dee29ce6dd None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:18.846394 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539493a-086f-47f4-9e82-66dee29ce6dd None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:18.846659 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539493a-086f-47f4-9e82-66dee29ce6dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:18.847822 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0539493a-086f-47f4-9e82-66dee29ce6dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:18.849363 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0539493a-086f-47f4-9e82-66dee29ce6dd None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:18.855936 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 498/1019] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:40:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:18.857048 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65b032-95c0-48be-bc2c-63dc3934da62 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:18.916622 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:18.964367 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65b032-95c0-48be-bc2c-63dc3934da62 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:18.999849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bed3bc-1053-4eaf-b3c0-c54981ae70ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:19.000480 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bed3bc-1053-4eaf-b3c0-c54981ae70ec None admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:19.000755 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bed3bc-1053-4eaf-b3c0-c54981ae70ec None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:19.001025 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bed3bc-1053-4eaf-b3c0-c54981ae70ec None admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:19.001718 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bed3bc-1053-4eaf-b3c0-c54981ae70ec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:19.003215 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bed3bc-1053-4eaf-b3c0-c54981ae70ec None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:19.038021 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 522/1020] 10.222.0.39 () {60 vars in 1141 bytes} [Tue Jul 26 04:40:18 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:40:19.147515 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac4fe9-0c87-458d-98a9-671e88cfb492 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:19.147709 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac4fe9-0c87-458d-98a9-671e88cfb492 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:19.147969 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac4fe9-0c87-458d-98a9-671e88cfb492 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:19.149377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 499/1021] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:19.155623 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b28f7c-7e9b-4ac6-b554-4c361d3aeb1c None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:19.155914 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b28f7c-7e9b-4ac6-b554-4c361d3aeb1c None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:19.156194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b28f7c-7e9b-4ac6-b554-4c361d3aeb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:19.175964 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-38b28f7c-7e9b-4ac6-b554-4c361d3aeb1c None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:19.177226 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-38b28f7c-7e9b-4ac6-b554-4c361d3aeb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:19.250025 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 523/1022] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:40:19.273822 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac4fe9-0c87-458d-98a9-671e88cfb492 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:19.386611 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac4fe9-0c87-458d-98a9-671e88cfb492 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:19.399108 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:19.431323 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb6283-173d-492f-813e-97d43bbad38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:19.432262 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb6283-173d-492f-813e-97d43bbad38b None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:19.432684 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb6283-173d-492f-813e-97d43bbad38b None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:19.433093 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb6283-173d-492f-813e-97d43bbad38b None admin] PATH_INFO: `/v3/services/image` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:19.433872 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb6283-173d-492f-813e-97d43bbad38b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:19.435411 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb6283-173d-492f-813e-97d43bbad38b None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:19.445617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-c1bb6283-173d-492f-813e-97d43bbad38b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 04:40:19.445617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:19.445617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 04:40:19.445617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 04:40:19.445617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 04:40:19.445617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 04:40:19.445617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 04:40:19.445617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:40:19.445617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 04:40:19.445617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:19.445617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 04:40:19.445617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:19.445617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:19.445617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:19.445617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:19.445617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:19.445617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:19.446777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:19.446777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:19.446777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:19.446777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:19.446777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:19.446777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:19.446777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 04:40:19.446777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 04:40:19.446777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 04:40:19.446777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 04:40:19.446777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:19.446777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:19.446777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:19.446777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:19.446777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:19.446777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:19.447640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:19.447640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:19.447640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:19.447640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:19.447640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:19.447640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:19.447640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:19.447640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:19.447640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:19.447640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:19.447640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 04:40:19.447640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:40:19.447640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 04:40:19.447640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:19.448809 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 500/1023] 10.222.0.39 () {56 vars in 1105 bytes} [Tue Jul 26 04:40:19 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:19.454671 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b28f7c-7e9b-4ac6-b554-4c361d3aeb1c None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:19.502838 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:19.576663 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b28f7c-7e9b-4ac6-b554-4c361d3aeb1c None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:19.615722 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbb9ee-62ee-442c-bf34-927f676736b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:19.616359 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbb9ee-62ee-442c-bf34-927f676736b4 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:19.616644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbb9ee-62ee-442c-bf34-927f676736b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:19.616922 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbb9ee-62ee-442c-bf34-927f676736b4 None admin] PATH_INFO: `/v3/services` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:19.617626 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbb9ee-62ee-442c-bf34-927f676736b4 None admin] RBAC: Adding query filter params (name=image) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:19.617923 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbb9ee-62ee-442c-bf34-927f676736b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:19.619368 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbb9ee-62ee-442c-bf34-927f676736b4 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:19.624981 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 524/1024] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:40:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:19.630873 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb6283-173d-492f-813e-97d43bbad38b None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:19.742775 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb6283-173d-492f-813e-97d43bbad38b None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:19.778880 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070ba79-bb11-4cdd-8c64-c37988f1d2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:19.779504 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070ba79-bb11-4cdd-8c64-c37988f1d2a0 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:19.779796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070ba79-bb11-4cdd-8c64-c37988f1d2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:19.780059 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070ba79-bb11-4cdd-8c64-c37988f1d2a0 None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:19.780743 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070ba79-bb11-4cdd-8c64-c37988f1d2a0 None admin] RBAC: Adding query filter params (type=image) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:19.781042 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070ba79-bb11-4cdd-8c64-c37988f1d2a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:19.782464 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070ba79-bb11-4cdd-8c64-c37988f1d2a0 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:19.787904 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 501/1025] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:40:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:19.794016 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbb9ee-62ee-442c-bf34-927f676736b4 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:19.896506 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbb9ee-62ee-442c-bf34-927f676736b4 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:19.898094 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:19.931744 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c69a35-b43b-4ccc-be2b-15d15bc17e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:19.932378 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c69a35-b43b-4ccc-be2b-15d15bc17e91 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:19.932654 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c69a35-b43b-4ccc-be2b-15d15bc17e91 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:19.932928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c69a35-b43b-4ccc-be2b-15d15bc17e91 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:19.933686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c69a35-b43b-4ccc-be2b-15d15bc17e91 None admin] RBAC: Adding query filter params (interface=public, service_id=560256fccaf44ffdb0d642400daefd57, region_id=RegionOne) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:19.934002 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c69a35-b43b-4ccc-be2b-15d15bc17e91 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:19.935415 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c69a35-b43b-4ccc-be2b-15d15bc17e91 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:19.940912 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 525/1026] 10.222.0.39 () {56 vars in 1251 bytes} [Tue Jul 26 04:40:19 2022] GET /identity/v3/endpoints?service_id=560256fccaf44ffdb0d642400daefd57&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:19.946968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070ba79-bb11-4cdd-8c64-c37988f1d2a0 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:19.989543 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:20.056210 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070ba79-bb11-4cdd-8c64-c37988f1d2a0 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:20.082373 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7246c-be06-4047-9e7f-3a1b04ce956b None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:20.082695 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7246c-be06-4047-9e7f-3a1b04ce956b None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:20.082919 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7246c-be06-4047-9e7f-3a1b04ce956b None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:20.084312 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 526/1027] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:20.089546 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76defdd-9505-461e-93cb-df3afc14e70d None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:20.090086 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76defdd-9505-461e-93cb-df3afc14e70d None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:20.090367 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76defdd-9505-461e-93cb-df3afc14e70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:20.102693 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6b718-e294-42b9-9250-20a589f1aca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:20.103611 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6b718-e294-42b9-9250-20a589f1aca3 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:20.104067 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6b718-e294-42b9-9250-20a589f1aca3 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:20.104515 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6b718-e294-42b9-9250-20a589f1aca3 None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:20.105370 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6b718-e294-42b9-9250-20a589f1aca3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:20.106961 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6b718-e294-42b9-9250-20a589f1aca3 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:20.115073 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 502/1028] 10.222.0.39 () {56 vars in 1087 bytes} [Tue Jul 26 04:40:19 2022] GET /identity/v3/services => generated 1957 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:40:20.116716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-c76defdd-9505-461e-93cb-df3afc14e70d None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:20.117939 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-c76defdd-9505-461e-93cb-df3afc14e70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:20.199287 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 527/1029] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:40:20.222750 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6b718-e294-42b9-9250-20a589f1aca3 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:20.346945 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6b718-e294-42b9-9250-20a589f1aca3 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:20.348755 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:20.384483 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9184d7-2d1b-4d24-b3dd-1abef4a90170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:20.385142 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9184d7-2d1b-4d24-b3dd-1abef4a90170 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:20.385417 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9184d7-2d1b-4d24-b3dd-1abef4a90170 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:20.385685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9184d7-2d1b-4d24-b3dd-1abef4a90170 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:20.397009 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9184d7-2d1b-4d24-b3dd-1abef4a90170 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:40:20.402079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-2e9184d7-2d1b-4d24-b3dd-1abef4a90170 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 04:40:20.402079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:20.402079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:20.402079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:20.402079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:20.402079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:20.402079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:20.402079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:20.402079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:20.402079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:20.402079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:20.402079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:20.402079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:40:20.402079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:40:20.402079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:40:20.402079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:40:20.403056 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:40:20.403056 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:40:20.403056 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:40:20.403056 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:40:20.403056 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:20.403056 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:20.403056 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:20.403056 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:20.403056 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:20.403056 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:20.403056 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:20.403056 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:20.403056 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:20.403056 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:20.403056 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:20.403056 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:20.403951 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:20.403951 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:20.403951 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:20.403951 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:20.403951 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:40:20.403951 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:40:20.403951 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:40:20.403951 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:40:20.403951 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:40:20.403951 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:40:20.403951 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 04:40:20.403951 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:20.403951 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 503/1030] 10.222.0.39 () {56 vars in 1120 bytes} [Tue Jul 26 04:40:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:20.411383 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76defdd-9505-461e-93cb-df3afc14e70d None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:20.510451 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:20.519269 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76defdd-9505-461e-93cb-df3afc14e70d None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:20.554485 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897cd1b7-4147-4e08-8038-09645761bb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:20.555112 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cd1b7-4147-4e08-8038-09645761bb68 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:20.555389 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cd1b7-4147-4e08-8038-09645761bb68 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:20.555660 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897cd1b7-4147-4e08-8038-09645761bb68 None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:20.556386 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897cd1b7-4147-4e08-8038-09645761bb68 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:20.556685 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897cd1b7-4147-4e08-8038-09645761bb68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:20.558105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897cd1b7-4147-4e08-8038-09645761bb68 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:20.567230 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 528/1031] 10.222.0.39 () {56 vars in 1115 bytes} [Tue Jul 26 04:40:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:20.572843 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9184d7-2d1b-4d24-b3dd-1abef4a90170 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:20.686381 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9184d7-2d1b-4d24-b3dd-1abef4a90170 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:20.723426 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3375b28-75ee-4aaf-b3aa-b4989d6eca60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:20.724085 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3375b28-75ee-4aaf-b3aa-b4989d6eca60 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:20.724421 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3375b28-75ee-4aaf-b3aa-b4989d6eca60 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:20.724694 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3375b28-75ee-4aaf-b3aa-b4989d6eca60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:20.736326 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3375b28-75ee-4aaf-b3aa-b4989d6eca60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:20.737796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3375b28-75ee-4aaf-b3aa-b4989d6eca60 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:20.753310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-a3375b28-75ee-4aaf-b3aa-b4989d6eca60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:40:20.753310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:20.753310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:20.753310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:20.753310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:20.753310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:20.753310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:20.753310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:20.753310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:20.753310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:20.753310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:20.753310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:20.753310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:40:20.753310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:40:20.753310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:40:20.754537 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:40:20.754537 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:20.754537 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:20.754537 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:20.754537 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:20.754537 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:20.754537 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:20.754537 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:20.754537 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:20.754537 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:20.754537 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:20.754537 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:20.754537 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:20.754537 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:20.754537 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:20.754537 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:20.754537 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:20.760255 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:40:20.760255 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:40:20.760255 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:40:20.760255 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:20.760255 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 504/1032] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:20.760540 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897cd1b7-4147-4e08-8038-09645761bb68 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:20.865484 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897cd1b7-4147-4e08-8038-09645761bb68 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:20.900595 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06add200-a538-4b70-9608-dff79d57eb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:20.901253 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06add200-a538-4b70-9608-dff79d57eb6a None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:20.901489 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06add200-a538-4b70-9608-dff79d57eb6a None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:20.901769 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06add200-a538-4b70-9608-dff79d57eb6a None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:20.902531 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06add200-a538-4b70-9608-dff79d57eb6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:20.902839 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06add200-a538-4b70-9608-dff79d57eb6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:20.904239 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06add200-a538-4b70-9608-dff79d57eb6a None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:20.917006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 529/1033] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:40:20.922656 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3375b28-75ee-4aaf-b3aa-b4989d6eca60 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:20.939668 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:21.028226 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3375b28-75ee-4aaf-b3aa-b4989d6eca60 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:21.063052 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2aef7f-ede8-4289-87c7-c1eaa174f30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:21.063701 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2aef7f-ede8-4289-87c7-c1eaa174f30e None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:21.063979 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2aef7f-ede8-4289-87c7-c1eaa174f30e None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:21.064251 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2aef7f-ede8-4289-87c7-c1eaa174f30e None admin] PATH_INFO: `/v3/users/nova` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:21.072647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2aef7f-ede8-4289-87c7-c1eaa174f30e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:21.074140 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2aef7f-ede8-4289-87c7-c1eaa174f30e None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:21.085781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-4f2aef7f-ede8-4289-87c7-c1eaa174f30e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 04:40:21.085781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:21.085781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:21.085781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:21.085781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:21.085781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:21.085781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:21.085781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:21.085781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:21.085781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:21.085781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:21.085781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:21.085781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:40:21.085781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:40:21.085781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:40:21.085781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:40:21.086929 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:21.086929 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:21.086929 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:40:21.086929 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:40:21.086929 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:40:21.086929 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:40:21.086929 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:21.086929 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:21.086929 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:21.086929 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:21.086929 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:21.086929 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:21.086929 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:21.086929 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:21.086929 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:21.086929 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:21.086929 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:21.086929 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:21.087898 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:21.087898 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:21.087898 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:40:21.087898 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:40:21.087898 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:40:21.087898 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:40:21.087898 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:40:21.087898 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:40:21.087898 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 04:40:21.087898 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:21.090398 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 505/1034] 10.222.0.39 () {56 vars in 1093 bytes} [Tue Jul 26 04:40:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:21.092870 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06add200-a538-4b70-9608-dff79d57eb6a None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:21.113112 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:21.130342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9075b-c782-42de-87c1-17d1297ec36f None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:21.130666 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9075b-c782-42de-87c1-17d1297ec36f None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:21.130897 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9075b-c782-42de-87c1-17d1297ec36f None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:21.132416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 506/1035] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:40:21.137480 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e944ba4-28d7-46b2-90e8-126b29b884fa None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:21.137766 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e944ba4-28d7-46b2-90e8-126b29b884fa None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:21.138063 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e944ba4-28d7-46b2-90e8-126b29b884fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:21.156923 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-4e944ba4-28d7-46b2-90e8-126b29b884fa None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:21.158162 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-4e944ba4-28d7-46b2-90e8-126b29b884fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:21.200446 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06add200-a538-4b70-9608-dff79d57eb6a None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:21.233595 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 507/1036] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 04:40:21.244730 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ce59a-4aba-420d-b77a-eb1236426ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:21.245383 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ce59a-4aba-420d-b77a-eb1236426ee2 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:21.245659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ce59a-4aba-420d-b77a-eb1236426ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:21.245940 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ce59a-4aba-420d-b77a-eb1236426ee2 None admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:21.246827 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ce59a-4aba-420d-b77a-eb1236426ee2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:21.247141 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ce59a-4aba-420d-b77a-eb1236426ee2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:21.248665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ce59a-4aba-420d-b77a-eb1236426ee2 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:21.257746 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e944ba4-28d7-46b2-90e8-126b29b884fa None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:21.261633 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:21.268838 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 530/1037] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Jul 26 04:40:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:21.278039 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ce59a-4aba-420d-b77a-eb1236426ee2 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:21.359732 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:21.377487 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e944ba4-28d7-46b2-90e8-126b29b884fa None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:21.384057 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ce59a-4aba-420d-b77a-eb1236426ee2 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:21.413204 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec454e54-2c2a-4dff-b3c2-b66f85c5451d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:21.413856 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec454e54-2c2a-4dff-b3c2-b66f85c5451d None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:21.414164 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec454e54-2c2a-4dff-b3c2-b66f85c5451d None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:21.414437 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec454e54-2c2a-4dff-b3c2-b66f85c5451d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:21.415598 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec454e54-2c2a-4dff-b3c2-b66f85c5451d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:21.417064 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec454e54-2c2a-4dff-b3c2-b66f85c5451d None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:21.418909 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 508/1038] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:40:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:40:21.422732 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bff69-6c4d-48a5-b2b0-e6b96c284a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:21.423379 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bff69-6c4d-48a5-b2b0-e6b96c284a7b None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:21.423876 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bff69-6c4d-48a5-b2b0-e6b96c284a7b None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:21.423981 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bff69-6c4d-48a5-b2b0-e6b96c284a7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:21.424715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec454e54-2c2a-4dff-b3c2-b66f85c5451d None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:21.502310 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3bff69-6c4d-48a5-b2b0-e6b96c284a7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:21.503810 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3bff69-6c4d-48a5-b2b0-e6b96c284a7b None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:21.508501 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:21.539517 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec454e54-2c2a-4dff-b3c2-b66f85c5451d None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:21.576971 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32869d3c-0e2d-4574-aadd-492233e7b362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:21.577578 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32869d3c-0e2d-4574-aadd-492233e7b362 None admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:21.577859 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32869d3c-0e2d-4574-aadd-492233e7b362 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:21.578161 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32869d3c-0e2d-4574-aadd-492233e7b362 None admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:21.578904 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32869d3c-0e2d-4574-aadd-492233e7b362 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:21.580345 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32869d3c-0e2d-4574-aadd-492233e7b362 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:21.585290 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:21.606812 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 509/1039] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 04:40:21 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:40:21.628156 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 531/1040] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:40:21 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 04:40:21.634374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32869d3c-0e2d-4574-aadd-492233e7b362 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:21.749957 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32869d3c-0e2d-4574-aadd-492233e7b362 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:21.788258 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:21.798973 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054c0a2-2986-4f99-87a1-dc8cb89af791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:21.799637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054c0a2-2986-4f99-87a1-dc8cb89af791 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:21.799916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054c0a2-2986-4f99-87a1-dc8cb89af791 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:21.800187 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c054c0a2-2986-4f99-87a1-dc8cb89af791 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:21.812665 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c054c0a2-2986-4f99-87a1-dc8cb89af791 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:21.814257 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c054c0a2-2986-4f99-87a1-dc8cb89af791 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:21.832851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-c054c0a2-2986-4f99-87a1-dc8cb89af791 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:40:21.832851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:21.832851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:21.832851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:21.832851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:21.832851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:21.832851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:21.832851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:21.832851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:21.832851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:21.832851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:21.832851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:21.832851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:40:21.832851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:40:21.832851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:40:21.833863 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:40:21.833863 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:21.833863 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:21.833863 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:21.833863 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:21.833863 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:21.833863 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:21.833863 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:21.833863 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:21.833863 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:21.833863 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:21.833863 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:21.833863 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:21.833863 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:21.833863 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:21.833863 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:21.833863 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:21.834860 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:40:21.834860 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:40:21.834860 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:40:21.834860 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:21.834860 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 510/1041] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:40:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:21.840523 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bff69-6c4d-48a5-b2b0-e6b96c284a7b None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:21.952105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bff69-6c4d-48a5-b2b0-e6b96c284a7b None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:21.987342 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a3042-8f59-4866-bd42-35810c9e50d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:21.987984 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a3042-8f59-4866-bd42-35810c9e50d6 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:21.988276 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a3042-8f59-4866-bd42-35810c9e50d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:21.988533 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a3042-8f59-4866-bd42-35810c9e50d6 None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:21.989236 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a3042-8f59-4866-bd42-35810c9e50d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:21.989540 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a3042-8f59-4866-bd42-35810c9e50d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:21.990965 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a3042-8f59-4866-bd42-35810c9e50d6 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:22.003886 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 532/1042] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:22.009843 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054c0a2-2986-4f99-87a1-dc8cb89af791 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:22.116174 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c054c0a2-2986-4f99-87a1-dc8cb89af791 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:22.141309 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94316ee-3149-4cb9-9c6a-6722fe9b11f8 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:22.141614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94316ee-3149-4cb9-9c6a-6722fe9b11f8 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:22.141854 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94316ee-3149-4cb9-9c6a-6722fe9b11f8 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:22.143273 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 533/1043] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:40:22.148704 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c0550-8d15-40b3-9a11-87a18d87cab5 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:22.149071 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c0550-8d15-40b3-9a11-87a18d87cab5 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:22.149414 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c0550-8d15-40b3-9a11-87a18d87cab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:22.161438 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc11952-cf6a-4375-a4f0-38f99ab922ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:22.162124 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc11952-cf6a-4375-a4f0-38f99ab922ce None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:22.162441 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc11952-cf6a-4375-a4f0-38f99ab922ce None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:22.162718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc11952-cf6a-4375-a4f0-38f99ab922ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:22.171834 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc11952-cf6a-4375-a4f0-38f99ab922ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:22.173472 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc11952-cf6a-4375-a4f0-38f99ab922ce None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:22.174383 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-744c0550-8d15-40b3-9a11-87a18d87cab5 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:22.175621 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-744c0550-8d15-40b3-9a11-87a18d87cab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:22.186026 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-dfc11952-cf6a-4375-a4f0-38f99ab922ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:40:22.186026 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:22.186026 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:22.186026 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:22.186026 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:22.186026 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:22.186026 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:22.186026 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:22.186026 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:22.186026 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:22.186026 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:22.186026 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:22.186026 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:40:22.186026 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:40:22.186026 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:40:22.187062 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:40:22.187062 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:22.187062 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:22.187062 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:22.187062 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:22.187062 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:22.187062 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:22.187062 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:22.187062 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:22.187062 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:22.187062 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:22.187062 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:22.187062 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:22.187062 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:22.187062 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:22.187062 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:22.187062 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:22.188080 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:40:22.188080 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:40:22.188080 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:40:22.188080 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:40:22.188080 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:40:22.188080 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:40:22.188080 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:40:22.188080 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:22.188080 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 511/1044] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:40:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:22.193679 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc11952-cf6a-4375-a4f0-38f99ab922ce None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:22.219522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:22.248061 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:22.272614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 534/1045] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 04:40:22.295685 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c0550-8d15-40b3-9a11-87a18d87cab5 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:22.325598 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc11952-cf6a-4375-a4f0-38f99ab922ce None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:22.363953 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f1086-ca1c-4db9-9c0e-7890bd4f5bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:22.364581 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f1086-ca1c-4db9-9c0e-7890bd4f5bbc None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:22.364860 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f1086-ca1c-4db9-9c0e-7890bd4f5bbc None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:22.365128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f1086-ca1c-4db9-9c0e-7890bd4f5bbc None admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:22.365884 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f1086-ca1c-4db9-9c0e-7890bd4f5bbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:22.366287 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f1086-ca1c-4db9-9c0e-7890bd4f5bbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:22.367701 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f1086-ca1c-4db9-9c0e-7890bd4f5bbc None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:22.381158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 512/1046] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:40:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:40:22.386940 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f1086-ca1c-4db9-9c0e-7890bd4f5bbc None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:22.412871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c0550-8d15-40b3-9a11-87a18d87cab5 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:22.450590 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1db67d-963d-45cd-bc9f-05654d03d624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:22.451237 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1db67d-963d-45cd-bc9f-05654d03d624 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:22.451567 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1db67d-963d-45cd-bc9f-05654d03d624 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:22.451838 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1db67d-963d-45cd-bc9f-05654d03d624 None admin] PATH_INFO: `/v3/services/image` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:22.452478 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1db67d-963d-45cd-bc9f-05654d03d624 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:22.453866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1db67d-963d-45cd-bc9f-05654d03d624 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:22.463791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-aa1db67d-963d-45cd-bc9f-05654d03d624 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 04:40:22.463791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:22.463791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 04:40:22.463791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 04:40:22.463791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 04:40:22.463791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 04:40:22.463791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 04:40:22.463791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:40:22.463791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 04:40:22.463791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:22.463791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 04:40:22.463791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:22.463791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:22.463791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:22.463791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:22.463791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:22.463791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:22.464920 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:22.464920 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:22.464920 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:22.464920 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:22.464920 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:22.464920 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:22.464920 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 04:40:22.464920 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 04:40:22.464920 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 04:40:22.464920 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 04:40:22.464920 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:22.464920 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:22.464920 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:22.464920 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:22.464920 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:22.464920 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:22.465766 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:22.465766 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:22.465766 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:22.465766 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:22.465766 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:22.465766 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:22.465766 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:22.465766 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:22.465766 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:22.465766 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:22.465766 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 04:40:22.465766 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:40:22.465766 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 26 04:40:22.465766 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:22.470279 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 535/1047] 10.222.0.39 () {56 vars in 1105 bytes} [Tue Jul 26 04:40:22 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:40:22.471559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1db67d-963d-45cd-bc9f-05654d03d624 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:22.496791 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:22.502392 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f1086-ca1c-4db9-9c0e-7890bd4f5bbc None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:22.507347 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:22.541574 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b366920-3666-4a17-8262-e17d136e90cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:22.542405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b366920-3666-4a17-8262-e17d136e90cc None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:22.542686 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b366920-3666-4a17-8262-e17d136e90cc None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:22.542960 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b366920-3666-4a17-8262-e17d136e90cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:22.543745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b366920-3666-4a17-8262-e17d136e90cc None admin] RBAC: Adding query filter params (role.id=b3d30de53787435faa1f35bb788dcefd, scope.project.id=c4d7c29a2b144df6afa96fd6894254a4, user.id=ae8593e125da4b208dd100608aa2b462) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:22.544049 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b366920-3666-4a17-8262-e17d136e90cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:22.545530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b366920-3666-4a17-8262-e17d136e90cc None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:22.562020 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 513/1048] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:40:22 2022] GET /identity/v3/role_assignments?user.id=ae8593e125da4b208dd100608aa2b462&scope.project.id=c4d7c29a2b144df6afa96fd6894254a4&role.id=b3d30de53787435faa1f35bb788dcefd => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:40:22.594654 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1db67d-963d-45cd-bc9f-05654d03d624 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:22.634267 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fe2b0-04d3-4397-b29e-342e62bc9cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:22.634798 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fe2b0-04d3-4397-b29e-342e62bc9cf4 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:22.635078 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fe2b0-04d3-4397-b29e-342e62bc9cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:22.635353 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803fe2b0-04d3-4397-b29e-342e62bc9cf4 None admin] PATH_INFO: `/v3/services` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:22.636056 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803fe2b0-04d3-4397-b29e-342e62bc9cf4 None admin] RBAC: Adding query filter params (name=image) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:22.636363 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803fe2b0-04d3-4397-b29e-342e62bc9cf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:22.637800 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803fe2b0-04d3-4397-b29e-342e62bc9cf4 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:22.648618 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 536/1049] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:40:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:22.650521 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b366920-3666-4a17-8262-e17d136e90cc None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:22.763861 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b366920-3666-4a17-8262-e17d136e90cc None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:22.800376 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce018f7d-c954-4d97-9cfd-b9000510fe51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:22.801030 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce018f7d-c954-4d97-9cfd-b9000510fe51 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:22.801310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce018f7d-c954-4d97-9cfd-b9000510fe51 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:22.801583 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce018f7d-c954-4d97-9cfd-b9000510fe51 None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:22.802323 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce018f7d-c954-4d97-9cfd-b9000510fe51 None admin] RBAC: Adding query filter params (type=image) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:22.802638 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce018f7d-c954-4d97-9cfd-b9000510fe51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:22.804055 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce018f7d-c954-4d97-9cfd-b9000510fe51 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:22.810038 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 514/1050] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:40:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:22.816459 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fe2b0-04d3-4397-b29e-342e62bc9cf4 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:22.914599 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:22.923129 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803fe2b0-04d3-4397-b29e-342e62bc9cf4 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:22.958651 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2eaca-4e00-415d-83d9-73d6f9f1599a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:22.959316 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2eaca-4e00-415d-83d9-73d6f9f1599a None admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:22.959546 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2eaca-4e00-415d-83d9-73d6f9f1599a None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:22.959778 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2eaca-4e00-415d-83d9-73d6f9f1599a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:22.960529 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2eaca-4e00-415d-83d9-73d6f9f1599a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:22.961905 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2eaca-4e00-415d-83d9-73d6f9f1599a None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:22.983440 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 537/1051] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:40:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:40:23.687758 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da3aed-6217-4f72-87da-26891a3a19dc None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:23.687953 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da3aed-6217-4f72-87da-26891a3a19dc None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:23.688268 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da3aed-6217-4f72-87da-26891a3a19dc None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:23.689569 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 515/1052] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:23.695625 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38000f9c-94de-47c6-8d50-7fb9d418916b None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:23.695898 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38000f9c-94de-47c6-8d50-7fb9d418916b None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:23.696199 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38000f9c-94de-47c6-8d50-7fb9d418916b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:23.714769 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-38000f9c-94de-47c6-8d50-7fb9d418916b None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:23.715960 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-38000f9c-94de-47c6-8d50-7fb9d418916b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:23.794706 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 538/1053] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:40:23.817918 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da3aed-6217-4f72-87da-26891a3a19dc None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:23.849521 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:23.940188 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da3aed-6217-4f72-87da-26891a3a19dc None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:23.974193 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023a98a-858f-4a8e-a6c3-d395b488b1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:23.974838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023a98a-858f-4a8e-a6c3-d395b488b1b3 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:23.975115 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023a98a-858f-4a8e-a6c3-d395b488b1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:23.975382 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023a98a-858f-4a8e-a6c3-d395b488b1b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:23.995618 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023a98a-858f-4a8e-a6c3-d395b488b1b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:40:24.000918 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-e023a98a-858f-4a8e-a6c3-d395b488b1b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:40:24.000918 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:24.000918 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:24.000918 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:24.000918 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:24.000918 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:24.000918 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:24.000918 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:24.000918 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:24.000918 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:24.000918 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:24.000918 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:24.000918 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:40:24.000918 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:40:24.000918 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:40:24.000918 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:40:24.001847 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:40:24.001847 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:40:24.001847 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:40:24.001847 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:40:24.001847 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:24.001847 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:24.001847 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:24.001847 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:24.001847 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:24.001847 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:24.001847 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:24.001847 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:24.001847 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:24.001847 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:24.001847 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:24.001847 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:24.008114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:24.008114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:24.008114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:24.008114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:24.008114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:40:24.008114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:40:24.008114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:40:24.008114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:40:24.008114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:40:24.008114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:40:24.008114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:40:24.008114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:24.008114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 516/1054] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:40:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:24.008839 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38000f9c-94de-47c6-8d50-7fb9d418916b None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:24.086489 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:24.114860 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38000f9c-94de-47c6-8d50-7fb9d418916b None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:24.149644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987445ce-5c2f-48f2-a0d9-d26d8bacf3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:24.150306 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987445ce-5c2f-48f2-a0d9-d26d8bacf3dc None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:24.150582 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987445ce-5c2f-48f2-a0d9-d26d8bacf3dc None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:24.150848 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987445ce-5c2f-48f2-a0d9-d26d8bacf3dc None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:24.151565 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987445ce-5c2f-48f2-a0d9-d26d8bacf3dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:24.151866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987445ce-5c2f-48f2-a0d9-d26d8bacf3dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:24.153260 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987445ce-5c2f-48f2-a0d9-d26d8bacf3dc None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:24.166112 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 539/1055] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:40:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:40:24.168075 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023a98a-858f-4a8e-a6c3-d395b488b1b3 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:24.259945 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:24.276884 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023a98a-858f-4a8e-a6c3-d395b488b1b3 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:24.318034 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc388e8-fb82-46cf-805d-a86d6a6cf9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:24.318690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc388e8-fb82-46cf-805d-a86d6a6cf9d4 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:24.318965 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc388e8-fb82-46cf-805d-a86d6a6cf9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:24.319232 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc388e8-fb82-46cf-805d-a86d6a6cf9d4 None admin] PATH_INFO: `/v3/users/71e80d8a85844b88b0651b8df0362a48` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:24.333872 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc388e8-fb82-46cf-805d-a86d6a6cf9d4 None admin] RBAC: Authorizing `identity:get_user(user_id=71e80d8a85844b88b0651b8df0362a48)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:24.335383 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc388e8-fb82-46cf-805d-a86d6a6cf9d4 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:24.337258 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 517/1056] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:40:24 2022] GET /identity/v3/users/71e80d8a85844b88b0651b8df0362a48 => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:24.343013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987445ce-5c2f-48f2-a0d9-d26d8bacf3dc None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:24.447083 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987445ce-5c2f-48f2-a0d9-d26d8bacf3dc None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:24.483309 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5af72-bee2-4678-aba0-fc171b72977e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:24.483934 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5af72-bee2-4678-aba0-fc171b72977e None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:24.484207 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5af72-bee2-4678-aba0-fc171b72977e None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:24.484472 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5af72-bee2-4678-aba0-fc171b72977e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:24.494149 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:24.548309 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95835e-19a7-46ed-98b4-53d4e3049152 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:24.548877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95835e-19a7-46ed-98b4-53d4e3049152 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:24.549247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95835e-19a7-46ed-98b4-53d4e3049152 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:24.551385 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 518/1057] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:40:24.557816 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42256e15-78c7-4d8e-852a-37676001cfc7 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:24.558123 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42256e15-78c7-4d8e-852a-37676001cfc7 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:24.558857 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42256e15-78c7-4d8e-852a-37676001cfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:24.580242 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-42256e15-78c7-4d8e-852a-37676001cfc7 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:24.581771 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-42256e15-78c7-4d8e-852a-37676001cfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:24.581966 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5af72-bee2-4678-aba0-fc171b72977e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:24.583382 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5af72-bee2-4678-aba0-fc171b72977e None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:24.674386 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 519/1058] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 04:40:24.695924 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42256e15-78c7-4d8e-852a-37676001cfc7 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:24.706672 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 540/1059] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:40:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 04:40:24.712381 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5af72-bee2-4678-aba0-fc171b72977e None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:24.755329 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:24.796176 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:24.823677 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5af72-bee2-4678-aba0-fc171b72977e None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:24.823985 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42256e15-78c7-4d8e-852a-37676001cfc7 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:24.859807 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a4e86-8d1b-402a-98eb-592eed486c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:24.860205 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1c6a6-3654-4185-90bc-228029ff57dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:24.860464 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a4e86-8d1b-402a-98eb-592eed486c2d None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:24.860746 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a4e86-8d1b-402a-98eb-592eed486c2d None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:24.860844 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1c6a6-3654-4185-90bc-228029ff57dc None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:24.861022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a4e86-8d1b-402a-98eb-592eed486c2d None admin] PATH_INFO: `/v3/projects/eaf704395aef4d0aa6b1eef594e4e2fd` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:24.861120 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1c6a6-3654-4185-90bc-228029ff57dc None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:24.861298 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1c6a6-3654-4185-90bc-228029ff57dc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:24.862207 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a4e86-8d1b-402a-98eb-592eed486c2d None admin] RBAC: Authorizing `identity:get_project(project_id=eaf704395aef4d0aa6b1eef594e4e2fd)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:24.863673 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a4e86-8d1b-402a-98eb-592eed486c2d None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:24.865537 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 541/1060] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:40:24 2022] GET /identity/v3/projects/eaf704395aef4d0aa6b1eef594e4e2fd => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:40:24.871430 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a4e86-8d1b-402a-98eb-592eed486c2d None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:24.872186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1c6a6-3654-4185-90bc-228029ff57dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:40:24.877226 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-87e1c6a6-3654-4185-90bc-228029ff57dc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 04:40:24.877226 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:24.877226 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:24.877226 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:24.877226 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:24.877226 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:24.877226 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:24.877226 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:24.877226 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:24.877226 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:24.877226 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:24.877226 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:24.877226 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:40:24.877226 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:40:24.877226 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:40:24.877226 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:40:24.878223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:40:24.878223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:40:24.878223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:40:24.878223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:40:24.878223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:24.878223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:24.878223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:24.878223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:24.878223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:24.878223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:24.878223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:24.878223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:24.878223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:24.878223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:24.878223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:24.878223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:24.882970 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:24.882970 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:24.882970 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:24.882970 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:24.882970 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:40:24.882970 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:40:24.882970 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:40:24.882970 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:40:24.882970 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:40:24.882970 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:40:24.882970 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 04:40:24.882970 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:24.882970 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 520/1061] 10.222.0.39 () {56 vars in 1120 bytes} [Tue Jul 26 04:40:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:24.884274 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1c6a6-3654-4185-90bc-228029ff57dc None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:24.989101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a4e86-8d1b-402a-98eb-592eed486c2d None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:24.997104 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:24.998164 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1c6a6-3654-4185-90bc-228029ff57dc None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:25.024855 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f2b4f-1ed1-4983-9a17-2454b118d12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:25.025479 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f2b4f-1ed1-4983-9a17-2454b118d12c None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:25.025756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f2b4f-1ed1-4983-9a17-2454b118d12c None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:25.026059 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f2b4f-1ed1-4983-9a17-2454b118d12c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:25.026848 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f2b4f-1ed1-4983-9a17-2454b118d12c None admin] RBAC: Adding query filter params (role.id=2bfdd65b06554a6da967b3939da753c7, scope.project.id=eaf704395aef4d0aa6b1eef594e4e2fd, user.id=71e80d8a85844b88b0651b8df0362a48) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:25.027155 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f2b4f-1ed1-4983-9a17-2454b118d12c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:25.028643 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f2b4f-1ed1-4983-9a17-2454b118d12c None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:25.032597 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c7c76-dbc5-4fcc-b1cb-ccc84d40a0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:25.033239 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c7c76-dbc5-4fcc-b1cb-ccc84d40a0a3 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:25.033517 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c7c76-dbc5-4fcc-b1cb-ccc84d40a0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:25.033792 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c7c76-dbc5-4fcc-b1cb-ccc84d40a0a3 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:25.034422 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 542/1062] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:40:24 2022] GET /identity/v3/role_assignments?user.id=71e80d8a85844b88b0651b8df0362a48&scope.project.id=eaf704395aef4d0aa6b1eef594e4e2fd&role.id=2bfdd65b06554a6da967b3939da753c7 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:40:25.035577 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce094b-7285-445d-be4b-bfddddd9046b None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:25.035857 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce094b-7285-445d-be4b-bfddddd9046b None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:25.036130 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce094b-7285-445d-be4b-bfddddd9046b None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:25.037332 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 543/1063] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:25.041518 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c7c76-dbc5-4fcc-b1cb-ccc84d40a0a3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:25.042068 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c7c76-dbc5-4fcc-b1cb-ccc84d40a0a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:25.043557 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c7c76-dbc5-4fcc-b1cb-ccc84d40a0a3 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:25.046646 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:25.048184 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc57de2-e9a8-4ff7-b0f7-c1b8dbb88ed1 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:25.048505 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc57de2-e9a8-4ff7-b0f7-c1b8dbb88ed1 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:25.048898 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc57de2-e9a8-4ff7-b0f7-c1b8dbb88ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:25.058265 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 521/1064] 10.222.0.39 () {56 vars in 1115 bytes} [Tue Jul 26 04:40:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:25.061350 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c7c76-dbc5-4fcc-b1cb-ccc84d40a0a3 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:25.072222 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-5fc57de2-e9a8-4ff7-b0f7-c1b8dbb88ed1 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:25.074263 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-5fc57de2-e9a8-4ff7-b0f7-c1b8dbb88ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:25.170005 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 544/1065] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 04:40:25.175739 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c7c76-dbc5-4fcc-b1cb-ccc84d40a0a3 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:25.183085 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc57de2-e9a8-4ff7-b0f7-c1b8dbb88ed1 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:25.215241 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137534b8-0427-4b78-9199-75bab2c70101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:25.215888 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137534b8-0427-4b78-9199-75bab2c70101 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:25.216167 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137534b8-0427-4b78-9199-75bab2c70101 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:25.216433 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137534b8-0427-4b78-9199-75bab2c70101 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:25.227089 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137534b8-0427-4b78-9199-75bab2c70101 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:25.228545 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137534b8-0427-4b78-9199-75bab2c70101 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:25.244009 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-137534b8-0427-4b78-9199-75bab2c70101 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:40:25.244009 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:25.244009 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:25.244009 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:25.244009 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:25.244009 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:25.244009 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:25.244009 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:25.244009 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:25.244009 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:25.244009 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:25.244009 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:25.244009 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:40:25.244009 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:40:25.244009 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:40:25.245128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:40:25.245128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:25.245128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:25.245128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:25.245128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:25.245128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:25.245128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:25.245128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:25.245128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:25.245128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:25.245128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:25.245128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:25.245128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:25.245128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:25.245128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:25.245128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:25.245128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:25.246104 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:40:25.246104 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:40:25.246104 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:40:25.246104 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:25.246104 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 522/1066] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:40:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:25.250973 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137534b8-0427-4b78-9199-75bab2c70101 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:25.293358 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:25.295832 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc57de2-e9a8-4ff7-b0f7-c1b8dbb88ed1 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:25.313832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:25.333340 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb352c-3a9c-419c-bc54-a4f7e742980f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:25.334043 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb352c-3a9c-419c-bc54-a4f7e742980f None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:25.334321 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb352c-3a9c-419c-bc54-a4f7e742980f None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:25.334587 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb352c-3a9c-419c-bc54-a4f7e742980f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:25.370323 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137534b8-0427-4b78-9199-75bab2c70101 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:25.405021 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738fbca-d176-4b21-a009-0ed1448c8180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:25.405738 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738fbca-d176-4b21-a009-0ed1448c8180 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:25.406053 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738fbca-d176-4b21-a009-0ed1448c8180 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:25.406325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738fbca-d176-4b21-a009-0ed1448c8180 None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:25.407010 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738fbca-d176-4b21-a009-0ed1448c8180 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:25.407309 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738fbca-d176-4b21-a009-0ed1448c8180 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:25.408686 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738fbca-d176-4b21-a009-0ed1448c8180 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:25.408911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb352c-3a9c-419c-bc54-a4f7e742980f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:25.410584 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb352c-3a9c-419c-bc54-a4f7e742980f None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:25.420845 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 523/1067] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:40:25.426476 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738fbca-d176-4b21-a009-0ed1448c8180 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:25.511836 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:25.520570 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 545/1068] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:40:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 04:40:25.521339 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb352c-3a9c-419c-bc54-a4f7e742980f None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:25.538193 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738fbca-d176-4b21-a009-0ed1448c8180 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:25.550048 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:25.577034 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a304dcd-c2ae-422c-8027-9c13f5d67257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:25.577684 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a304dcd-c2ae-422c-8027-9c13f5d67257 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:25.577964 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a304dcd-c2ae-422c-8027-9c13f5d67257 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:25.578275 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a304dcd-c2ae-422c-8027-9c13f5d67257 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:25.586995 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a304dcd-c2ae-422c-8027-9c13f5d67257 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:25.588387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a304dcd-c2ae-422c-8027-9c13f5d67257 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:25.600744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-5a304dcd-c2ae-422c-8027-9c13f5d67257 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 04:40:25.600744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:25.600744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:25.600744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:25.600744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:25.600744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:25.600744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:25.600744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:25.600744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:25.600744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:25.600744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:25.600744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:25.600744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:40:25.600744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:40:25.600744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:40:25.600744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:40:25.601769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:25.601769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:25.601769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:40:25.601769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:40:25.601769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:40:25.601769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:40:25.601769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:25.601769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:25.601769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:25.601769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:25.601769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:25.601769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:25.601769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:25.601769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:25.601769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:25.601769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:25.601769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:25.601769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:25.602824 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:25.602824 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:25.602824 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:40:25.602824 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:40:25.602824 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:40:25.602824 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:40:25.602824 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:40:25.602824 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:40:25.602824 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 04:40:25.602824 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:25.602824 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 524/1069] 10.222.0.39 () {56 vars in 1093 bytes} [Tue Jul 26 04:40:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:40:25.607834 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a304dcd-c2ae-422c-8027-9c13f5d67257 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:25.632607 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb352c-3a9c-419c-bc54-a4f7e742980f None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:25.668774 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd763ee-9947-4dac-b878-810209edd125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:25.669438 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd763ee-9947-4dac-b878-810209edd125 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:25.669720 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd763ee-9947-4dac-b878-810209edd125 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:25.670126 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd763ee-9947-4dac-b878-810209edd125 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:25.680498 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd763ee-9947-4dac-b878-810209edd125 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:25.681990 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd763ee-9947-4dac-b878-810209edd125 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:25.697170 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-8dd763ee-9947-4dac-b878-810209edd125 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:40:25.697170 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:25.697170 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:25.697170 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:25.697170 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:25.697170 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:25.697170 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:25.697170 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:25.697170 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:25.697170 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:25.697170 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:25.697170 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:25.697170 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:40:25.697170 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:40:25.697170 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:40:25.698187 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:40:25.698187 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:25.698187 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:25.698187 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:25.698187 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:25.698187 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:25.698187 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:25.698187 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:25.698187 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:25.698187 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:25.698187 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:25.698187 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:25.698187 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:25.698187 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:25.698187 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:25.698187 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:25.698187 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:25.699126 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:40:25.699126 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:40:25.699126 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:40:25.699126 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:25.699126 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 546/1070] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:40:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:25.704413 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd763ee-9947-4dac-b878-810209edd125 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:25.716823 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a304dcd-c2ae-422c-8027-9c13f5d67257 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:25.754345 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2677854-12cb-4a8a-b653-076c58c2ba09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:25.754991 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2677854-12cb-4a8a-b653-076c58c2ba09 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:25.755251 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2677854-12cb-4a8a-b653-076c58c2ba09 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:25.755522 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2677854-12cb-4a8a-b653-076c58c2ba09 None admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:25.756318 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2677854-12cb-4a8a-b653-076c58c2ba09 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:25.756631 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2677854-12cb-4a8a-b653-076c58c2ba09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:25.758133 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2677854-12cb-4a8a-b653-076c58c2ba09 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:25.761470 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:25.781216 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 525/1071] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Jul 26 04:40:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:25.782354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2677854-12cb-4a8a-b653-076c58c2ba09 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:25.810360 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:25.824500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd763ee-9947-4dac-b878-810209edd125 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:25.860866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48e13f-079e-44c0-8ccc-39b1f54c63ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:25.861413 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48e13f-079e-44c0-8ccc-39b1f54c63ff None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:25.861716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48e13f-079e-44c0-8ccc-39b1f54c63ff None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:25.862029 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48e13f-079e-44c0-8ccc-39b1f54c63ff None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:25.862727 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48e13f-079e-44c0-8ccc-39b1f54c63ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:25.863034 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48e13f-079e-44c0-8ccc-39b1f54c63ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:25.864441 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48e13f-079e-44c0-8ccc-39b1f54c63ff None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:25.882013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 547/1072] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:40:25.889625 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2677854-12cb-4a8a-b653-076c58c2ba09 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:25.930399 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84284a-05f5-490a-b865-b557a2142de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:25.931072 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84284a-05f5-490a-b865-b557a2142de3 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:25.931350 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84284a-05f5-490a-b865-b557a2142de3 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:25.931617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84284a-05f5-490a-b865-b557a2142de3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:25.944287 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c84284a-05f5-490a-b865-b557a2142de3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:25.945810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c84284a-05f5-490a-b865-b557a2142de3 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:25.962838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-4c84284a-05f5-490a-b865-b557a2142de3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:40:25.962838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:25.962838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:25.962838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:25.962838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:25.962838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:25.962838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:25.962838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:25.962838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:25.962838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:25.962838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:25.962838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:25.962838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:40:25.962838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:40:25.962838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:40:25.963829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:40:25.963829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:25.963829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:25.963829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:25.963829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:25.963829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:25.963829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:25.963829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:25.963829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:25.963829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:25.963829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:25.963829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:25.963829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:25.963829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:25.963829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:25.963829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:25.963829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:25.964756 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:40:25.964756 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:40:25.964756 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:40:25.964756 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:25.966365 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 526/1073] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:40:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:25.970349 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48e13f-079e-44c0-8ccc-39b1f54c63ff None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:26.083134 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48e13f-079e-44c0-8ccc-39b1f54c63ff None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:26.098281 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:26.123404 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a3ecd-e834-463c-b968-e956507fdb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:26.123968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a3ecd-e834-463c-b968-e956507fdb01 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:26.124253 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a3ecd-e834-463c-b968-e956507fdb01 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:26.124525 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a3ecd-e834-463c-b968-e956507fdb01 None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:26.125246 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a3ecd-e834-463c-b968-e956507fdb01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:26.125547 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a3ecd-e834-463c-b968-e956507fdb01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:26.127012 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a3ecd-e834-463c-b968-e956507fdb01 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:26.139915 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 548/1074] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:26.145788 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84284a-05f5-490a-b865-b557a2142de3 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:26.232821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:26.256708 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84284a-05f5-490a-b865-b557a2142de3 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:26.295152 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49987dc-4631-4caf-bceb-8bebf25a2c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:26.295814 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49987dc-4631-4caf-bceb-8bebf25a2c51 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:26.296091 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49987dc-4631-4caf-bceb-8bebf25a2c51 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:26.296364 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49987dc-4631-4caf-bceb-8bebf25a2c51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:26.303141 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49987dc-4631-4caf-bceb-8bebf25a2c51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:26.304600 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49987dc-4631-4caf-bceb-8bebf25a2c51 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:26.315997 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-b49987dc-4631-4caf-bceb-8bebf25a2c51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:40:26.315997 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:26.315997 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:26.315997 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:26.315997 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:26.315997 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:26.315997 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:26.315997 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:26.315997 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:26.315997 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:26.315997 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:26.315997 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:26.315997 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:40:26.315997 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:40:26.315997 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:40:26.317325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:40:26.317325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:26.317325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:26.317325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:26.317325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:26.317325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:26.317325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:26.317325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:26.317325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:26.317325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:26.317325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:26.317325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:26.317325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:26.317325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:26.317325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:26.317325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:26.317325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:26.318309 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:40:26.318309 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:40:26.318309 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:40:26.318309 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:40:26.318309 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:40:26.318309 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:40:26.318309 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:40:26.318309 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:26.322154 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 527/1075] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:40:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:26.323551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a3ecd-e834-463c-b968-e956507fdb01 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:26.423463 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a3ecd-e834-463c-b968-e956507fdb01 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:26.458965 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf8ae2-a68b-42ef-8fb3-4cc00d067e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:26.459559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf8ae2-a68b-42ef-8fb3-4cc00d067e5e None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:26.459872 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf8ae2-a68b-42ef-8fb3-4cc00d067e5e None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:26.460148 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf8ae2-a68b-42ef-8fb3-4cc00d067e5e None admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:26.460906 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf8ae2-a68b-42ef-8fb3-4cc00d067e5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:26.461213 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf8ae2-a68b-42ef-8fb3-4cc00d067e5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:26.462721 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf8ae2-a68b-42ef-8fb3-4cc00d067e5e None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:26.475297 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 549/1076] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:40:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:26.481471 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49987dc-4631-4caf-bceb-8bebf25a2c51 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:26.592245 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49987dc-4631-4caf-bceb-8bebf25a2c51 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:26.628981 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce2a7d-371c-4494-865c-54caa7310c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:26.629658 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce2a7d-371c-4494-865c-54caa7310c46 None admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:26.629937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce2a7d-371c-4494-865c-54caa7310c46 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:26.630316 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce2a7d-371c-4494-865c-54caa7310c46 None admin] PATH_INFO: `/v3/projects/c4d7c29a2b144df6afa96fd6894254a4/users/ae8593e125da4b208dd100608aa2b462/roles/b3d30de53787435faa1f35bb788dcefd` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:26.632654 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce2a7d-371c-4494-865c-54caa7310c46 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4d7c29a2b144df6afa96fd6894254a4, user_id=ae8593e125da4b208dd100608aa2b462, role_id=b3d30de53787435faa1f35bb788dcefd)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:26.634155 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ce2a7d-371c-4494-865c-54caa7310c46 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:26.645712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:26.651198 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 528/1077] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 04:40:26 2022] PUT /identity/v3/projects/c4d7c29a2b144df6afa96fd6894254a4/users/ae8593e125da4b208dd100608aa2b462/roles/b3d30de53787435faa1f35bb788dcefd => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:40:27.023729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd15f9f-8f61-4dbc-9354-7e7906a1ac09 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:27.023991 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd15f9f-8f61-4dbc-9354-7e7906a1ac09 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:27.024255 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd15f9f-8f61-4dbc-9354-7e7906a1ac09 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:27.025606 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 550/1078] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:27.031232 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506092a6-7f82-4727-845d-683f87ba0590 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:27.031700 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506092a6-7f82-4727-845d-683f87ba0590 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:27.031788 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506092a6-7f82-4727-845d-683f87ba0590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:27.051243 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-506092a6-7f82-4727-845d-683f87ba0590 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:27.052441 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-506092a6-7f82-4727-845d-683f87ba0590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:27.125417 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 529/1079] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:40:27.147483 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd15f9f-8f61-4dbc-9354-7e7906a1ac09 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:27.180631 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:27.257250 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd15f9f-8f61-4dbc-9354-7e7906a1ac09 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:27.295014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0948f-ac84-430d-9fef-1e827c59cf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:27.295669 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0948f-ac84-430d-9fef-1e827c59cf2c None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:27.295945 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0948f-ac84-430d-9fef-1e827c59cf2c None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:27.296213 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0948f-ac84-430d-9fef-1e827c59cf2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:27.306709 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0948f-ac84-430d-9fef-1e827c59cf2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:40:27.311556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-3ed0948f-ac84-430d-9fef-1e827c59cf2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:40:27.311556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:27.311556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:27.311556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:27.311556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:27.311556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:27.311556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:27.311556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:27.311556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:27.311556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:27.311556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:27.311556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:27.311556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:40:27.311556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:40:27.311556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:40:27.311556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:40:27.312520 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:40:27.312520 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:40:27.312520 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:40:27.312520 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:40:27.312520 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:27.312520 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:27.312520 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:27.312520 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:27.312520 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:27.312520 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:27.312520 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:27.312520 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:27.312520 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:27.312520 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:27.312520 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:27.312520 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:27.313565 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:27.313565 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:27.313565 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:27.313565 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:27.313565 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:40:27.313565 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:40:27.313565 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:40:27.313565 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:40:27.313565 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:40:27.313565 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:40:27.313565 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:40:27.313565 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:27.313565 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 551/1080] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:40:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:27.319318 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506092a6-7f82-4727-845d-683f87ba0590 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:27.418825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506092a6-7f82-4727-845d-683f87ba0590 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:27.448175 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:27.454919 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d058c-2ff3-4f52-aff3-9315225e75a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:27.455535 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d058c-2ff3-4f52-aff3-9315225e75a0 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:27.455808 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d058c-2ff3-4f52-aff3-9315225e75a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:27.456073 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d058c-2ff3-4f52-aff3-9315225e75a0 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:27.456778 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d058c-2ff3-4f52-aff3-9315225e75a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:27.457074 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d058c-2ff3-4f52-aff3-9315225e75a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:27.458503 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d058c-2ff3-4f52-aff3-9315225e75a0 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:27.466835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 530/1081] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:40:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:27.472847 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0948f-ac84-430d-9fef-1e827c59cf2c None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:27.565339 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:27.575292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0948f-ac84-430d-9fef-1e827c59cf2c None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:27.610862 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8605f4e-c038-47c3-aec9-5697fefde1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:27.611498 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8605f4e-c038-47c3-aec9-5697fefde1db None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:27.611771 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8605f4e-c038-47c3-aec9-5697fefde1db None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:27.612037 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8605f4e-c038-47c3-aec9-5697fefde1db None admin] PATH_INFO: `/v3/users/71e80d8a85844b88b0651b8df0362a48` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:27.613240 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8605f4e-c038-47c3-aec9-5697fefde1db None admin] RBAC: Authorizing `identity:get_user(user_id=71e80d8a85844b88b0651b8df0362a48)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:27.614744 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8605f4e-c038-47c3-aec9-5697fefde1db None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:27.616358 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 552/1082] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:40:27 2022] GET /identity/v3/users/71e80d8a85844b88b0651b8df0362a48 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:27.622263 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d058c-2ff3-4f52-aff3-9315225e75a0 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:27.722737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d058c-2ff3-4f52-aff3-9315225e75a0 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:27.758988 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a5202-5909-43ab-9142-4222c72da754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:27.759619 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a5202-5909-43ab-9142-4222c72da754 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:27.759895 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a5202-5909-43ab-9142-4222c72da754 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:27.760160 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a5202-5909-43ab-9142-4222c72da754 None admin] PATH_INFO: `/v3/projects/eaf704395aef4d0aa6b1eef594e4e2fd` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:27.761329 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a5202-5909-43ab-9142-4222c72da754 None admin] RBAC: Authorizing `identity:get_project(project_id=eaf704395aef4d0aa6b1eef594e4e2fd)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:27.762868 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a5202-5909-43ab-9142-4222c72da754 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:27.764605 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 531/1083] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:40:27 2022] GET /identity/v3/projects/eaf704395aef4d0aa6b1eef594e4e2fd => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:27.770680 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8605f4e-c038-47c3-aec9-5697fefde1db None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:27.872399 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8605f4e-c038-47c3-aec9-5697fefde1db None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:27.907000 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e603e6-8cc5-40e8-ba63-dee5f4b69b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:27.907652 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e603e6-8cc5-40e8-ba63-dee5f4b69b37 None admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:27.907928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e603e6-8cc5-40e8-ba63-dee5f4b69b37 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:27.908195 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e603e6-8cc5-40e8-ba63-dee5f4b69b37 None admin] PATH_INFO: `/v3/projects/eaf704395aef4d0aa6b1eef594e4e2fd/users/71e80d8a85844b88b0651b8df0362a48/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:27.910220 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e603e6-8cc5-40e8-ba63-dee5f4b69b37 None admin] RBAC: Authorizing `identity:create_grant(project_id=eaf704395aef4d0aa6b1eef594e4e2fd, user_id=71e80d8a85844b88b0651b8df0362a48, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:27.911678 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e603e6-8cc5-40e8-ba63-dee5f4b69b37 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:27.926130 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 553/1084] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 04:40:27 2022] PUT /identity/v3/projects/eaf704395aef4d0aa6b1eef594e4e2fd/users/71e80d8a85844b88b0651b8df0362a48/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:40:28.607860 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115747a5-9455-4d65-b6dc-8fc1e5bd2af8 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:28.608385 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115747a5-9455-4d65-b6dc-8fc1e5bd2af8 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:28.608385 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115747a5-9455-4d65-b6dc-8fc1e5bd2af8 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:28.609668 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 532/1085] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:28.614953 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd32c6f-314d-4335-9ee4-d00b1c2776e8 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:28.615382 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd32c6f-314d-4335-9ee4-d00b1c2776e8 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:28.615474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd32c6f-314d-4335-9ee4-d00b1c2776e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:28.633746 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-dcd32c6f-314d-4335-9ee4-d00b1c2776e8 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:28.634948 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-dcd32c6f-314d-4335-9ee4-d00b1c2776e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:28.649285 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:28.702384 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 554/1086] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:40:28.726413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115747a5-9455-4d65-b6dc-8fc1e5bd2af8 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:28.790000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:28.835268 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115747a5-9455-4d65-b6dc-8fc1e5bd2af8 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:28.870901 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e5aa1-5729-4839-97ec-e0d7e110c8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:28.871467 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e5aa1-5729-4839-97ec-e0d7e110c8b5 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:28.871744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e5aa1-5729-4839-97ec-e0d7e110c8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:28.872015 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e5aa1-5729-4839-97ec-e0d7e110c8b5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:28.882833 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e5aa1-5729-4839-97ec-e0d7e110c8b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:40:28.887762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-047e5aa1-5729-4839-97ec-e0d7e110c8b5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 04:40:28.887762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:28.887762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:28.887762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:28.887762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:28.887762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:28.887762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:28.887762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:28.887762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:28.887762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:28.887762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:28.887762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:28.887762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:40:28.887762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:40:28.887762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:40:28.887762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:40:28.888782 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:40:28.888782 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:40:28.888782 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:40:28.888782 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:40:28.888782 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:28.888782 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:28.888782 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:28.888782 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:28.888782 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:28.888782 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:28.888782 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:28.888782 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:28.888782 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:28.888782 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:28.888782 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:28.888782 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:28.889669 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:28.889669 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:28.889669 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:28.889669 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:28.889669 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:40:28.889669 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:40:28.889669 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:40:28.889669 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:40:28.889669 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:40:28.889669 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:40:28.889669 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 26 04:40:28.889669 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:28.889669 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 533/1087] 10.222.0.39 () {56 vars in 1120 bytes} [Tue Jul 26 04:40:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:28.895551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd32c6f-314d-4335-9ee4-d00b1c2776e8 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:29.008110 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd32c6f-314d-4335-9ee4-d00b1c2776e8 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:29.043727 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8a5fb-e809-4c1a-9c9e-4b91af034ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:29.044417 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8a5fb-e809-4c1a-9c9e-4b91af034ff2 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:29.044723 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8a5fb-e809-4c1a-9c9e-4b91af034ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:29.045022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8a5fb-e809-4c1a-9c9e-4b91af034ff2 None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:29.045740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8a5fb-e809-4c1a-9c9e-4b91af034ff2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:29.046069 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8a5fb-e809-4c1a-9c9e-4b91af034ff2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:29.047468 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8a5fb-e809-4c1a-9c9e-4b91af034ff2 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:29.055712 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 555/1088] 10.222.0.39 () {56 vars in 1115 bytes} [Tue Jul 26 04:40:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:29.061814 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e5aa1-5729-4839-97ec-e0d7e110c8b5 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:29.168657 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e5aa1-5729-4839-97ec-e0d7e110c8b5 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:29.189181 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:29.204271 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed4c82-62dc-416b-94f3-b19aeac7bb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:29.204916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed4c82-62dc-416b-94f3-b19aeac7bb66 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:29.205200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed4c82-62dc-416b-94f3-b19aeac7bb66 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:29.205477 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed4c82-62dc-416b-94f3-b19aeac7bb66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:29.215596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed4c82-62dc-416b-94f3-b19aeac7bb66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:29.217110 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed4c82-62dc-416b-94f3-b19aeac7bb66 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:29.231748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-41ed4c82-62dc-416b-94f3-b19aeac7bb66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:40:29.231748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:29.231748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:29.231748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:29.231748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:29.231748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:29.231748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:29.231748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:29.231748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:29.231748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:29.231748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:29.231748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:29.231748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:40:29.231748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:40:29.231748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:40:29.232683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:40:29.232683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:29.232683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:29.232683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:29.232683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:29.232683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:29.232683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:29.232683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:29.232683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:29.232683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:29.232683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:29.232683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:29.232683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:29.232683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:29.232683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:29.232683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:29.232683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:29.233601 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:40:29.233601 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:40:29.233601 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:40:29.233601 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:29.233601 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 534/1089] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:40:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:29.240655 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8a5fb-e809-4c1a-9c9e-4b91af034ff2 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:29.256944 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:29.352049 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8a5fb-e809-4c1a-9c9e-4b91af034ff2 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:29.387486 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a2352-a109-4ae5-a4ea-9c6e6b71ef2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:29.388106 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a2352-a109-4ae5-a4ea-9c6e6b71ef2a None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:29.388416 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a2352-a109-4ae5-a4ea-9c6e6b71ef2a None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:29.388695 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a2352-a109-4ae5-a4ea-9c6e6b71ef2a None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:29.389391 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a2352-a109-4ae5-a4ea-9c6e6b71ef2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:29.389697 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a2352-a109-4ae5-a4ea-9c6e6b71ef2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:29.391131 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a2352-a109-4ae5-a4ea-9c6e6b71ef2a None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:29.403988 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 556/1090] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:29.409618 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed4c82-62dc-416b-94f3-b19aeac7bb66 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:29.515382 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed4c82-62dc-416b-94f3-b19aeac7bb66 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:29.550904 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b459d1-f4c4-403e-8ef8-14e65f009f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:29.551546 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b459d1-f4c4-403e-8ef8-14e65f009f54 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:29.551825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b459d1-f4c4-403e-8ef8-14e65f009f54 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:29.552094 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b459d1-f4c4-403e-8ef8-14e65f009f54 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:29.559962 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b459d1-f4c4-403e-8ef8-14e65f009f54 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:29.561587 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b459d1-f4c4-403e-8ef8-14e65f009f54 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:29.573603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-75b459d1-f4c4-403e-8ef8-14e65f009f54 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 26 04:40:29.573603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:29.573603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:29.573603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:29.573603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:29.573603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:29.573603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:29.573603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:29.573603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:29.573603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:29.573603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:29.573603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:29.573603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:40:29.573603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:40:29.573603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:40:29.573603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:40:29.574710 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:29.574710 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:29.574710 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:40:29.574710 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:40:29.574710 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:40:29.574710 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:40:29.574710 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:29.574710 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:29.574710 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:29.574710 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:29.574710 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:29.574710 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:29.574710 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:29.574710 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:29.574710 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:29.574710 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:29.574710 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:29.574710 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:29.575684 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:29.575684 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:29.575684 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:40:29.575684 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:40:29.575684 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:40:29.575684 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:40:29.575684 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:40:29.575684 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:40:29.575684 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 26 04:40:29.575684 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:29.575684 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 535/1091] 10.222.0.39 () {56 vars in 1093 bytes} [Tue Jul 26 04:40:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:29.580891 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a2352-a109-4ae5-a4ea-9c6e6b71ef2a None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:29.655437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:29.686810 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a2352-a109-4ae5-a4ea-9c6e6b71ef2a None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:29.721861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528bc2bb-d88c-46fa-8a8a-9706689d095a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:29.722500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bc2bb-d88c-46fa-8a8a-9706689d095a None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:29.722772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bc2bb-d88c-46fa-8a8a-9706689d095a None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:29.723042 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528bc2bb-d88c-46fa-8a8a-9706689d095a None admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:29.723891 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528bc2bb-d88c-46fa-8a8a-9706689d095a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:29.724201 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528bc2bb-d88c-46fa-8a8a-9706689d095a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:29.725652 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528bc2bb-d88c-46fa-8a8a-9706689d095a None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:29.744276 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 557/1092] 10.222.0.39 () {56 vars in 1133 bytes} [Tue Jul 26 04:40:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:29.750054 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b459d1-f4c4-403e-8ef8-14e65f009f54 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:29.786877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:29.861636 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b459d1-f4c4-403e-8ef8-14e65f009f54 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:29.879893 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16163ab4-b1da-4fef-bc98-2af940b3391a None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:29.880271 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16163ab4-b1da-4fef-bc98-2af940b3391a None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:29.880611 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16163ab4-b1da-4fef-bc98-2af940b3391a None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:29.882123 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 558/1093] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:29.887076 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaed4e3-29d0-4950-9b8e-08b69373d869 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:29.887357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaed4e3-29d0-4950-9b8e-08b69373d869 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:29.887631 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaed4e3-29d0-4950-9b8e-08b69373d869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:29.896076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a618fb3-91e4-40e8-a44e-8cc9ba6345da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:29.896703 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a618fb3-91e4-40e8-a44e-8cc9ba6345da None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:29.896986 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a618fb3-91e4-40e8-a44e-8cc9ba6345da None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:29.897253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a618fb3-91e4-40e8-a44e-8cc9ba6345da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:29.905565 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-bdaed4e3-29d0-4950-9b8e-08b69373d869 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:29.906786 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-bdaed4e3-29d0-4950-9b8e-08b69373d869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:29.965903 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a618fb3-91e4-40e8-a44e-8cc9ba6345da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:29.967439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a618fb3-91e4-40e8-a44e-8cc9ba6345da None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:29.974656 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 559/1094] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 04:40:29.997828 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:29.998322 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaed4e3-29d0-4950-9b8e-08b69373d869 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:30.057172 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:30.068623 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 536/1095] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:40:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 04:40:30.074409 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a618fb3-91e4-40e8-a44e-8cc9ba6345da None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:30.099742 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaed4e3-29d0-4950-9b8e-08b69373d869 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:30.135020 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae0332-c75c-491a-820e-ecdbe5f3a46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:30.135671 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae0332-c75c-491a-820e-ecdbe5f3a46f None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:30.135953 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae0332-c75c-491a-820e-ecdbe5f3a46f None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:30.136234 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae0332-c75c-491a-820e-ecdbe5f3a46f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:30.146850 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae0332-c75c-491a-820e-ecdbe5f3a46f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:40:30.151921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-9cae0332-c75c-491a-820e-ecdbe5f3a46f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:40:30.151921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:30.151921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:30.151921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:30.151921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:30.151921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:30.151921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:30.151921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:30.151921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:30.151921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:30.151921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:30.151921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:30.151921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:40:30.151921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:40:30.151921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:40:30.151921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:40:30.152931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:40:30.152931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:40:30.152931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:40:30.152931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:40:30.152931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:30.152931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:30.152931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:30.152931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:30.152931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:30.152931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:30.152931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:30.152931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:30.152931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:30.152931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:30.152931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:30.152931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:30.154228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:30.154228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:30.154228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:30.154228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:30.154228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:40:30.154228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:40:30.154228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:40:30.154228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:40:30.154228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:40:30.154228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:40:30.154228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:40:30.154228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:30.154228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 560/1096] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:40:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:40:30.159325 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae0332-c75c-491a-820e-ecdbe5f3a46f None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:30.174536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a618fb3-91e4-40e8-a44e-8cc9ba6345da None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:30.203854 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:30.209554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147938f4-a95d-421c-9956-7c90292ccb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:30.210239 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147938f4-a95d-421c-9956-7c90292ccb89 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:30.210515 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147938f4-a95d-421c-9956-7c90292ccb89 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:30.210781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147938f4-a95d-421c-9956-7c90292ccb89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:30.221565 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147938f4-a95d-421c-9956-7c90292ccb89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:30.223059 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147938f4-a95d-421c-9956-7c90292ccb89 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:30.238342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-147938f4-a95d-421c-9956-7c90292ccb89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:40:30.238342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:30.238342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:30.238342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:30.238342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:30.238342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:30.238342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:30.238342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:30.238342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:30.238342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:30.238342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:30.238342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:30.238342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:40:30.238342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:40:30.238342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:40:30.239474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:40:30.239474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:30.239474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:30.239474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:30.239474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:30.239474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:30.239474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:30.239474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:30.239474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:30.239474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:30.239474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:30.239474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:30.239474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:30.239474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:30.239474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:30.239474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:30.239474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:30.240403 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:40:30.240403 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:40:30.240403 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:40:30.240403 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:30.240403 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 537/1097] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:40:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:30.245157 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147938f4-a95d-421c-9956-7c90292ccb89 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:30.261905 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae0332-c75c-491a-820e-ecdbe5f3a46f None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:30.292973 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:30.311064 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063ea0c-4102-46c1-82a1-cb4967b2f441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:30.311708 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063ea0c-4102-46c1-82a1-cb4967b2f441 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:30.311991 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063ea0c-4102-46c1-82a1-cb4967b2f441 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:30.312258 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e063ea0c-4102-46c1-82a1-cb4967b2f441 None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:30.313009 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063ea0c-4102-46c1-82a1-cb4967b2f441 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:30.313311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063ea0c-4102-46c1-82a1-cb4967b2f441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:30.314730 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e063ea0c-4102-46c1-82a1-cb4967b2f441 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:30.324361 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 561/1098] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:40:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:30.330322 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063ea0c-4102-46c1-82a1-cb4967b2f441 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:30.354344 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147938f4-a95d-421c-9956-7c90292ccb89 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:30.388481 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33121266-2b19-4636-a327-47b66b6762ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:30.389114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33121266-2b19-4636-a327-47b66b6762ab None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:30.389393 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33121266-2b19-4636-a327-47b66b6762ab None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:30.389664 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33121266-2b19-4636-a327-47b66b6762ab None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:30.390396 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33121266-2b19-4636-a327-47b66b6762ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:30.390712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33121266-2b19-4636-a327-47b66b6762ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:30.392089 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33121266-2b19-4636-a327-47b66b6762ab None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:30.404728 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 538/1099] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:40:30.410388 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33121266-2b19-4636-a327-47b66b6762ab None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:30.432039 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e063ea0c-4102-46c1-82a1-cb4967b2f441 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:30.456312 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:30.465874 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f257a-7114-4b9b-b20a-6189139ba78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:30.466588 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f257a-7114-4b9b-b20a-6189139ba78f None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:30.466864 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f257a-7114-4b9b-b20a-6189139ba78f None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:30.467133 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829f257a-7114-4b9b-b20a-6189139ba78f None admin] PATH_INFO: `/v3/users/71e80d8a85844b88b0651b8df0362a48` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:30.468298 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f257a-7114-4b9b-b20a-6189139ba78f None admin] RBAC: Authorizing `identity:get_user(user_id=71e80d8a85844b88b0651b8df0362a48)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:30.469775 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829f257a-7114-4b9b-b20a-6189139ba78f None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:30.471804 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 562/1100] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:40:30 2022] GET /identity/v3/users/71e80d8a85844b88b0651b8df0362a48 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:40:30.477369 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f257a-7114-4b9b-b20a-6189139ba78f None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:30.512550 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33121266-2b19-4636-a327-47b66b6762ab None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:30.528530 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:30.547526 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf813e25-6a1a-4004-8656-75d7213fde20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:30.548180 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf813e25-6a1a-4004-8656-75d7213fde20 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:30.548453 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf813e25-6a1a-4004-8656-75d7213fde20 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:30.548702 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf813e25-6a1a-4004-8656-75d7213fde20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:30.555515 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf813e25-6a1a-4004-8656-75d7213fde20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:30.556956 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf813e25-6a1a-4004-8656-75d7213fde20 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:30.569690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-bf813e25-6a1a-4004-8656-75d7213fde20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:40:30.569690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:30.569690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:30.569690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:30.569690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:30.569690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:30.569690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:30.569690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:30.569690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:30.569690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:30.569690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:30.569690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:30.569690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:40:30.569690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:40:30.569690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:40:30.570637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:40:30.570637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:30.570637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:30.570637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:30.570637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:30.570637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:30.570637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:30.570637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:30.570637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:30.570637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:30.570637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:30.570637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:30.570637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:30.570637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:30.570637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:30.570637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:30.570637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:30.571555 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:40:30.571555 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:40:30.571555 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:40:30.571555 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:40:30.571555 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:40:30.571555 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:40:30.571555 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:40:30.571555 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:30.571555 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 539/1101] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:40:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:40:30.577215 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf813e25-6a1a-4004-8656-75d7213fde20 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:30.588512 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829f257a-7114-4b9b-b20a-6189139ba78f None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:30.627510 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f42275-0623-4d4c-8500-494202913236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:30.628553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f42275-0623-4d4c-8500-494202913236 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:30.629083 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f42275-0623-4d4c-8500-494202913236 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:30.629493 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f42275-0623-4d4c-8500-494202913236 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:30.683351 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf813e25-6a1a-4004-8656-75d7213fde20 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:30.686431 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:30.703271 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f42275-0623-4d4c-8500-494202913236 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:30.704779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f42275-0623-4d4c-8500-494202913236 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:30.721424 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ad2f5-70fd-4934-91a7-7f0612887a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:30.722083 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ad2f5-70fd-4934-91a7-7f0612887a18 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:30.722364 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ad2f5-70fd-4934-91a7-7f0612887a18 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:30.722617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ad2f5-70fd-4934-91a7-7f0612887a18 None admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:30.723396 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ad2f5-70fd-4934-91a7-7f0612887a18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:30.723703 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ad2f5-70fd-4934-91a7-7f0612887a18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:30.725141 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ad2f5-70fd-4934-91a7-7f0612887a18 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:30.738089 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 540/1102] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:40:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:40:30.744418 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ad2f5-70fd-4934-91a7-7f0612887a18 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:30.758106 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:30.813594 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 563/1103] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:40:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 04:40:30.815778 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f42275-0623-4d4c-8500-494202913236 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:30.850593 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ad2f5-70fd-4934-91a7-7f0612887a18 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:30.884961 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a341f2-9119-43eb-a006-a8727f14d4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:30.885590 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a341f2-9119-43eb-a006-a8727f14d4f7 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:30.885898 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a341f2-9119-43eb-a006-a8727f14d4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:30.886184 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a341f2-9119-43eb-a006-a8727f14d4f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:30.886976 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a341f2-9119-43eb-a006-a8727f14d4f7 None admin] RBAC: Adding query filter params (role.id=b3d30de53787435faa1f35bb788dcefd, scope.project.id=c4d7c29a2b144df6afa96fd6894254a4, user.id=ae8593e125da4b208dd100608aa2b462) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:30.887285 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a341f2-9119-43eb-a006-a8727f14d4f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:30.888724 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a341f2-9119-43eb-a006-a8727f14d4f7 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:30.894680 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 541/1104] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:40:30 2022] GET /identity/v3/role_assignments?user.id=ae8593e125da4b208dd100608aa2b462&scope.project.id=c4d7c29a2b144df6afa96fd6894254a4&role.id=b3d30de53787435faa1f35bb788dcefd => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:30.916104 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f42275-0623-4d4c-8500-494202913236 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:30.960852 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd084ef-f876-4651-b799-9d5e43b51239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:30.961513 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd084ef-f876-4651-b799-9d5e43b51239 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:30.961790 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd084ef-f876-4651-b799-9d5e43b51239 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:30.962086 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd084ef-f876-4651-b799-9d5e43b51239 None admin] PATH_INFO: `/v3/projects/eaf704395aef4d0aa6b1eef594e4e2fd` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:30.963316 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd084ef-f876-4651-b799-9d5e43b51239 None admin] RBAC: Authorizing `identity:get_project(project_id=eaf704395aef4d0aa6b1eef594e4e2fd)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:30.964815 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd084ef-f876-4651-b799-9d5e43b51239 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:30.966690 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 564/1105] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:40:30 2022] GET /identity/v3/projects/eaf704395aef4d0aa6b1eef594e4e2fd => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:30.973229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a341f2-9119-43eb-a006-a8727f14d4f7 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:31.006789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:31.082247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a341f2-9119-43eb-a006-a8727f14d4f7 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:31.116363 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8046d-aa46-491c-9dbe-bd596a996086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:31.116908 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8046d-aa46-491c-9dbe-bd596a996086 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:31.117188 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8046d-aa46-491c-9dbe-bd596a996086 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:31.117476 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8046d-aa46-491c-9dbe-bd596a996086 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:31.118277 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8046d-aa46-491c-9dbe-bd596a996086 None admin] RBAC: Adding query filter params (role.id=2bfdd65b06554a6da967b3939da753c7, scope.project.id=eaf704395aef4d0aa6b1eef594e4e2fd, user.id=71e80d8a85844b88b0651b8df0362a48) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:31.118584 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8046d-aa46-491c-9dbe-bd596a996086 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:31.120001 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8046d-aa46-491c-9dbe-bd596a996086 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:31.125911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 542/1106] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:40:30 2022] GET /identity/v3/role_assignments?user.id=71e80d8a85844b88b0651b8df0362a48&scope.project.id=eaf704395aef4d0aa6b1eef594e4e2fd&role.id=2bfdd65b06554a6da967b3939da753c7 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:33.127644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d49162-1e1d-4106-aca2-2f51bca2bad1 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:33.128240 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d49162-1e1d-4106-aca2-2f51bca2bad1 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:33.128240 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d49162-1e1d-4106-aca2-2f51bca2bad1 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:33.129536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 565/1107] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:33.134944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16cca6-ca66-40f8-a964-338b47fe9986 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:33.135426 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16cca6-ca66-40f8-a964-338b47fe9986 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:33.135541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16cca6-ca66-40f8-a964-338b47fe9986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:33.156004 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-6d16cca6-ca66-40f8-a964-338b47fe9986 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:33.157205 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-6d16cca6-ca66-40f8-a964-338b47fe9986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:33.227097 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 543/1108] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:40:33.251984 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d49162-1e1d-4106-aca2-2f51bca2bad1 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:33.276053 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:33.369215 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d49162-1e1d-4106-aca2-2f51bca2bad1 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:33.405260 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a6875-fdd9-402e-8916-cf969abcc315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:33.405819 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a6875-fdd9-402e-8916-cf969abcc315 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:33.406132 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a6875-fdd9-402e-8916-cf969abcc315 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:33.406404 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a6875-fdd9-402e-8916-cf969abcc315 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:33.407626 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a6875-fdd9-402e-8916-cf969abcc315 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:33.409084 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a6875-fdd9-402e-8916-cf969abcc315 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:33.410743 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 566/1109] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:40:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:33.416947 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16cca6-ca66-40f8-a964-338b47fe9986 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:33.442415 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:33.521948 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d16cca6-ca66-40f8-a964-338b47fe9986 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:33.556540 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba992f5-bb85-4bbe-b7f1-96c359db0a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:33.557159 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba992f5-bb85-4bbe-b7f1-96c359db0a93 None admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:33.557436 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba992f5-bb85-4bbe-b7f1-96c359db0a93 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:33.557706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba992f5-bb85-4bbe-b7f1-96c359db0a93 None admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:33.558421 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba992f5-bb85-4bbe-b7f1-96c359db0a93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:33.559860 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba992f5-bb85-4bbe-b7f1-96c359db0a93 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:33.583247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 544/1110] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 04:40:33 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:40:35.594511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9bcb0-d7e6-4e79-870c-a48829578c3c None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:35.595147 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9bcb0-d7e6-4e79-870c-a48829578c3c None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:35.595147 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9bcb0-d7e6-4e79-870c-a48829578c3c None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:35.596282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 567/1111] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:35.601797 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de84ef-1d10-482a-b8ab-e47af407d6b6 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:35.602269 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de84ef-1d10-482a-b8ab-e47af407d6b6 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:35.602370 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de84ef-1d10-482a-b8ab-e47af407d6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:35.621938 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-79de84ef-1d10-482a-b8ab-e47af407d6b6 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:35.623213 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-79de84ef-1d10-482a-b8ab-e47af407d6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:35.693496 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 545/1112] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:40:35.717342 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9bcb0-d7e6-4e79-870c-a48829578c3c None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:35.818912 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:35.834375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9bcb0-d7e6-4e79-870c-a48829578c3c None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:35.868859 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9e90e-f5da-46c0-aab5-8c3fa16d1eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:35.869415 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9e90e-f5da-46c0-aab5-8c3fa16d1eeb None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:35.869692 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9e90e-f5da-46c0-aab5-8c3fa16d1eeb None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:35.869961 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9e90e-f5da-46c0-aab5-8c3fa16d1eeb None admin] PATH_INFO: `/v3/roles/e2b16a5edd7b472487fac12492349bc7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:35.871465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9e90e-f5da-46c0-aab5-8c3fa16d1eeb None admin] RBAC: Authorizing `identity:get_role(role_id=e2b16a5edd7b472487fac12492349bc7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:35.872910 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9e90e-f5da-46c0-aab5-8c3fa16d1eeb None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:35.874303 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 568/1113] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:40:35 2022] GET /identity/v3/roles/e2b16a5edd7b472487fac12492349bc7 => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:35.880436 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de84ef-1d10-482a-b8ab-e47af407d6b6 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:35.891245 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:35.984502 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de84ef-1d10-482a-b8ab-e47af407d6b6 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:36.021438 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658ef79-2eb8-49e3-95a2-f654acd0804c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:36.022112 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658ef79-2eb8-49e3-95a2-f654acd0804c None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:36.022389 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658ef79-2eb8-49e3-95a2-f654acd0804c None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:36.022658 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658ef79-2eb8-49e3-95a2-f654acd0804c None admin] PATH_INFO: `/v3/users/62e6b6caa1f34e0f9ec1a0876d411cc8` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:36.037073 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658ef79-2eb8-49e3-95a2-f654acd0804c None admin] RBAC: Authorizing `identity:get_user(user_id=62e6b6caa1f34e0f9ec1a0876d411cc8)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:36.038563 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3658ef79-2eb8-49e3-95a2-f654acd0804c None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:36.040192 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 546/1114] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:40:35 2022] GET /identity/v3/users/62e6b6caa1f34e0f9ec1a0876d411cc8 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:36.046441 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9e90e-f5da-46c0-aab5-8c3fa16d1eeb None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:36.166074 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9e90e-f5da-46c0-aab5-8c3fa16d1eeb None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:36.204033 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e675977-825c-4854-84ff-3dba8d038aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:36.204646 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e675977-825c-4854-84ff-3dba8d038aad None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:36.204921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e675977-825c-4854-84ff-3dba8d038aad None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:36.205188 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e675977-825c-4854-84ff-3dba8d038aad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:36.228965 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:36.273699 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e675977-825c-4854-84ff-3dba8d038aad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:36.275270 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e675977-825c-4854-84ff-3dba8d038aad None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:36.380002 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 569/1115] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:40:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 04:40:36.386286 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658ef79-2eb8-49e3-95a2-f654acd0804c None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:36.468916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:36.513337 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3658ef79-2eb8-49e3-95a2-f654acd0804c None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:36.548469 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e723a9-0ee9-4c5e-aeb1-2fd9678ba8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:36.549188 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e723a9-0ee9-4c5e-aeb1-2fd9678ba8db None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:36.549464 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e723a9-0ee9-4c5e-aeb1-2fd9678ba8db None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:36.549731 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e723a9-0ee9-4c5e-aeb1-2fd9678ba8db None admin] PATH_INFO: `/v3/projects/eaf704395aef4d0aa6b1eef594e4e2fd` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:36.550940 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e723a9-0ee9-4c5e-aeb1-2fd9678ba8db None admin] RBAC: Authorizing `identity:get_project(project_id=eaf704395aef4d0aa6b1eef594e4e2fd)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:36.552378 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e723a9-0ee9-4c5e-aeb1-2fd9678ba8db None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:36.554057 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 547/1116] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:40:36 2022] GET /identity/v3/projects/eaf704395aef4d0aa6b1eef594e4e2fd => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:36.560784 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e675977-825c-4854-84ff-3dba8d038aad None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:36.621114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:36.668824 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e675977-825c-4854-84ff-3dba8d038aad None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:36.707709 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5b286-fcbe-4ef5-b7ec-ee429a377a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:36.708348 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5b286-fcbe-4ef5-b7ec-ee429a377a74 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:36.708626 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5b286-fcbe-4ef5-b7ec-ee429a377a74 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:36.708897 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5b286-fcbe-4ef5-b7ec-ee429a377a74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:36.709693 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db5b286-fcbe-4ef5-b7ec-ee429a377a74 None admin] RBAC: Adding query filter params (role.id=e2b16a5edd7b472487fac12492349bc7, scope.project.id=eaf704395aef4d0aa6b1eef594e4e2fd, user.id=62e6b6caa1f34e0f9ec1a0876d411cc8) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:36.710019 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db5b286-fcbe-4ef5-b7ec-ee429a377a74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:36.711510 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db5b286-fcbe-4ef5-b7ec-ee429a377a74 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:36.718270 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 570/1117] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:40:36 2022] GET /identity/v3/role_assignments?user.id=62e6b6caa1f34e0f9ec1a0876d411cc8&scope.project.id=eaf704395aef4d0aa6b1eef594e4e2fd&role.id=e2b16a5edd7b472487fac12492349bc7 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:38.695463 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711a39a-6546-49ba-918b-7bcc1a87fcfc None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:38.696029 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711a39a-6546-49ba-918b-7bcc1a87fcfc None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:38.696029 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711a39a-6546-49ba-918b-7bcc1a87fcfc None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:38.697317 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 548/1118] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:38.703548 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288b43f-bed5-469f-b477-95296145f9d0 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:38.704027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288b43f-bed5-469f-b477-95296145f9d0 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:38.704027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a288b43f-bed5-469f-b477-95296145f9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:38.727352 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-a288b43f-bed5-469f-b477-95296145f9d0 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:38.728639 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-a288b43f-bed5-469f-b477-95296145f9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:38.803728 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 571/1119] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 04:40:38.826451 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711a39a-6546-49ba-918b-7bcc1a87fcfc None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:38.937398 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711a39a-6546-49ba-918b-7bcc1a87fcfc None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:38.985039 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb0810-63bf-494a-82cd-ce177c91e66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:38.985609 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb0810-63bf-494a-82cd-ce177c91e66c None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:38.985889 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb0810-63bf-494a-82cd-ce177c91e66c None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:38.986201 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb0810-63bf-494a-82cd-ce177c91e66c None admin] PATH_INFO: `/v3/roles/e2b16a5edd7b472487fac12492349bc7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:38.988411 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb0810-63bf-494a-82cd-ce177c91e66c None admin] RBAC: Authorizing `identity:get_role(role_id=e2b16a5edd7b472487fac12492349bc7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:38.990569 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb0810-63bf-494a-82cd-ce177c91e66c None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:38.992589 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 549/1120] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:40:38 2022] GET /identity/v3/roles/e2b16a5edd7b472487fac12492349bc7 => generated 223 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:39.000171 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288b43f-bed5-469f-b477-95296145f9d0 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:39.054441 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:39.106613 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a288b43f-bed5-469f-b477-95296145f9d0 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:39.142346 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6873085-8e9e-4db6-b68b-ebb461bc1b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:39.143010 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6873085-8e9e-4db6-b68b-ebb461bc1b41 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:39.143280 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6873085-8e9e-4db6-b68b-ebb461bc1b41 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:39.143570 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6873085-8e9e-4db6-b68b-ebb461bc1b41 None admin] PATH_INFO: `/v3/users/62e6b6caa1f34e0f9ec1a0876d411cc8` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:39.144757 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6873085-8e9e-4db6-b68b-ebb461bc1b41 None admin] RBAC: Authorizing `identity:get_user(user_id=62e6b6caa1f34e0f9ec1a0876d411cc8)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:39.146275 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6873085-8e9e-4db6-b68b-ebb461bc1b41 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:39.147908 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 572/1121] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:40:38 2022] GET /identity/v3/users/62e6b6caa1f34e0f9ec1a0876d411cc8 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:39.154143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb0810-63bf-494a-82cd-ce177c91e66c None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:39.157247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:39.266135 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb0810-63bf-494a-82cd-ce177c91e66c None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:39.303254 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a7efe1-0645-4bb2-abe8-8b6629495749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:39.303911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7efe1-0645-4bb2-abe8-8b6629495749 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:39.304186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7efe1-0645-4bb2-abe8-8b6629495749 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:39.304468 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a7efe1-0645-4bb2-abe8-8b6629495749 None admin] PATH_INFO: `/v3/projects/eaf704395aef4d0aa6b1eef594e4e2fd` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:39.305777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7efe1-0645-4bb2-abe8-8b6629495749 None admin] RBAC: Authorizing `identity:get_project(project_id=eaf704395aef4d0aa6b1eef594e4e2fd)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:39.307177 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a7efe1-0645-4bb2-abe8-8b6629495749 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:39.308874 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 550/1122] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:40:39 2022] GET /identity/v3/projects/eaf704395aef4d0aa6b1eef594e4e2fd => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:39.315651 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6873085-8e9e-4db6-b68b-ebb461bc1b41 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:39.433766 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6873085-8e9e-4db6-b68b-ebb461bc1b41 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:39.451677 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:39.475416 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29547bed-2046-4246-872d-1dbccf49c18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:39.476100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29547bed-2046-4246-872d-1dbccf49c18e None admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:39.476382 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29547bed-2046-4246-872d-1dbccf49c18e None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:39.476654 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29547bed-2046-4246-872d-1dbccf49c18e None admin] PATH_INFO: `/v3/projects/eaf704395aef4d0aa6b1eef594e4e2fd/users/62e6b6caa1f34e0f9ec1a0876d411cc8/roles/e2b16a5edd7b472487fac12492349bc7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:39.479315 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29547bed-2046-4246-872d-1dbccf49c18e None admin] RBAC: Authorizing `identity:create_grant(project_id=eaf704395aef4d0aa6b1eef594e4e2fd, user_id=62e6b6caa1f34e0f9ec1a0876d411cc8, role_id=e2b16a5edd7b472487fac12492349bc7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:39.480793 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29547bed-2046-4246-872d-1dbccf49c18e None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:39.499520 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 573/1123] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 04:40:39 2022] PUT /identity/v3/projects/eaf704395aef4d0aa6b1eef594e4e2fd/users/62e6b6caa1f34e0f9ec1a0876d411cc8/roles/e2b16a5edd7b472487fac12492349bc7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:40:41.471620 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7922de-8633-4b6f-927a-5521b9377996 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:41.472217 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7922de-8633-4b6f-927a-5521b9377996 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:41.472217 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7922de-8633-4b6f-927a-5521b9377996 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:41.473501 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 551/1124] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:41.479018 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c2dc1-afb0-4a83-9379-1af32c0fc229 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:41.479471 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c2dc1-afb0-4a83-9379-1af32c0fc229 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:41.479581 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c2dc1-afb0-4a83-9379-1af32c0fc229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:41.498253 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-d46c2dc1-afb0-4a83-9379-1af32c0fc229 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:41.499466 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-d46c2dc1-afb0-4a83-9379-1af32c0fc229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:41.570465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 574/1125] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:40:41.593544 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7922de-8633-4b6f-927a-5521b9377996 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:41.669214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:41.702834 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7922de-8633-4b6f-927a-5521b9377996 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:41.738458 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398315a-5d99-44cc-8743-a6f157d0708c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:41.739096 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398315a-5d99-44cc-8743-a6f157d0708c None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:41.739372 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398315a-5d99-44cc-8743-a6f157d0708c None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:41.739639 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398315a-5d99-44cc-8743-a6f157d0708c None admin] PATH_INFO: `/v3/roles/e2b16a5edd7b472487fac12492349bc7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:41.741128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398315a-5d99-44cc-8743-a6f157d0708c None admin] RBAC: Authorizing `identity:get_role(role_id=e2b16a5edd7b472487fac12492349bc7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:41.742542 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398315a-5d99-44cc-8743-a6f157d0708c None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:41.743899 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 552/1126] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:40:41 2022] GET /identity/v3/roles/e2b16a5edd7b472487fac12492349bc7 => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:41.750066 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c2dc1-afb0-4a83-9379-1af32c0fc229 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:41.857878 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46c2dc1-afb0-4a83-9379-1af32c0fc229 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:41.865744 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:41.895861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54312f1-835a-4c9c-b9ee-c144587c52a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:41.896525 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54312f1-835a-4c9c-b9ee-c144587c52a9 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:41.896808 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54312f1-835a-4c9c-b9ee-c144587c52a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:41.897081 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54312f1-835a-4c9c-b9ee-c144587c52a9 None admin] PATH_INFO: `/v3/users/62e6b6caa1f34e0f9ec1a0876d411cc8` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:41.898337 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54312f1-835a-4c9c-b9ee-c144587c52a9 None admin] RBAC: Authorizing `identity:get_user(user_id=62e6b6caa1f34e0f9ec1a0876d411cc8)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:41.899816 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54312f1-835a-4c9c-b9ee-c144587c52a9 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:41.901479 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 575/1127] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:40:41 2022] GET /identity/v3/users/62e6b6caa1f34e0f9ec1a0876d411cc8 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:41.907735 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398315a-5d99-44cc-8743-a6f157d0708c None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:42.013033 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398315a-5d99-44cc-8743-a6f157d0708c None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:42.048250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664df1bb-269d-4a65-aae5-b57bce392b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:42.048868 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664df1bb-269d-4a65-aae5-b57bce392b17 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:42.049147 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664df1bb-269d-4a65-aae5-b57bce392b17 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:42.049413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664df1bb-269d-4a65-aae5-b57bce392b17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:42.057545 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:42.122687 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664df1bb-269d-4a65-aae5-b57bce392b17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:42.124062 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664df1bb-269d-4a65-aae5-b57bce392b17 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:42.229868 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 553/1128] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:40:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 04:40:42.236251 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54312f1-835a-4c9c-b9ee-c144587c52a9 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:42.355287 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54312f1-835a-4c9c-b9ee-c144587c52a9 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:42.391374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3ba50-5bec-4457-8de0-0de3fcdbd4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:42.391940 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3ba50-5bec-4457-8de0-0de3fcdbd4ef None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:42.392213 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3ba50-5bec-4457-8de0-0de3fcdbd4ef None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:42.392480 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3ba50-5bec-4457-8de0-0de3fcdbd4ef None admin] PATH_INFO: `/v3/projects/eaf704395aef4d0aa6b1eef594e4e2fd` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:42.393661 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3ba50-5bec-4457-8de0-0de3fcdbd4ef None admin] RBAC: Authorizing `identity:get_project(project_id=eaf704395aef4d0aa6b1eef594e4e2fd)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:42.395155 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3ba50-5bec-4457-8de0-0de3fcdbd4ef None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:42.396806 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 576/1129] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:40:42 2022] GET /identity/v3/projects/eaf704395aef4d0aa6b1eef594e4e2fd => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:42.403181 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664df1bb-269d-4a65-aae5-b57bce392b17 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:42.443728 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:42.504519 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664df1bb-269d-4a65-aae5-b57bce392b17 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:42.540946 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d7685-87b8-4be6-a920-10d0999c5deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:42.541561 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d7685-87b8-4be6-a920-10d0999c5deb None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:42.541835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d7685-87b8-4be6-a920-10d0999c5deb None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:42.542134 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d7685-87b8-4be6-a920-10d0999c5deb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:42.542911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d7685-87b8-4be6-a920-10d0999c5deb None admin] RBAC: Adding query filter params (role.id=e2b16a5edd7b472487fac12492349bc7, scope.project.id=eaf704395aef4d0aa6b1eef594e4e2fd, user.id=62e6b6caa1f34e0f9ec1a0876d411cc8) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:42.543216 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d7685-87b8-4be6-a920-10d0999c5deb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:42.544617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d7685-87b8-4be6-a920-10d0999c5deb None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:42.551953 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 554/1130] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:40:42 2022] GET /identity/v3/role_assignments?user.id=62e6b6caa1f34e0f9ec1a0876d411cc8&scope.project.id=eaf704395aef4d0aa6b1eef594e4e2fd&role.id=e2b16a5edd7b472487fac12492349bc7 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:44.515553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fd95d-73a8-486a-a71d-63227cf94fd5 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:44.516128 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fd95d-73a8-486a-a71d-63227cf94fd5 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:44.516128 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87fd95d-73a8-486a-a71d-63227cf94fd5 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:44.517511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 577/1131] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:44.523093 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a279e-52fb-4a28-984d-330d4a914282 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:44.523547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a279e-52fb-4a28-984d-330d4a914282 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:44.523667 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a279e-52fb-4a28-984d-330d4a914282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:44.543035 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-eb3a279e-52fb-4a28-984d-330d4a914282 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:44.544209 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-eb3a279e-52fb-4a28-984d-330d4a914282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:44.616059 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 555/1132] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 04:40:44.639668 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87fd95d-73a8-486a-a71d-63227cf94fd5 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:44.686958 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:44.746728 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87fd95d-73a8-486a-a71d-63227cf94fd5 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:44.781756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b787ff-0e6d-4e31-a510-aafd02d4a9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:44.782437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b787ff-0e6d-4e31-a510-aafd02d4a9ab None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:44.782720 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b787ff-0e6d-4e31-a510-aafd02d4a9ab None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:44.782990 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b787ff-0e6d-4e31-a510-aafd02d4a9ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:44.784172 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b787ff-0e6d-4e31-a510-aafd02d4a9ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:44.785634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b787ff-0e6d-4e31-a510-aafd02d4a9ab None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:44.787285 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 578/1133] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:40:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:44.793869 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a279e-52fb-4a28-984d-330d4a914282 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:44.827846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:44.899550 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a279e-52fb-4a28-984d-330d4a914282 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:44.934608 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4bce8-e95c-4a02-95b0-75d3e33bae5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:44.935226 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4bce8-e95c-4a02-95b0-75d3e33bae5b None admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:44.935505 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4bce8-e95c-4a02-95b0-75d3e33bae5b None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:44.935773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4bce8-e95c-4a02-95b0-75d3e33bae5b None admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:44.936446 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4bce8-e95c-4a02-95b0-75d3e33bae5b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:44.937870 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4bce8-e95c-4a02-95b0-75d3e33bae5b None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:44.966464 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 556/1134] 10.222.0.39 () {60 vars in 1141 bytes} [Tue Jul 26 04:40:44 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:40:46.969792 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c29e8a-f2a4-4ab6-a608-2154edf2de23 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:46.970409 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c29e8a-f2a4-4ab6-a608-2154edf2de23 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:46.970409 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c29e8a-f2a4-4ab6-a608-2154edf2de23 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:46.972486 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 579/1135] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:46.980375 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cbd20-49e4-4c4f-8a88-840879a65319 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:46.980911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cbd20-49e4-4c4f-8a88-840879a65319 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:46.981030 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cbd20-49e4-4c4f-8a88-840879a65319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:47.001000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-dd8cbd20-49e4-4c4f-8a88-840879a65319 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:47.002219 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-dd8cbd20-49e4-4c4f-8a88-840879a65319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:47.076178 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 557/1136] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 26 04:40:47.100604 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c29e8a-f2a4-4ab6-a608-2154edf2de23 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:47.206309 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c29e8a-f2a4-4ab6-a608-2154edf2de23 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:47.217028 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:47.243218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7202295-5cde-4af5-911a-ff3974400cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:47.243772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7202295-5cde-4af5-911a-ff3974400cda None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:47.244052 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7202295-5cde-4af5-911a-ff3974400cda None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:47.244325 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7202295-5cde-4af5-911a-ff3974400cda None admin] PATH_INFO: `/v3/domains/default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:47.245609 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7202295-5cde-4af5-911a-ff3974400cda None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:47.247155 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7202295-5cde-4af5-911a-ff3974400cda None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:47.248754 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 580/1137] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:40:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:47.255245 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8cbd20-49e4-4c4f-8a88-840879a65319 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:47.275905 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:47.364453 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8cbd20-49e4-4c4f-8a88-840879a65319 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:47.407184 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c39d9-7eed-4576-ae63-a8ea25461745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:47.407804 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c39d9-7eed-4576-ae63-a8ea25461745 None admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:47.408083 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c39d9-7eed-4576-ae63-a8ea25461745 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:47.408354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c39d9-7eed-4576-ae63-a8ea25461745 None admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:47.409040 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c39d9-7eed-4576-ae63-a8ea25461745 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:47.410554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c39d9-7eed-4576-ae63-a8ea25461745 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:47.438627 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 558/1138] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 04:40:47 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:40:49.446303 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f2e2b-04df-4a97-9597-46b5f192db25 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:49.447144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f2e2b-04df-4a97-9597-46b5f192db25 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:49.447144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f2e2b-04df-4a97-9597-46b5f192db25 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:49.449511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 581/1139] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:49.455052 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25350563-206e-48bc-919a-68cd43100072 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:49.455493 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25350563-206e-48bc-919a-68cd43100072 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:49.455585 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25350563-206e-48bc-919a-68cd43100072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:49.475558 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-25350563-206e-48bc-919a-68cd43100072 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:49.476751 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-25350563-206e-48bc-919a-68cd43100072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:49.543790 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:49.549451 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 559/1140] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:40:49.573134 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f2e2b-04df-4a97-9597-46b5f192db25 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:49.683505 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f2e2b-04df-4a97-9597-46b5f192db25 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:49.719335 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bb943-fab9-4f45-831b-9ca78d8ed821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:49.719969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bb943-fab9-4f45-831b-9ca78d8ed821 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:49.720248 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bb943-fab9-4f45-831b-9ca78d8ed821 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:49.720524 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bb943-fab9-4f45-831b-9ca78d8ed821 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:49.731970 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815bb943-fab9-4f45-831b-9ca78d8ed821 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:40:49.737040 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-815bb943-fab9-4f45-831b-9ca78d8ed821 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:40:49.737040 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:49.737040 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:49.737040 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:49.737040 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:49.737040 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:49.737040 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:49.737040 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:49.737040 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:49.737040 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:49.737040 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:49.737040 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:49.737040 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:40:49.737040 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:40:49.737040 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:40:49.737040 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:40:49.738247 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:40:49.738247 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:40:49.738247 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:40:49.738247 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:40:49.738247 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:49.738247 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:49.738247 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:49.738247 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:49.738247 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:49.738247 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:49.738247 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:49.738247 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:49.738247 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:49.738247 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:49.738247 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:49.738247 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:49.739357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:49.739357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:49.739357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:49.739357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:49.739357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:40:49.739357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:40:49.739357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:40:49.739357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:40:49.739357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:40:49.739357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:40:49.739357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:40:49.739357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:49.739357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 582/1141] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:40:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:49.744713 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25350563-206e-48bc-919a-68cd43100072 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:49.848833 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25350563-206e-48bc-919a-68cd43100072 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:49.894666 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71255ecb-0968-4c8d-ada2-1ef071050480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:49.895291 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71255ecb-0968-4c8d-ada2-1ef071050480 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:49.895522 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71255ecb-0968-4c8d-ada2-1ef071050480 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:49.895832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71255ecb-0968-4c8d-ada2-1ef071050480 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:49.896549 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71255ecb-0968-4c8d-ada2-1ef071050480 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:49.896857 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71255ecb-0968-4c8d-ada2-1ef071050480 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:49.898277 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71255ecb-0968-4c8d-ada2-1ef071050480 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:49.906731 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 560/1142] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:40:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:40:49.912810 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bb943-fab9-4f45-831b-9ca78d8ed821 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:49.954621 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:50.019339 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bb943-fab9-4f45-831b-9ca78d8ed821 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:50.055394 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81d54e-9901-4f30-9369-04642297f0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:50.056024 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81d54e-9901-4f30-9369-04642297f0c4 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:50.056300 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81d54e-9901-4f30-9369-04642297f0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:50.056572 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81d54e-9901-4f30-9369-04642297f0c4 None admin] PATH_INFO: `/v3/users/fdc44416fae944d1b8f956150cec36a5` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:50.070792 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81d54e-9901-4f30-9369-04642297f0c4 None admin] RBAC: Authorizing `identity:get_user(user_id=fdc44416fae944d1b8f956150cec36a5)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:50.072244 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81d54e-9901-4f30-9369-04642297f0c4 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:50.073854 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 583/1143] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:40:49 2022] GET /identity/v3/users/fdc44416fae944d1b8f956150cec36a5 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:50.080087 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71255ecb-0968-4c8d-ada2-1ef071050480 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:50.150024 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:50.195889 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71255ecb-0968-4c8d-ada2-1ef071050480 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:50.230809 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be69d2-bf35-43ad-b61d-aeccc73fb7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:50.231414 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be69d2-bf35-43ad-b61d-aeccc73fb7d3 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:50.231685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be69d2-bf35-43ad-b61d-aeccc73fb7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:50.231951 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be69d2-bf35-43ad-b61d-aeccc73fb7d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:50.314997 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be69d2-bf35-43ad-b61d-aeccc73fb7d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:50.316466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be69d2-bf35-43ad-b61d-aeccc73fb7d3 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:50.380637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:50.424024 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 561/1144] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:40:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 04:40:50.433718 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81d54e-9901-4f30-9369-04642297f0c4 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:50.537289 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:50.544263 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81d54e-9901-4f30-9369-04642297f0c4 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:50.582807 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4521a60-ce78-460f-b227-320fb56c185b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:50.583441 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4521a60-ce78-460f-b227-320fb56c185b None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:50.583715 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4521a60-ce78-460f-b227-320fb56c185b None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:50.583999 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4521a60-ce78-460f-b227-320fb56c185b None admin] PATH_INFO: `/v3/projects/2309d56d331d45d78a0be50b38a4ff9d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:50.585258 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4521a60-ce78-460f-b227-320fb56c185b None admin] RBAC: Authorizing `identity:get_project(project_id=2309d56d331d45d78a0be50b38a4ff9d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:50.586749 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4521a60-ce78-460f-b227-320fb56c185b None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:50.588400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 584/1145] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:40:50 2022] GET /identity/v3/projects/2309d56d331d45d78a0be50b38a4ff9d => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:50.595379 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be69d2-bf35-43ad-b61d-aeccc73fb7d3 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:50.704128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be69d2-bf35-43ad-b61d-aeccc73fb7d3 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:50.738851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ead467-3eb4-489d-a10b-98c31c0d842e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:50.739435 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ead467-3eb4-489d-a10b-98c31c0d842e None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:50.739727 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ead467-3eb4-489d-a10b-98c31c0d842e None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:50.739997 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ead467-3eb4-489d-a10b-98c31c0d842e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:50.740772 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ead467-3eb4-489d-a10b-98c31c0d842e None admin] RBAC: Adding query filter params (role.id=2bfdd65b06554a6da967b3939da753c7, scope.project.id=2309d56d331d45d78a0be50b38a4ff9d, user.id=fdc44416fae944d1b8f956150cec36a5) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:50.741078 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ead467-3eb4-489d-a10b-98c31c0d842e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:50.742536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ead467-3eb4-489d-a10b-98c31c0d842e None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:50.748047 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 562/1146] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:40:50 2022] GET /identity/v3/role_assignments?user.id=fdc44416fae944d1b8f956150cec36a5&scope.project.id=2309d56d331d45d78a0be50b38a4ff9d&role.id=2bfdd65b06554a6da967b3939da753c7 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:52.726781 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414fc7a-37fd-48f5-b63c-1800f42f522a None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:52.727351 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414fc7a-37fd-48f5-b63c-1800f42f522a None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:52.727351 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414fc7a-37fd-48f5-b63c-1800f42f522a None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:52.728715 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 585/1147] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:52.735462 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80e931-af2f-4cf9-b8e9-0ed464d10757 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:52.736181 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80e931-af2f-4cf9-b8e9-0ed464d10757 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:52.736348 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80e931-af2f-4cf9-b8e9-0ed464d10757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:52.765517 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-1c80e931-af2f-4cf9-b8e9-0ed464d10757 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:52.766758 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-1c80e931-af2f-4cf9-b8e9-0ed464d10757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:52.788708 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:52.838012 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 563/1148] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:40:52.861049 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414fc7a-37fd-48f5-b63c-1800f42f522a None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:52.982507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414fc7a-37fd-48f5-b63c-1800f42f522a None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:53.017727 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc16154-3369-4db9-b717-44f0b0ba5bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:53.018389 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc16154-3369-4db9-b717-44f0b0ba5bc9 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:53.018674 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc16154-3369-4db9-b717-44f0b0ba5bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:53.018938 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc16154-3369-4db9-b717-44f0b0ba5bc9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:53.030017 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc16154-3369-4db9-b717-44f0b0ba5bc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:40:53.034923 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-cdc16154-3369-4db9-b717-44f0b0ba5bc9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:40:53.034923 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:53.034923 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:53.034923 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:53.034923 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:53.034923 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:53.034923 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:53.034923 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:53.034923 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:53.034923 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:53.034923 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:53.034923 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:53.034923 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:40:53.034923 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:40:53.034923 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:40:53.034923 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:40:53.036005 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:40:53.036005 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:40:53.036005 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:40:53.036005 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:40:53.036005 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:53.036005 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:53.036005 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:53.036005 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:53.036005 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:53.036005 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:53.036005 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:53.036005 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:53.036005 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:53.036005 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:53.036005 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:53.036005 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:53.037089 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:53.037089 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:53.037089 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:53.037089 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:53.037089 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:40:53.037089 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:40:53.037089 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:40:53.037089 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:40:53.037089 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:40:53.037089 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:40:53.037089 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:40:53.037089 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:53.037089 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 586/1149] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:40:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:53.042312 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80e931-af2f-4cf9-b8e9-0ed464d10757 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:53.149652 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80e931-af2f-4cf9-b8e9-0ed464d10757 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:53.191079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731721b8-536b-4e08-aaf7-7ff30e0fd18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:53.191692 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731721b8-536b-4e08-aaf7-7ff30e0fd18d None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:53.191975 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731721b8-536b-4e08-aaf7-7ff30e0fd18d None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:53.192248 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731721b8-536b-4e08-aaf7-7ff30e0fd18d None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:53.192964 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731721b8-536b-4e08-aaf7-7ff30e0fd18d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:53.193271 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731721b8-536b-4e08-aaf7-7ff30e0fd18d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:53.194689 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731721b8-536b-4e08-aaf7-7ff30e0fd18d None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:53.202933 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 564/1150] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:40:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:40:53.208746 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc16154-3369-4db9-b717-44f0b0ba5bc9 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:53.235925 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:53.318065 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc16154-3369-4db9-b717-44f0b0ba5bc9 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:53.354863 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908f013-17df-46e6-b1dd-eabcaf892f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:53.355866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908f013-17df-46e6-b1dd-eabcaf892f28 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:53.356294 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908f013-17df-46e6-b1dd-eabcaf892f28 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:53.356714 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7908f013-17df-46e6-b1dd-eabcaf892f28 None admin] PATH_INFO: `/v3/users/fdc44416fae944d1b8f956150cec36a5` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:53.358648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908f013-17df-46e6-b1dd-eabcaf892f28 None admin] RBAC: Authorizing `identity:get_user(user_id=fdc44416fae944d1b8f956150cec36a5)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:53.360977 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7908f013-17df-46e6-b1dd-eabcaf892f28 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:53.363519 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 587/1151] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:40:53 2022] GET /identity/v3/users/fdc44416fae944d1b8f956150cec36a5 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:53.370171 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731721b8-536b-4e08-aaf7-7ff30e0fd18d None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:53.392691 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:53.493695 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731721b8-536b-4e08-aaf7-7ff30e0fd18d None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:53.531020 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d13f2a-393d-43d4-9483-b59d70638637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:53.531652 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d13f2a-393d-43d4-9483-b59d70638637 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:53.531923 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d13f2a-393d-43d4-9483-b59d70638637 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:53.532190 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d13f2a-393d-43d4-9483-b59d70638637 None admin] PATH_INFO: `/v3/projects/2309d56d331d45d78a0be50b38a4ff9d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:53.533456 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d13f2a-393d-43d4-9483-b59d70638637 None admin] RBAC: Authorizing `identity:get_project(project_id=2309d56d331d45d78a0be50b38a4ff9d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:53.534936 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d13f2a-393d-43d4-9483-b59d70638637 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:53.536599 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 565/1152] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:40:53 2022] GET /identity/v3/projects/2309d56d331d45d78a0be50b38a4ff9d => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:53.544572 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908f013-17df-46e6-b1dd-eabcaf892f28 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:53.652713 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:53.662087 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7908f013-17df-46e6-b1dd-eabcaf892f28 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:53.697209 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c2d03-33ed-4e74-b6bc-f560f98461ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:53.697869 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c2d03-33ed-4e74-b6bc-f560f98461ed None admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:53.698178 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c2d03-33ed-4e74-b6bc-f560f98461ed None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:53.698449 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c2d03-33ed-4e74-b6bc-f560f98461ed None admin] PATH_INFO: `/v3/projects/2309d56d331d45d78a0be50b38a4ff9d/users/fdc44416fae944d1b8f956150cec36a5/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:53.700519 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c2d03-33ed-4e74-b6bc-f560f98461ed None admin] RBAC: Authorizing `identity:create_grant(project_id=2309d56d331d45d78a0be50b38a4ff9d, user_id=fdc44416fae944d1b8f956150cec36a5, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:53.701971 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c2d03-33ed-4e74-b6bc-f560f98461ed None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:53.717831 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 588/1153] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 04:40:53 2022] PUT /identity/v3/projects/2309d56d331d45d78a0be50b38a4ff9d/users/fdc44416fae944d1b8f956150cec36a5/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:40:55.699468 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733acd6-5b66-4202-812a-b0dc66c50ee8 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:55.700012 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733acd6-5b66-4202-812a-b0dc66c50ee8 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:55.700012 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733acd6-5b66-4202-812a-b0dc66c50ee8 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:55.701391 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 566/1154] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:55.707847 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984d541-f5c4-47ae-bced-2ada05425f66 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:55.708602 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984d541-f5c4-47ae-bced-2ada05425f66 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:55.708769 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984d541-f5c4-47ae-bced-2ada05425f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:55.736369 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-4984d541-f5c4-47ae-bced-2ada05425f66 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:55.737574 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-4984d541-f5c4-47ae-bced-2ada05425f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:55.807320 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 589/1155] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:40:55.837407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733acd6-5b66-4202-812a-b0dc66c50ee8 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:55.931554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:55.950966 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733acd6-5b66-4202-812a-b0dc66c50ee8 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:55.985999 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ac160-e25a-42cb-b22a-962db1488f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:55.986636 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ac160-e25a-42cb-b22a-962db1488f5c None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:55.986911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ac160-e25a-42cb-b22a-962db1488f5c None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:55.987178 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ac160-e25a-42cb-b22a-962db1488f5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:55.998164 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ac160-e25a-42cb-b22a-962db1488f5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:40:56.003635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-248ac160-e25a-42cb-b22a-962db1488f5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:40:56.003635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:56.003635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:56.003635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:56.003635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:56.003635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:56.003635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:56.003635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:56.003635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:56.003635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:56.003635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:56.003635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:56.003635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:40:56.003635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:40:56.003635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:40:56.003635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:40:56.004720 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:40:56.004720 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:40:56.004720 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:40:56.004720 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:40:56.004720 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:56.004720 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:56.004720 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:56.004720 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:56.004720 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:56.004720 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:56.004720 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:56.004720 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:56.004720 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:56.004720 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:56.004720 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:56.004720 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:56.005841 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:56.005841 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:56.005841 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:56.005841 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:56.005841 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:40:56.005841 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:40:56.005841 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:40:56.005841 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:40:56.005841 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:40:56.005841 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:40:56.005841 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:40:56.005841 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:40:56.005841 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 567/1156] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:40:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:56.011688 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984d541-f5c4-47ae-bced-2ada05425f66 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:56.095742 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:56.116470 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984d541-f5c4-47ae-bced-2ada05425f66 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:56.151852 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e0071-c640-4b00-b1af-965985bfd27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:56.152459 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e0071-c640-4b00-b1af-965985bfd27d None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:56.152737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e0071-c640-4b00-b1af-965985bfd27d None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:56.153016 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e0071-c640-4b00-b1af-965985bfd27d None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:56.153756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e0071-c640-4b00-b1af-965985bfd27d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:56.154093 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e0071-c640-4b00-b1af-965985bfd27d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:56.155497 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e0071-c640-4b00-b1af-965985bfd27d None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:56.164252 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 590/1157] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:40:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:56.170875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ac160-e25a-42cb-b22a-962db1488f5c None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:56.292337 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ac160-e25a-42cb-b22a-962db1488f5c None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:56.329627 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3dbaaa-77f9-4b7d-b8d5-0a5cd8e44743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:56.330292 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3dbaaa-77f9-4b7d-b8d5-0a5cd8e44743 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:56.330557 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3dbaaa-77f9-4b7d-b8d5-0a5cd8e44743 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:56.330824 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3dbaaa-77f9-4b7d-b8d5-0a5cd8e44743 None admin] PATH_INFO: `/v3/users/fdc44416fae944d1b8f956150cec36a5` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:56.332198 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3dbaaa-77f9-4b7d-b8d5-0a5cd8e44743 None admin] RBAC: Authorizing `identity:get_user(user_id=fdc44416fae944d1b8f956150cec36a5)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:56.333635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3dbaaa-77f9-4b7d-b8d5-0a5cd8e44743 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:56.335280 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 568/1158] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:40:56 2022] GET /identity/v3/users/fdc44416fae944d1b8f956150cec36a5 => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:56.341670 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e0071-c640-4b00-b1af-965985bfd27d None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:56.453558 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e0071-c640-4b00-b1af-965985bfd27d None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:56.488527 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45e3d8-8752-47a5-8b91-42dfeec65717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:56.489134 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45e3d8-8752-47a5-8b91-42dfeec65717 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:56.489406 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45e3d8-8752-47a5-8b91-42dfeec65717 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:56.489676 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45e3d8-8752-47a5-8b91-42dfeec65717 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:56.504471 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:56.561611 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee45e3d8-8752-47a5-8b91-42dfeec65717 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:56.563039 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee45e3d8-8752-47a5-8b91-42dfeec65717 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:56.669074 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 591/1159] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:40:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 04:40:56.675420 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3dbaaa-77f9-4b7d-b8d5-0a5cd8e44743 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:56.694340 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:56.784738 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3dbaaa-77f9-4b7d-b8d5-0a5cd8e44743 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:56.820300 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66f14c-adfe-42f4-8a7c-a51171dca2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:56.820863 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66f14c-adfe-42f4-8a7c-a51171dca2fc None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:56.821138 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66f14c-adfe-42f4-8a7c-a51171dca2fc None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:56.821414 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66f14c-adfe-42f4-8a7c-a51171dca2fc None admin] PATH_INFO: `/v3/projects/2309d56d331d45d78a0be50b38a4ff9d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:56.822700 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66f14c-adfe-42f4-8a7c-a51171dca2fc None admin] RBAC: Authorizing `identity:get_project(project_id=2309d56d331d45d78a0be50b38a4ff9d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:56.824167 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b66f14c-adfe-42f4-8a7c-a51171dca2fc None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:56.825808 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 569/1160] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:40:56 2022] GET /identity/v3/projects/2309d56d331d45d78a0be50b38a4ff9d => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:56.835939 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45e3d8-8752-47a5-8b91-42dfeec65717 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:56.881893 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:56.943355 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45e3d8-8752-47a5-8b91-42dfeec65717 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:56.980493 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01632ea4-9cc4-4769-bfe2-985c7aa848c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:56.981099 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01632ea4-9cc4-4769-bfe2-985c7aa848c7 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:56.981376 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01632ea4-9cc4-4769-bfe2-985c7aa848c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:56.981650 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01632ea4-9cc4-4769-bfe2-985c7aa848c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:56.982466 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01632ea4-9cc4-4769-bfe2-985c7aa848c7 None admin] RBAC: Adding query filter params (role.id=2bfdd65b06554a6da967b3939da753c7, scope.project.id=2309d56d331d45d78a0be50b38a4ff9d, user.id=fdc44416fae944d1b8f956150cec36a5) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:56.982773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01632ea4-9cc4-4769-bfe2-985c7aa848c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:56.984236 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01632ea4-9cc4-4769-bfe2-985c7aa848c7 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:56.990155 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 592/1161] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:40:56 2022] GET /identity/v3/role_assignments?user.id=fdc44416fae944d1b8f956150cec36a5&scope.project.id=2309d56d331d45d78a0be50b38a4ff9d&role.id=2bfdd65b06554a6da967b3939da753c7 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:40:58.991476 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f34fa-cb69-48a1-b1b5-cda84cf5acf6 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:58.992339 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f34fa-cb69-48a1-b1b5-cda84cf5acf6 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:58.992339 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f34fa-cb69-48a1-b1b5-cda84cf5acf6 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:58.994632 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 570/1162] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:40:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:40:59.000153 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921374e0-54ee-4a2d-b8f5-84fa26b48219 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:59.000568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921374e0-54ee-4a2d-b8f5-84fa26b48219 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:59.000676 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921374e0-54ee-4a2d-b8f5-84fa26b48219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:59.020231 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-921374e0-54ee-4a2d-b8f5-84fa26b48219 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:40:59.021389 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-921374e0-54ee-4a2d-b8f5-84fa26b48219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:40:59.101070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 593/1163] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:40:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:40:59.123518 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f34fa-cb69-48a1-b1b5-cda84cf5acf6 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:59.234016 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:59.255453 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f34fa-cb69-48a1-b1b5-cda84cf5acf6 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:59.293385 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e517b9e-3e69-4176-bdb8-8f17b9e4989e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:59.294011 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e517b9e-3e69-4176-bdb8-8f17b9e4989e None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:59.294326 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e517b9e-3e69-4176-bdb8-8f17b9e4989e None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:59.294596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e517b9e-3e69-4176-bdb8-8f17b9e4989e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:59.364972 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e517b9e-3e69-4176-bdb8-8f17b9e4989e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:59.366524 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e517b9e-3e69-4176-bdb8-8f17b9e4989e None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:59.455118 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:59.476303 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 571/1164] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:40:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 26 04:40:59.482944 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921374e0-54ee-4a2d-b8f5-84fa26b48219 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:59.524015 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:40:59.585479 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921374e0-54ee-4a2d-b8f5-84fa26b48219 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:59.622440 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c3625-34ff-4622-afa7-7a9457e9aaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:59.623093 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c3625-34ff-4622-afa7-7a9457e9aaa7 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:59.623373 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c3625-34ff-4622-afa7-7a9457e9aaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:59.623646 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c3625-34ff-4622-afa7-7a9457e9aaa7 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:59.636078 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c3625-34ff-4622-afa7-7a9457e9aaa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:59.637557 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c3625-34ff-4622-afa7-7a9457e9aaa7 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:59.656218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-596c3625-34ff-4622-afa7-7a9457e9aaa7 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 26 04:40:59.656218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:59.656218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 26 04:40:59.656218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 26 04:40:59.656218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:40:59.656218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:40:59.656218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:40:59.656218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:40:59.656218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 26 04:40:59.656218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:59.656218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 04:40:59.656218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:59.656218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:40:59.656218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:40:59.656218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:40:59.656218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:40:59.656218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:40:59.657740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:40:59.657740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:40:59.657740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:40:59.657740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:40:59.657740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:40:59.657740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:40:59.657740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:40:59.657740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:40:59.657740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:40:59.657740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:40:59.657740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:40:59.657740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:40:59.657740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:40:59.657740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:40:59.657740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:40:59.657740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:40:59.658644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:40:59.658644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:40:59.658644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:40:59.658644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:40:59.658644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:40:59.658644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:40:59.658644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:40:59.658644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:40:59.658644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:40:59.658644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:40:59.658644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 26 04:40:59.658644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:40:59.658644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 26 04:40:59.658644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:40:59.658644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 594/1165] 10.222.0.39 () {56 vars in 1117 bytes} [Tue Jul 26 04:40:59 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:40:59.664205 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e517b9e-3e69-4176-bdb8-8f17b9e4989e None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:40:59.766711 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e517b9e-3e69-4176-bdb8-8f17b9e4989e None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:40:59.801533 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcaf3b2-cb5b-4fb4-9c63-f306d52533e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:40:59.802101 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcaf3b2-cb5b-4fb4-9c63-f306d52533e3 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:40:59.802377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcaf3b2-cb5b-4fb4-9c63-f306d52533e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:40:59.802648 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcaf3b2-cb5b-4fb4-9c63-f306d52533e3 None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:40:59.803325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcaf3b2-cb5b-4fb4-9c63-f306d52533e3 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:40:59.803631 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcaf3b2-cb5b-4fb4-9c63-f306d52533e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:40:59.804985 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcaf3b2-cb5b-4fb4-9c63-f306d52533e3 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:40:59.812159 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 572/1166] 10.222.0.39 () {56 vars in 1115 bytes} [Tue Jul 26 04:40:59 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:41:01.764901 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84214903-b6fe-46d3-acc6-bf983a45d303 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:01.765785 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84214903-b6fe-46d3-acc6-bf983a45d303 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:01.765785 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84214903-b6fe-46d3-acc6-bf983a45d303 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:01.768091 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 595/1167] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:41:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:41:01.774392 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb866a-1f68-45b8-89df-9d0e48814603 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:01.775079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb866a-1f68-45b8-89df-9d0e48814603 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:01.775270 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb866a-1f68-45b8-89df-9d0e48814603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:01.800675 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-f0bb866a-1f68-45b8-89df-9d0e48814603 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:41:01.801870 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-f0bb866a-1f68-45b8-89df-9d0e48814603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:41:01.855744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:01.885246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 573/1168] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:41:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:41:01.908172 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84214903-b6fe-46d3-acc6-bf983a45d303 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:41:02.020815 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:02.025888 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84214903-b6fe-46d3-acc6-bf983a45d303 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:41:02.064158 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773893fa-cf69-4c76-ab9c-8cb14d9b8f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:41:02.064771 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773893fa-cf69-4c76-ab9c-8cb14d9b8f41 None admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:02.065029 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773893fa-cf69-4c76-ab9c-8cb14d9b8f41 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:02.065308 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773893fa-cf69-4c76-ab9c-8cb14d9b8f41 None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:02.066014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773893fa-cf69-4c76-ab9c-8cb14d9b8f41 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:41:02.067427 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773893fa-cf69-4c76-ab9c-8cb14d9b8f41 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:41:02.085274 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 596/1169] 10.222.0.39 () {60 vars in 1138 bytes} [Tue Jul 26 04:41:01 2022] POST /identity/v3/domains => generated 267 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:41:04.084561 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce221e3d-fb88-446b-bd08-893042eaf1b7 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:04.085436 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce221e3d-fb88-446b-bd08-893042eaf1b7 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:04.085436 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce221e3d-fb88-446b-bd08-893042eaf1b7 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:04.087623 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 574/1170] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:41:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:41:04.093947 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fe662-5689-4a58-880d-a2ef5f216d0d None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:04.094733 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fe662-5689-4a58-880d-a2ef5f216d0d None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:04.094885 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fe662-5689-4a58-880d-a2ef5f216d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:04.117074 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-836fe662-5689-4a58-880d-a2ef5f216d0d None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:41:04.118285 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-836fe662-5689-4a58-880d-a2ef5f216d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:41:04.185729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 597/1171] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:41:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:41:04.209767 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce221e3d-fb88-446b-bd08-893042eaf1b7 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:41:04.327423 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce221e3d-fb88-446b-bd08-893042eaf1b7 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:41:04.373802 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013772ba-7abf-4321-a0af-98e6d3913f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:41:04.374406 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013772ba-7abf-4321-a0af-98e6d3913f75 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:04.374680 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013772ba-7abf-4321-a0af-98e6d3913f75 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:04.374948 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013772ba-7abf-4321-a0af-98e6d3913f75 None admin] PATH_INFO: `/v3/domains/927c6466f4304cf6b3428949ebb126a0` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:04.386231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013772ba-7abf-4321-a0af-98e6d3913f75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=927c6466f4304cf6b3428949ebb126a0)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:41:04.387763 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013772ba-7abf-4321-a0af-98e6d3913f75 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:41:04.389374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 575/1172] 10.222.0.39 () {56 vars in 1183 bytes} [Tue Jul 26 04:41:04 2022] GET /identity/v3/domains/927c6466f4304cf6b3428949ebb126a0 => generated 267 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:41:04.395680 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836fe662-5689-4a58-880d-a2ef5f216d0d None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:41:04.482846 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:04.496537 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836fe662-5689-4a58-880d-a2ef5f216d0d None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:41:04.533316 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d42b0-bfe3-43ff-9ad5-96c7dcdc8a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:41:04.533928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d42b0-bfe3-43ff-9ad5-96c7dcdc8a7d None admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:04.534244 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d42b0-bfe3-43ff-9ad5-96c7dcdc8a7d None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:04.534516 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d42b0-bfe3-43ff-9ad5-96c7dcdc8a7d None admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:04.535196 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d42b0-bfe3-43ff-9ad5-96c7dcdc8a7d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:41:04.536669 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701d42b0-bfe3-43ff-9ad5-96c7dcdc8a7d None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:41:04.568508 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 598/1173] 10.222.0.39 () {60 vars in 1141 bytes} [Tue Jul 26 04:41:04 2022] POST /identity/v3/projects => generated 361 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:41:06.579016 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5961f5-f1da-4f33-ac22-d4055240473d None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:06.579595 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5961f5-f1da-4f33-ac22-d4055240473d None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:06.579595 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5961f5-f1da-4f33-ac22-d4055240473d None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:06.580813 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 576/1174] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:41:06.586192 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9981e2-9d6e-4ce4-b322-7d8708161f83 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:06.586644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9981e2-9d6e-4ce4-b322-7d8708161f83 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:06.586905 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9981e2-9d6e-4ce4-b322-7d8708161f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:06.607323 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-3a9981e2-9d6e-4ce4-b322-7d8708161f83 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:41:06.608519 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-3a9981e2-9d6e-4ce4-b322-7d8708161f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:41:06.680373 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 599/1175] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:41:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:41:06.705550 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5961f5-f1da-4f33-ac22-d4055240473d None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:41:06.745392 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:06.813191 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5961f5-f1da-4f33-ac22-d4055240473d None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:41:06.848319 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a080104-7f6f-4a72-90ab-65aee02c5230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:41:06.848934 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a080104-7f6f-4a72-90ab-65aee02c5230 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:06.849210 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a080104-7f6f-4a72-90ab-65aee02c5230 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:06.849481 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a080104-7f6f-4a72-90ab-65aee02c5230 None admin] PATH_INFO: `/v3/domains/927c6466f4304cf6b3428949ebb126a0` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:06.850687 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a080104-7f6f-4a72-90ab-65aee02c5230 None admin] RBAC: Authorizing `identity:get_domain(domain_id=927c6466f4304cf6b3428949ebb126a0)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:41:06.852120 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a080104-7f6f-4a72-90ab-65aee02c5230 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:41:06.853685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 577/1176] 10.222.0.39 () {56 vars in 1183 bytes} [Tue Jul 26 04:41:06 2022] GET /identity/v3/domains/927c6466f4304cf6b3428949ebb126a0 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:41:06.860501 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9981e2-9d6e-4ce4-b322-7d8708161f83 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:41:06.940280 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:06.973048 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9981e2-9d6e-4ce4-b322-7d8708161f83 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:41:07.009502 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668b144-c75e-46f6-9153-e897a030fc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:41:07.010189 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668b144-c75e-46f6-9153-e897a030fc8f None admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:07.010464 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668b144-c75e-46f6-9153-e897a030fc8f None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:07.010739 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668b144-c75e-46f6-9153-e897a030fc8f None admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:07.011427 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668b144-c75e-46f6-9153-e897a030fc8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:41:07.012901 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668b144-c75e-46f6-9153-e897a030fc8f None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:41:07.043703 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 600/1177] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 04:41:06 2022] POST /identity/v3/users => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:41:09.064681 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935ff22-82a4-4b8e-bb64-075729d92eda None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:09.065579 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935ff22-82a4-4b8e-bb64-075729d92eda None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:09.065579 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935ff22-82a4-4b8e-bb64-075729d92eda None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:09.067671 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 578/1178] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:41:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:41:09.076345 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7665ae5-cba7-4a86-9996-93d986bccda7 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:09.076766 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7665ae5-cba7-4a86-9996-93d986bccda7 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:09.076911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7665ae5-cba7-4a86-9996-93d986bccda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:09.099756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-a7665ae5-cba7-4a86-9996-93d986bccda7 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:41:09.100956 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-a7665ae5-cba7-4a86-9996-93d986bccda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:41:09.171274 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 601/1179] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:41:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:41:09.205009 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935ff22-82a4-4b8e-bb64-075729d92eda None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:41:09.312058 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935ff22-82a4-4b8e-bb64-075729d92eda None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:41:09.314843 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:09.350469 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8215b1-1cca-4210-824a-ab228daf6040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:41:09.351117 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8215b1-1cca-4210-824a-ab228daf6040 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:09.351394 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8215b1-1cca-4210-824a-ab228daf6040 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:09.351666 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8215b1-1cca-4210-824a-ab228daf6040 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:09.371228 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8215b1-1cca-4210-824a-ab228daf6040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:41:09.376172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-7c8215b1-1cca-4210-824a-ab228daf6040 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:41:09.376172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:41:09.376172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:41:09.376172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:41:09.376172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:41:09.376172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:41:09.376172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:41:09.376172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:41:09.376172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:41:09.376172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:41:09.376172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:41:09.376172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:41:09.376172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:41:09.376172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:41:09.376172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:41:09.376172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:41:09.377333 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:41:09.377333 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:41:09.377333 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:41:09.377333 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:41:09.377333 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:41:09.377333 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:41:09.377333 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:41:09.377333 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:41:09.377333 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:41:09.377333 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:41:09.377333 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:41:09.377333 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:41:09.377333 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:41:09.377333 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:41:09.377333 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:41:09.377333 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:41:09.378744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:41:09.378744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:41:09.378744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:41:09.378744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:41:09.378744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:41:09.378744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:41:09.378744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:41:09.378744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:41:09.378744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:41:09.378744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:41:09.378744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:41:09.378744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:41:09.378744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 579/1180] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:41:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:41:09.385946 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7665ae5-cba7-4a86-9996-93d986bccda7 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:41:09.448256 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:09.493424 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7665ae5-cba7-4a86-9996-93d986bccda7 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:41:09.531106 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b49a6d-759b-4255-b83c-33187ce451da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:41:09.531717 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b49a6d-759b-4255-b83c-33187ce451da None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:09.531995 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b49a6d-759b-4255-b83c-33187ce451da None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:09.532266 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b49a6d-759b-4255-b83c-33187ce451da None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:09.532983 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b49a6d-759b-4255-b83c-33187ce451da None admin] RBAC: Adding query filter params (name=admin) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:41:09.533283 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b49a6d-759b-4255-b83c-33187ce451da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:41:09.534716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b49a6d-759b-4255-b83c-33187ce451da None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:41:09.542913 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 602/1181] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:41:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:41:09.552280 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8215b1-1cca-4210-824a-ab228daf6040 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:41:09.655682 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8215b1-1cca-4210-824a-ab228daf6040 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:41:09.695533 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275859d-401e-44b5-a689-dc46ed5a6112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:41:09.696168 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275859d-401e-44b5-a689-dc46ed5a6112 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:09.696440 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275859d-401e-44b5-a689-dc46ed5a6112 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:09.696707 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275859d-401e-44b5-a689-dc46ed5a6112 None admin] PATH_INFO: `/v3/users/1022d10778174a4f99aa6c9a47b6f857` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:09.710707 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275859d-401e-44b5-a689-dc46ed5a6112 None admin] RBAC: Authorizing `identity:get_user(user_id=1022d10778174a4f99aa6c9a47b6f857)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:41:09.712148 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275859d-401e-44b5-a689-dc46ed5a6112 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:41:09.713924 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 580/1182] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:41:09 2022] GET /identity/v3/users/1022d10778174a4f99aa6c9a47b6f857 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:41:09.720303 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b49a6d-759b-4255-b83c-33187ce451da None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:41:09.826515 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b49a6d-759b-4255-b83c-33187ce451da None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:41:09.844020 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:09.863699 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8c7c9-69ff-4898-894d-e91371d056f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:41:09.864305 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8c7c9-69ff-4898-894d-e91371d056f7 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:09.864586 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8c7c9-69ff-4898-894d-e91371d056f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:09.864857 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8c7c9-69ff-4898-894d-e91371d056f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:09.934279 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8c7c9-69ff-4898-894d-e91371d056f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:41:09.935688 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8c7c9-69ff-4898-894d-e91371d056f7 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:41:10.040796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 603/1183] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:41:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 04:41:10.050384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275859d-401e-44b5-a689-dc46ed5a6112 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:41:10.083745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:10.166147 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275859d-401e-44b5-a689-dc46ed5a6112 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:41:10.201617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358c288c-f700-496e-9960-e3ef16f128da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:41:10.202278 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c288c-f700-496e-9960-e3ef16f128da None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:10.202548 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c288c-f700-496e-9960-e3ef16f128da None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:10.202815 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358c288c-f700-496e-9960-e3ef16f128da None admin] PATH_INFO: `/v3/projects/67f1cd2f8fcd4bcdbf810599a5fda180` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:10.204080 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c288c-f700-496e-9960-e3ef16f128da None admin] RBAC: Authorizing `identity:get_project(project_id=67f1cd2f8fcd4bcdbf810599a5fda180)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:41:10.205513 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358c288c-f700-496e-9960-e3ef16f128da None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:41:10.207177 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 581/1184] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:41:10 2022] GET /identity/v3/projects/67f1cd2f8fcd4bcdbf810599a5fda180 => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:41:10.216676 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8c7c9-69ff-4898-894d-e91371d056f7 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:41:10.235617 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:10.315623 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8c7c9-69ff-4898-894d-e91371d056f7 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:41:10.350546 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167c151d-939e-4205-94cc-295b6d1d780f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:41:10.351157 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c151d-939e-4205-94cc-295b6d1d780f None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:10.351429 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c151d-939e-4205-94cc-295b6d1d780f None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:10.351705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167c151d-939e-4205-94cc-295b6d1d780f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:10.352485 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c151d-939e-4205-94cc-295b6d1d780f None admin] RBAC: Adding query filter params (role.id=2bfdd65b06554a6da967b3939da753c7, scope.project.id=67f1cd2f8fcd4bcdbf810599a5fda180, user.id=1022d10778174a4f99aa6c9a47b6f857) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:41:10.352788 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c151d-939e-4205-94cc-295b6d1d780f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:41:10.354299 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167c151d-939e-4205-94cc-295b6d1d780f None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:41:10.360231 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 604/1185] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:41:10 2022] GET /identity/v3/role_assignments?user.id=1022d10778174a4f99aa6c9a47b6f857&scope.project.id=67f1cd2f8fcd4bcdbf810599a5fda180&role.id=2bfdd65b06554a6da967b3939da753c7 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:41:12.315647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7442f-9dc6-4a6f-b939-a51efa70f678 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:12.316423 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7442f-9dc6-4a6f-b939-a51efa70f678 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:12.316535 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7442f-9dc6-4a6f-b939-a51efa70f678 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:12.318681 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 582/1186] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:41:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:41:12.324907 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bce1f8-1783-4d1b-ac27-8415008b44ee None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:12.325606 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bce1f8-1783-4d1b-ac27-8415008b44ee None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:12.325758 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bce1f8-1783-4d1b-ac27-8415008b44ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:12.362459 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-49bce1f8-1783-4d1b-ac27-8415008b44ee None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:41:12.363669 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-49bce1f8-1783-4d1b-ac27-8415008b44ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:41:12.436387 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 605/1187] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:41:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:41:12.459295 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7442f-9dc6-4a6f-b939-a51efa70f678 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:41:12.552493 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:12.565279 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7442f-9dc6-4a6f-b939-a51efa70f678 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:41:12.602358 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e5bfa-0e79-4056-b393-f7295bbc7e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:41:12.602994 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e5bfa-0e79-4056-b393-f7295bbc7e99 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:12.603296 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e5bfa-0e79-4056-b393-f7295bbc7e99 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:12.603539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e5bfa-0e79-4056-b393-f7295bbc7e99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:12.613816 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e5bfa-0e79-4056-b393-f7295bbc7e99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:41:12.618726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-982e5bfa-0e79-4056-b393-f7295bbc7e99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:41:12.618726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:41:12.618726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:41:12.618726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:41:12.618726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:41:12.618726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:41:12.618726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:41:12.618726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:41:12.618726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:41:12.618726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:41:12.618726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:41:12.618726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:41:12.618726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:41:12.618726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:41:12.618726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:41:12.618726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:41:12.619911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:41:12.619911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:41:12.619911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:41:12.619911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:41:12.619911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:41:12.619911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:41:12.619911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:41:12.619911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:41:12.619911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:41:12.619911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:41:12.619911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:41:12.619911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:41:12.619911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:41:12.619911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:41:12.619911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:41:12.619911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:41:12.620928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:41:12.620928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:41:12.620928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:41:12.620928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:41:12.620928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:41:12.620928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:41:12.620928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:41:12.620928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:41:12.620928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:41:12.620928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:41:12.620928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:41:12.620928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:41:12.620928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 583/1188] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:41:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:41:12.628815 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bce1f8-1783-4d1b-ac27-8415008b44ee None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:41:12.651497 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:12.741180 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bce1f8-1783-4d1b-ac27-8415008b44ee None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:41:12.777403 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485475e0-0f1a-4610-bb7a-23040e6f626e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:41:12.778027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485475e0-0f1a-4610-bb7a-23040e6f626e None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:12.778310 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485475e0-0f1a-4610-bb7a-23040e6f626e None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:12.778582 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485475e0-0f1a-4610-bb7a-23040e6f626e None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:12.779301 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485475e0-0f1a-4610-bb7a-23040e6f626e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:41:12.779608 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485475e0-0f1a-4610-bb7a-23040e6f626e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:41:12.781004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485475e0-0f1a-4610-bb7a-23040e6f626e None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:41:12.789174 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 606/1189] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:41:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:41:12.797923 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e5bfa-0e79-4056-b393-f7295bbc7e99 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:41:12.902808 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e5bfa-0e79-4056-b393-f7295bbc7e99 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:41:12.938700 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7ddb4-7cea-42ff-a857-3abf0fe3aa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:41:12.939325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7ddb4-7cea-42ff-a857-3abf0fe3aa31 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:12.939604 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7ddb4-7cea-42ff-a857-3abf0fe3aa31 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:12.939874 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7ddb4-7cea-42ff-a857-3abf0fe3aa31 None admin] PATH_INFO: `/v3/users/1022d10778174a4f99aa6c9a47b6f857` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:12.941155 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7ddb4-7cea-42ff-a857-3abf0fe3aa31 None admin] RBAC: Authorizing `identity:get_user(user_id=1022d10778174a4f99aa6c9a47b6f857)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:41:12.942625 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7ddb4-7cea-42ff-a857-3abf0fe3aa31 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:41:12.944208 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 584/1190] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:41:12 2022] GET /identity/v3/users/1022d10778174a4f99aa6c9a47b6f857 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:41:12.951772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485475e0-0f1a-4610-bb7a-23040e6f626e None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:41:13.045491 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:13.083090 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485475e0-0f1a-4610-bb7a-23040e6f626e None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:41:13.118460 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec14da-f8cf-4a7b-8aaf-55e6ce15a48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:41:13.119099 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec14da-f8cf-4a7b-8aaf-55e6ce15a48f None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:13.119378 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec14da-f8cf-4a7b-8aaf-55e6ce15a48f None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:13.119657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec14da-f8cf-4a7b-8aaf-55e6ce15a48f None admin] PATH_INFO: `/v3/projects/67f1cd2f8fcd4bcdbf810599a5fda180` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:13.120918 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec14da-f8cf-4a7b-8aaf-55e6ce15a48f None admin] RBAC: Authorizing `identity:get_project(project_id=67f1cd2f8fcd4bcdbf810599a5fda180)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:41:13.122408 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec14da-f8cf-4a7b-8aaf-55e6ce15a48f None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:41:13.124129 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 607/1191] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:41:12 2022] GET /identity/v3/projects/67f1cd2f8fcd4bcdbf810599a5fda180 => generated 361 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:41:13.130423 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7ddb4-7cea-42ff-a857-3abf0fe3aa31 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:41:13.151565 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:13.236380 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7ddb4-7cea-42ff-a857-3abf0fe3aa31 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:41:13.271769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29e41b-98d7-4399-9e13-8f22f5eeee0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:41:13.272428 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29e41b-98d7-4399-9e13-8f22f5eeee0e None admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:13.272699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29e41b-98d7-4399-9e13-8f22f5eeee0e None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:13.272963 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29e41b-98d7-4399-9e13-8f22f5eeee0e None admin] PATH_INFO: `/v3/projects/67f1cd2f8fcd4bcdbf810599a5fda180/users/1022d10778174a4f99aa6c9a47b6f857/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:13.275188 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29e41b-98d7-4399-9e13-8f22f5eeee0e None admin] RBAC: Authorizing `identity:create_grant(project_id=67f1cd2f8fcd4bcdbf810599a5fda180, user_id=1022d10778174a4f99aa6c9a47b6f857, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:41:13.276642 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc29e41b-98d7-4399-9e13-8f22f5eeee0e None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:41:13.291262 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 585/1192] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 04:41:13 2022] PUT /identity/v3/projects/67f1cd2f8fcd4bcdbf810599a5fda180/users/1022d10778174a4f99aa6c9a47b6f857/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:41:15.246691 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d55c10-b856-4edd-bfeb-f19cfc624c5d None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:15.247596 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d55c10-b856-4edd-bfeb-f19cfc624c5d None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:15.247596 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d55c10-b856-4edd-bfeb-f19cfc624c5d None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:15.249836 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 608/1193] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:41:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:41:15.256179 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a864c58-1840-4ff0-bb83-e5c4f8578d15 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:15.256634 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a864c58-1840-4ff0-bb83-e5c4f8578d15 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:15.256728 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a864c58-1840-4ff0-bb83-e5c4f8578d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:15.276528 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-6a864c58-1840-4ff0-bb83-e5c4f8578d15 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:41:15.277705 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-6a864c58-1840-4ff0-bb83-e5c4f8578d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:41:15.345671 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 586/1194] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:41:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:41:15.368670 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d55c10-b856-4edd-bfeb-f19cfc624c5d None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:41:15.472271 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d55c10-b856-4edd-bfeb-f19cfc624c5d None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:41:15.507024 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45694a6-230b-4a7a-a48f-5f6d6c17285c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:41:15.507600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45694a6-230b-4a7a-a48f-5f6d6c17285c None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:15.507879 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45694a6-230b-4a7a-a48f-5f6d6c17285c None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:15.508150 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45694a6-230b-4a7a-a48f-5f6d6c17285c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:15.519862 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45694a6-230b-4a7a-a48f-5f6d6c17285c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:41:15.524772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-d45694a6-230b-4a7a-a48f-5f6d6c17285c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:41:15.524772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:41:15.524772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:41:15.524772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:41:15.524772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:41:15.524772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:41:15.524772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:41:15.524772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:41:15.524772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:41:15.524772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:41:15.524772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:41:15.524772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:41:15.524772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:41:15.524772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:41:15.524772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:41:15.524772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:41:15.525916 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:41:15.525916 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:41:15.525916 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:41:15.525916 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:41:15.525916 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:41:15.525916 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:41:15.525916 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:41:15.525916 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:41:15.525916 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:41:15.525916 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:41:15.525916 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:41:15.525916 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:41:15.525916 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:41:15.525916 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:41:15.525916 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:41:15.525916 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:41:15.527207 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:41:15.527207 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:41:15.527207 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:41:15.527207 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:41:15.527207 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:41:15.527207 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:41:15.527207 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:41:15.527207 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:41:15.527207 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:41:15.527207 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:41:15.527207 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:41:15.527207 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:41:15.527207 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 609/1195] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:41:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:41:15.532242 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a864c58-1840-4ff0-bb83-e5c4f8578d15 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:41:15.542720 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:15.635190 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a864c58-1840-4ff0-bb83-e5c4f8578d15 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:41:15.673332 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012d14e-e191-45d3-a34f-bbc413d62a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:41:15.673970 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012d14e-e191-45d3-a34f-bbc413d62a29 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:15.674272 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012d14e-e191-45d3-a34f-bbc413d62a29 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:15.674544 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012d14e-e191-45d3-a34f-bbc413d62a29 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:15.675275 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012d14e-e191-45d3-a34f-bbc413d62a29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:41:15.675574 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012d14e-e191-45d3-a34f-bbc413d62a29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:41:15.676969 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012d14e-e191-45d3-a34f-bbc413d62a29 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:41:15.686279 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 587/1196] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:41:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:41:15.692831 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45694a6-230b-4a7a-a48f-5f6d6c17285c None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:41:15.696066 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:15.795747 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45694a6-230b-4a7a-a48f-5f6d6c17285c None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:41:15.830374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104b5d5-7290-49c1-a260-bbdea466763d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:41:15.831010 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104b5d5-7290-49c1-a260-bbdea466763d None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:15.831287 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104b5d5-7290-49c1-a260-bbdea466763d None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:15.831562 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104b5d5-7290-49c1-a260-bbdea466763d None admin] PATH_INFO: `/v3/users/1022d10778174a4f99aa6c9a47b6f857` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:15.832761 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104b5d5-7290-49c1-a260-bbdea466763d None admin] RBAC: Authorizing `identity:get_user(user_id=1022d10778174a4f99aa6c9a47b6f857)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:41:15.834245 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104b5d5-7290-49c1-a260-bbdea466763d None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:41:15.835867 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 610/1197] 10.222.0.39 () {56 vars in 1177 bytes} [Tue Jul 26 04:41:15 2022] GET /identity/v3/users/1022d10778174a4f99aa6c9a47b6f857 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:41:15.842027 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012d14e-e191-45d3-a34f-bbc413d62a29 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:41:15.915803 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:15.947968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012d14e-e191-45d3-a34f-bbc413d62a29 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:41:15.982221 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4edc7f-006f-4857-97e4-40e04eb7fed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:41:15.982832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4edc7f-006f-4857-97e4-40e04eb7fed3 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:15.983112 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4edc7f-006f-4857-97e4-40e04eb7fed3 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:15.983387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4edc7f-006f-4857-97e4-40e04eb7fed3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:16.053456 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4edc7f-006f-4857-97e4-40e04eb7fed3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:41:16.054850 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4edc7f-006f-4857-97e4-40e04eb7fed3 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:41:16.126197 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:16.159069 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 588/1198] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:41:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 04:41:16.165342 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104b5d5-7290-49c1-a260-bbdea466763d None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:41:16.237628 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:16.270067 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104b5d5-7290-49c1-a260-bbdea466763d None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:41:16.304643 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b837a86-1dea-46fb-a613-b1025e33c2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:41:16.305228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b837a86-1dea-46fb-a613-b1025e33c2a0 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:16.305502 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b837a86-1dea-46fb-a613-b1025e33c2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:16.305782 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b837a86-1dea-46fb-a613-b1025e33c2a0 None admin] PATH_INFO: `/v3/projects/67f1cd2f8fcd4bcdbf810599a5fda180` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:16.307057 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b837a86-1dea-46fb-a613-b1025e33c2a0 None admin] RBAC: Authorizing `identity:get_project(project_id=67f1cd2f8fcd4bcdbf810599a5fda180)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:41:16.308515 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b837a86-1dea-46fb-a613-b1025e33c2a0 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:41:16.310229 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 611/1199] 10.222.0.39 () {56 vars in 1186 bytes} [Tue Jul 26 04:41:16 2022] GET /identity/v3/projects/67f1cd2f8fcd4bcdbf810599a5fda180 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:41:16.316975 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4edc7f-006f-4857-97e4-40e04eb7fed3 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:41:16.439670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4edc7f-006f-4857-97e4-40e04eb7fed3 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:41:16.475115 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ae1850-00de-42f9-89e4-db6b20ddd7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:41:16.475731 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae1850-00de-42f9-89e4-db6b20ddd7ce None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:41:16.476001 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae1850-00de-42f9-89e4-db6b20ddd7ce None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:41:16.476268 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae1850-00de-42f9-89e4-db6b20ddd7ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:41:16.477034 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae1850-00de-42f9-89e4-db6b20ddd7ce None admin] RBAC: Adding query filter params (role.id=2bfdd65b06554a6da967b3939da753c7, scope.project.id=67f1cd2f8fcd4bcdbf810599a5fda180, user.id=1022d10778174a4f99aa6c9a47b6f857) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:41:16.477337 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae1850-00de-42f9-89e4-db6b20ddd7ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:41:16.478814 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ae1850-00de-42f9-89e4-db6b20ddd7ce None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:41:16.484630 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 589/1200] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:41:16 2022] GET /identity/v3/role_assignments?user.id=1022d10778174a4f99aa6c9a47b6f857&scope.project.id=67f1cd2f8fcd4bcdbf810599a5fda180&role.id=2bfdd65b06554a6da967b3939da753c7 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:41:26.299901 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=31 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:41:26.481889 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=83 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:11.973063 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183da8d-f672-494d-b30b-81cde52d067d None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:11.973714 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183da8d-f672-494d-b30b-81cde52d067d None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:11.973714 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183da8d-f672-494d-b30b-81cde52d067d None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:11.975308 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 612/1201] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:42:11.981385 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f511403-c706-4f7d-bff0-ef8a12e9eab3 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:11.981934 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f511403-c706-4f7d-bff0-ef8a12e9eab3 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:11.981934 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f511403-c706-4f7d-bff0-ef8a12e9eab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:12.002925 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-4f511403-c706-4f7d-bff0-ef8a12e9eab3 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:42:12.004185 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-4f511403-c706-4f7d-bff0-ef8a12e9eab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:42:12.088771 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 590/1202] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:42:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:42:12.120147 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183da8d-f672-494d-b30b-81cde52d067d None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:12.290763 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183da8d-f672-494d-b30b-81cde52d067d None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:12.336570 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184a1e9-5c30-4496-8526-150801151494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:12.338161 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184a1e9-5c30-4496-8526-150801151494 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:12.338608 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184a1e9-5c30-4496-8526-150801151494 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:12.339003 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184a1e9-5c30-4496-8526-150801151494 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:12.366147 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184a1e9-5c30-4496-8526-150801151494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:12.368881 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184a1e9-5c30-4496-8526-150801151494 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:12.390715 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-6184a1e9-5c30-4496-8526-150801151494 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:42:12.390715 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:12.390715 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:12.390715 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:12.390715 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:12.390715 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:12.390715 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:12.390715 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:12.390715 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:12.390715 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:12.390715 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:12.390715 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:12.390715 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:42:12.390715 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:42:12.390715 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:42:12.391845 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:42:12.391845 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:12.391845 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:12.391845 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:12.391845 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:12.391845 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:12.391845 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:12.391845 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:12.391845 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:12.391845 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:12.391845 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:12.391845 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:12.391845 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:12.391845 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:12.391845 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:12.391845 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:12.391845 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:12.392849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:42:12.392849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:42:12.392849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:42:12.392849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:42:12.397479 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 613/1203] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:42:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:42:12.400046 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f511403-c706-4f7d-bff0-ef8a12e9eab3 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:12.547962 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f511403-c706-4f7d-bff0-ef8a12e9eab3 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:12.585816 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:12.592381 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4dc86-9159-4533-8d08-d1df162bf306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:12.593010 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4dc86-9159-4533-8d08-d1df162bf306 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:12.593295 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4dc86-9159-4533-8d08-d1df162bf306 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:12.593563 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4dc86-9159-4533-8d08-d1df162bf306 None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:12.594315 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4dc86-9159-4533-8d08-d1df162bf306 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:12.594623 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4dc86-9159-4533-8d08-d1df162bf306 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:12.596362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4dc86-9159-4533-8d08-d1df162bf306 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:12.608700 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 591/1204] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:42:12.615486 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184a1e9-5c30-4496-8526-150801151494 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:12.690277 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:12.745211 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184a1e9-5c30-4496-8526-150801151494 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:12.785025 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360f41f-0347-42d4-88a2-b3ff7cf2cdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:12.785707 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360f41f-0347-42d4-88a2-b3ff7cf2cdbb None admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:12.786070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360f41f-0347-42d4-88a2-b3ff7cf2cdbb None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:12.786350 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360f41f-0347-42d4-88a2-b3ff7cf2cdbb None admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:12.787071 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4360f41f-0347-42d4-88a2-b3ff7cf2cdbb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:12.788654 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4360f41f-0347-42d4-88a2-b3ff7cf2cdbb None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:12.815659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 614/1205] 10.222.0.39 () {60 vars in 1132 bytes} [Tue Jul 26 04:42:12 2022] POST /identity/v3/users => generated 251 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:42:15.088130 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387861ad-1a01-410d-80e1-baa817a84fc7 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:15.088703 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387861ad-1a01-410d-80e1-baa817a84fc7 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:15.088703 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387861ad-1a01-410d-80e1-baa817a84fc7 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:15.090203 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 592/1206] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:42:15.099655 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b40224-08ba-464a-bd6d-fc576d380b0d None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:15.100109 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b40224-08ba-464a-bd6d-fc576d380b0d None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:15.100272 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b40224-08ba-464a-bd6d-fc576d380b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:15.122071 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-78b40224-08ba-464a-bd6d-fc576d380b0d None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:42:15.123537 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-78b40224-08ba-464a-bd6d-fc576d380b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:42:15.202830 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 615/1207] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:42:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:42:15.227594 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387861ad-1a01-410d-80e1-baa817a84fc7 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:15.368177 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387861ad-1a01-410d-80e1-baa817a84fc7 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:15.411833 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421bd72-0332-4db8-ac6b-580738ee245c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:15.412485 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421bd72-0332-4db8-ac6b-580738ee245c None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:15.412766 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421bd72-0332-4db8-ac6b-580738ee245c None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:15.413044 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421bd72-0332-4db8-ac6b-580738ee245c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:15.426369 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421bd72-0332-4db8-ac6b-580738ee245c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:42:15.431715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-a421bd72-0332-4db8-ac6b-580738ee245c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:42:15.431715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:15.431715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:15.431715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:15.431715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:15.431715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:15.431715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:15.431715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:15.431715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:15.431715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:15.431715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:15.431715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:15.431715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:42:15.431715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:42:15.431715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:42:15.431715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:42:15.433530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:42:15.433530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:42:15.433530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:42:15.433530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:42:15.433530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:15.433530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:15.433530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:15.433530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:15.433530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:15.433530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:15.433530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:15.433530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:15.433530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:15.433530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:15.433530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:15.433530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:15.434474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:15.434474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:15.434474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:15.434474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:15.434474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:42:15.434474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:42:15.434474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:42:15.434474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:42:15.434474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:42:15.434474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:42:15.434474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:42:15.434474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:42:15.434474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 593/1208] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 04:42:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:42:15.439810 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b40224-08ba-464a-bd6d-fc576d380b0d None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:15.484002 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:15.560084 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b40224-08ba-464a-bd6d-fc576d380b0d None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:15.601852 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d717c-d804-426b-8c88-10b2c270d383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:15.602573 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d717c-d804-426b-8c88-10b2c270d383 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:15.602865 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d717c-d804-426b-8c88-10b2c270d383 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:15.603218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d717c-d804-426b-8c88-10b2c270d383 None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:15.604015 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d717c-d804-426b-8c88-10b2c270d383 None admin] RBAC: Adding query filter params (name=service) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:15.604352 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d717c-d804-426b-8c88-10b2c270d383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:15.605902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d717c-d804-426b-8c88-10b2c270d383 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:15.618115 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 616/1209] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 04:42:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:42:15.624386 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421bd72-0332-4db8-ac6b-580738ee245c None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:15.689094 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:15.745034 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421bd72-0332-4db8-ac6b-580738ee245c None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:15.782881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cbf72-f3aa-4ef8-9773-3bdd1b5429a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:15.783829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cbf72-f3aa-4ef8-9773-3bdd1b5429a1 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:15.784109 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cbf72-f3aa-4ef8-9773-3bdd1b5429a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:15.784375 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62cbf72-f3aa-4ef8-9773-3bdd1b5429a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:15.796375 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62cbf72-f3aa-4ef8-9773-3bdd1b5429a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:15.797862 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62cbf72-f3aa-4ef8-9773-3bdd1b5429a1 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:15.818000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-f62cbf72-f3aa-4ef8-9773-3bdd1b5429a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:42:15.818000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:15.818000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:15.818000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:15.818000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:15.818000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:15.818000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:15.818000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:15.818000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:15.818000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:15.818000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:15.818000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:15.818000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:42:15.818000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:42:15.818000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:42:15.819020 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:42:15.819020 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:15.819020 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:15.819020 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:15.819020 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:15.819020 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:15.819020 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:15.819020 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:15.819020 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:15.819020 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:15.819020 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:15.819020 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:15.819020 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:15.819020 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:15.819020 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:15.819020 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:15.819020 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:15.819963 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:42:15.819963 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:42:15.819963 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:42:15.819963 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:42:15.819963 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 594/1210] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:42:15.822394 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d717c-d804-426b-8c88-10b2c270d383 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:15.939276 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:15.942296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d717c-d804-426b-8c88-10b2c270d383 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:15.982675 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4435e8-5ac2-4432-af53-52764a656937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:15.983790 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4435e8-5ac2-4432-af53-52764a656937 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:15.984383 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4435e8-5ac2-4432-af53-52764a656937 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:15.984726 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4435e8-5ac2-4432-af53-52764a656937 None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:15.985644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4435e8-5ac2-4432-af53-52764a656937 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:15.986088 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4435e8-5ac2-4432-af53-52764a656937 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:15.987813 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4435e8-5ac2-4432-af53-52764a656937 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:16.002728 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 617/1211] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:42:16.010053 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cbf72-f3aa-4ef8-9773-3bdd1b5429a1 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:16.132562 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62cbf72-f3aa-4ef8-9773-3bdd1b5429a1 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:16.134348 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:16.174446 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d084b5-4c14-4855-8a30-833848e98709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:16.175176 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d084b5-4c14-4855-8a30-833848e98709 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:16.175462 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d084b5-4c14-4855-8a30-833848e98709 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:16.175725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d084b5-4c14-4855-8a30-833848e98709 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:16.184828 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d084b5-4c14-4855-8a30-833848e98709 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:16.186328 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d084b5-4c14-4855-8a30-833848e98709 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:16.200647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-80d084b5-4c14-4855-8a30-833848e98709 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 04:42:16.200647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:16.200647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:16.200647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:16.200647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:16.200647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:16.200647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:16.200647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:16.200647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:16.200647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:16.200647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:16.200647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:16.200647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:42:16.200647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:42:16.200647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:42:16.200647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:42:16.201998 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:16.201998 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:16.201998 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:42:16.201998 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:42:16.201998 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:42:16.201998 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:42:16.201998 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:16.201998 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:16.201998 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:16.201998 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:16.201998 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:16.201998 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:16.201998 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:16.201998 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:16.201998 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:16.201998 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:16.201998 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:16.201998 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:16.203192 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:16.203192 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:16.203192 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:42:16.203192 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:42:16.203192 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:42:16.203192 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:42:16.203192 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:42:16.203192 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:42:16.203192 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 04:42:16.203192 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:42:16.206163 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 595/1212] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:42:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:42:16.208778 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4435e8-5ac2-4432-af53-52764a656937 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:16.341926 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4435e8-5ac2-4432-af53-52764a656937 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:16.383614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b57701-dc78-4a98-a47d-ed4f0581d1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:16.384331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b57701-dc78-4a98-a47d-ed4f0581d1be None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:16.384640 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b57701-dc78-4a98-a47d-ed4f0581d1be None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:16.385003 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b57701-dc78-4a98-a47d-ed4f0581d1be None admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:16.385917 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b57701-dc78-4a98-a47d-ed4f0581d1be None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:16.386362 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b57701-dc78-4a98-a47d-ed4f0581d1be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:16.388099 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b57701-dc78-4a98-a47d-ed4f0581d1be None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:16.412635 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 618/1213] 10.222.0.39 () {56 vars in 1143 bytes} [Tue Jul 26 04:42:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:42:16.418526 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d084b5-4c14-4855-8a30-833848e98709 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:16.543536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d084b5-4c14-4855-8a30-833848e98709 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:16.582063 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af736f-db13-4cfb-a084-2e33599cb330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:16.582704 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af736f-db13-4cfb-a084-2e33599cb330 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:16.582984 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af736f-db13-4cfb-a084-2e33599cb330 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:16.583259 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af736f-db13-4cfb-a084-2e33599cb330 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:16.617914 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:16.666601 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af736f-db13-4cfb-a084-2e33599cb330 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:16.668213 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af736f-db13-4cfb-a084-2e33599cb330 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:16.797858 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 596/1214] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:42:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 04:42:16.803639 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b57701-dc78-4a98-a47d-ed4f0581d1be None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:16.824011 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:16.917078 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b57701-dc78-4a98-a47d-ed4f0581d1be None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:16.957358 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d58a7-b95c-473c-b51e-f8d14469a70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:16.958129 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d58a7-b95c-473c-b51e-f8d14469a70a None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:16.958445 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d58a7-b95c-473c-b51e-f8d14469a70a None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:16.958685 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d58a7-b95c-473c-b51e-f8d14469a70a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:16.970815 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d58a7-b95c-473c-b51e-f8d14469a70a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:16.972409 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d58a7-b95c-473c-b51e-f8d14469a70a None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:16.989627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-3b8d58a7-b95c-473c-b51e-f8d14469a70a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:42:16.989627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:16.989627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:16.989627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:16.989627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:16.989627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:16.989627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:16.989627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:16.989627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:16.989627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:16.989627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:16.989627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:16.989627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:42:16.989627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:42:16.989627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:42:16.990902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:42:16.990902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:16.990902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:16.990902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:16.990902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:16.990902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:16.990902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:16.990902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:16.990902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:16.990902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:16.990902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:16.990902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:16.990902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:16.990902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:16.990902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:16.990902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:16.990902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:16.992110 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:42:16.992110 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:42:16.992110 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:42:16.992110 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:42:16.995931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 619/1215] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:42:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:42:16.996943 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af736f-db13-4cfb-a084-2e33599cb330 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:17.066896 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:17.108912 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af736f-db13-4cfb-a084-2e33599cb330 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:17.146074 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bee5d-3a8b-404e-8fc8-8e75ee0150bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:17.146772 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bee5d-3a8b-404e-8fc8-8e75ee0150bc None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:17.147006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bee5d-3a8b-404e-8fc8-8e75ee0150bc None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:17.147231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bee5d-3a8b-404e-8fc8-8e75ee0150bc None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:17.147968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41bee5d-3a8b-404e-8fc8-8e75ee0150bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:17.148279 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41bee5d-3a8b-404e-8fc8-8e75ee0150bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:17.149758 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41bee5d-3a8b-404e-8fc8-8e75ee0150bc None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:17.162779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 597/1216] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:42:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:42:17.168572 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d58a7-b95c-473c-b51e-f8d14469a70a None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:17.243623 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:17.291951 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d58a7-b95c-473c-b51e-f8d14469a70a None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:17.328691 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a79f5-670e-401d-96cd-1553e05e4085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:17.329263 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a79f5-670e-401d-96cd-1553e05e4085 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:17.329542 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a79f5-670e-401d-96cd-1553e05e4085 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:17.329823 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a79f5-670e-401d-96cd-1553e05e4085 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:17.336785 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a79f5-670e-401d-96cd-1553e05e4085 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:17.338353 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a79f5-670e-401d-96cd-1553e05e4085 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:17.351839 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-857a79f5-670e-401d-96cd-1553e05e4085 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:42:17.351839 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:17.351839 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:17.351839 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:17.351839 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:17.351839 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:17.351839 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:17.351839 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:17.351839 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:17.351839 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:17.351839 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:17.351839 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:17.351839 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:42:17.351839 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:42:17.351839 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:42:17.352834 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:42:17.352834 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:17.352834 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:17.352834 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:17.352834 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:17.352834 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:17.352834 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:17.352834 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:17.352834 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:17.352834 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:17.352834 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:17.352834 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:17.352834 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:17.352834 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:17.352834 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:17.352834 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:17.352834 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:17.353792 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:42:17.353792 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:42:17.353792 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:42:17.353792 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:42:17.353792 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:42:17.353792 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:42:17.353792 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:42:17.353792 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:42:17.353792 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 620/1217] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:42:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:42:17.360515 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bee5d-3a8b-404e-8fc8-8e75ee0150bc None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:17.470373 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bee5d-3a8b-404e-8fc8-8e75ee0150bc None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:17.494669 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:17.508095 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8feec-7db6-43dd-bbb5-097ee30bdfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:17.508675 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8feec-7db6-43dd-bbb5-097ee30bdfa7 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:17.508977 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8feec-7db6-43dd-bbb5-097ee30bdfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:17.509295 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8feec-7db6-43dd-bbb5-097ee30bdfa7 None admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:17.510181 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8feec-7db6-43dd-bbb5-097ee30bdfa7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:17.510510 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8feec-7db6-43dd-bbb5-097ee30bdfa7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:17.512234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c8feec-7db6-43dd-bbb5-097ee30bdfa7 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:17.530343 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 598/1218] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:42:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:42:17.533709 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a79f5-670e-401d-96cd-1553e05e4085 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:17.657280 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a79f5-670e-401d-96cd-1553e05e4085 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:17.691655 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:17.698344 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112d796-b26c-473c-8671-df6449efcc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:17.699061 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112d796-b26c-473c-8671-df6449efcc7c None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:17.699382 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112d796-b26c-473c-8671-df6449efcc7c None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:17.699614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112d796-b26c-473c-8671-df6449efcc7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:17.700460 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112d796-b26c-473c-8671-df6449efcc7c None admin] RBAC: Adding query filter params (role.id=a22f1a3785a746048e38205d1996764b, scope.project.id=c4d7c29a2b144df6afa96fd6894254a4, user.id=21dfe7b4d6524ec2885224d77395b00b) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:17.700772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112d796-b26c-473c-8671-df6449efcc7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:17.702377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112d796-b26c-473c-8671-df6449efcc7c None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:17.718013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 621/1219] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:42:17 2022] GET /identity/v3/role_assignments?user.id=21dfe7b4d6524ec2885224d77395b00b&scope.project.id=c4d7c29a2b144df6afa96fd6894254a4&role.id=a22f1a3785a746048e38205d1996764b => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:42:19.748876 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66425870-8af8-4774-8026-5516c567fccd None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:19.749439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66425870-8af8-4774-8026-5516c567fccd None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:19.749540 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66425870-8af8-4774-8026-5516c567fccd None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:19.750931 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 599/1220] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:42:19.757225 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a508b9f-b638-4d48-9a89-0710679c60fc None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:19.757814 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a508b9f-b638-4d48-9a89-0710679c60fc None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:19.757814 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a508b9f-b638-4d48-9a89-0710679c60fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:19.780474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-2a508b9f-b638-4d48-9a89-0710679c60fc None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:42:19.781690 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-2a508b9f-b638-4d48-9a89-0710679c60fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:42:19.860162 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 622/1221] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:42:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:42:19.884612 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66425870-8af8-4774-8026-5516c567fccd None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:20.004213 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66425870-8af8-4774-8026-5516c567fccd None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:20.049493 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e8ede-2cf2-49b8-882e-5cf375a2f075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:20.050236 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e8ede-2cf2-49b8-882e-5cf375a2f075 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:20.050510 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e8ede-2cf2-49b8-882e-5cf375a2f075 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:20.050773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e8ede-2cf2-49b8-882e-5cf375a2f075 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:20.062762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e8ede-2cf2-49b8-882e-5cf375a2f075 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:42:20.068122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-320e8ede-2cf2-49b8-882e-5cf375a2f075 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:42:20.068122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:20.068122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:20.068122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:20.068122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:20.068122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:20.068122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:20.068122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:20.068122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:20.068122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:20.068122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:20.068122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:20.068122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:42:20.068122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:42:20.068122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:42:20.068122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:42:20.069422 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:42:20.069422 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:42:20.069422 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:42:20.069422 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:42:20.069422 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:20.069422 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:20.069422 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:20.069422 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:20.069422 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:20.069422 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:20.069422 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:20.069422 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:20.069422 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:20.069422 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:20.069422 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:20.069422 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:20.070405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:20.070405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:20.070405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:20.070405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:20.070405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:42:20.070405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:42:20.070405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:42:20.070405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:42:20.070405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:42:20.070405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:42:20.070405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:42:20.070405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:42:20.070405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 600/1222] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 04:42:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:42:20.075639 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a508b9f-b638-4d48-9a89-0710679c60fc None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:20.181829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a508b9f-b638-4d48-9a89-0710679c60fc None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:20.207006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:20.218516 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28646d36-4a71-46c0-b299-888f600365bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:20.219148 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28646d36-4a71-46c0-b299-888f600365bc None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:20.219465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28646d36-4a71-46c0-b299-888f600365bc None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:20.219763 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28646d36-4a71-46c0-b299-888f600365bc None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:20.220543 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28646d36-4a71-46c0-b299-888f600365bc None admin] RBAC: Adding query filter params (name=service) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:20.220850 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28646d36-4a71-46c0-b299-888f600365bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:20.222365 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28646d36-4a71-46c0-b299-888f600365bc None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:20.231551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 623/1223] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 04:42:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:42:20.237429 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e8ede-2cf2-49b8-882e-5cf375a2f075 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:20.286385 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:20.348444 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e8ede-2cf2-49b8-882e-5cf375a2f075 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:20.388568 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcf03a-25cc-4e30-8cc6-44fa39ef537b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:20.389445 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcf03a-25cc-4e30-8cc6-44fa39ef537b None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:20.389728 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcf03a-25cc-4e30-8cc6-44fa39ef537b None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:20.390020 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcf03a-25cc-4e30-8cc6-44fa39ef537b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:20.402484 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fcf03a-25cc-4e30-8cc6-44fa39ef537b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:20.404119 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fcf03a-25cc-4e30-8cc6-44fa39ef537b None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:20.421789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-15fcf03a-25cc-4e30-8cc6-44fa39ef537b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:42:20.421789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:20.421789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:20.421789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:20.421789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:20.421789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:20.421789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:20.421789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:20.421789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:20.421789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:20.421789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:20.421789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:20.421789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:42:20.421789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:42:20.421789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:42:20.422830 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:42:20.422830 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:20.422830 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:20.422830 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:20.422830 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:20.422830 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:20.422830 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:20.422830 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:20.422830 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:20.422830 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:20.422830 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:20.422830 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:20.422830 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:20.422830 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:20.422830 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:20.422830 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:20.422830 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:20.424355 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:42:20.424355 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:42:20.424355 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:42:20.424355 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:42:20.424355 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 601/1224] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:42:20.429291 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28646d36-4a71-46c0-b299-888f600365bc None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:20.544856 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28646d36-4a71-46c0-b299-888f600365bc None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:20.581011 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04368020-59ff-4fba-b037-a0e877d3796b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:20.581674 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04368020-59ff-4fba-b037-a0e877d3796b None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:20.581952 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04368020-59ff-4fba-b037-a0e877d3796b None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:20.582256 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04368020-59ff-4fba-b037-a0e877d3796b None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:20.582956 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04368020-59ff-4fba-b037-a0e877d3796b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:20.583253 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04368020-59ff-4fba-b037-a0e877d3796b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:20.584664 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04368020-59ff-4fba-b037-a0e877d3796b None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:20.597290 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 624/1225] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:42:20.603144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcf03a-25cc-4e30-8cc6-44fa39ef537b None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:20.710377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:20.718241 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcf03a-25cc-4e30-8cc6-44fa39ef537b None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:20.752864 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea095c05-b9a4-4573-a0e2-461bbe9b87b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:20.753899 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea095c05-b9a4-4573-a0e2-461bbe9b87b1 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:20.753899 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea095c05-b9a4-4573-a0e2-461bbe9b87b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:20.754252 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea095c05-b9a4-4573-a0e2-461bbe9b87b1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:20.762207 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea095c05-b9a4-4573-a0e2-461bbe9b87b1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:20.763670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea095c05-b9a4-4573-a0e2-461bbe9b87b1 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:20.775235 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-ea095c05-b9a4-4573-a0e2-461bbe9b87b1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 04:42:20.775235 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:20.775235 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:20.775235 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:20.775235 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:20.775235 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:20.775235 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:20.775235 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:20.775235 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:20.775235 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:20.775235 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:20.775235 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:20.775235 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:42:20.775235 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:42:20.775235 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:42:20.775235 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:42:20.776748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:20.776748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:20.776748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:42:20.776748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:42:20.776748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:42:20.776748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:42:20.776748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:20.776748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:20.776748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:20.776748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:20.776748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:20.776748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:20.776748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:20.776748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:20.776748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:20.776748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:20.776748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:20.776748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:20.777948 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:20.777948 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:20.777948 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:42:20.777948 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:42:20.777948 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:42:20.777948 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:42:20.777948 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:42:20.777948 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:42:20.777948 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 04:42:20.777948 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:42:20.777948 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 602/1226] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:42:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:42:20.782615 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04368020-59ff-4fba-b037-a0e877d3796b None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:20.834100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:20.888866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04368020-59ff-4fba-b037-a0e877d3796b None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:20.926095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8db27-9a71-4d0f-93f2-aa8326d52e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:20.926733 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8db27-9a71-4d0f-93f2-aa8326d52e62 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:20.927014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8db27-9a71-4d0f-93f2-aa8326d52e62 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:20.927286 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec8db27-9a71-4d0f-93f2-aa8326d52e62 None admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:20.928114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8db27-9a71-4d0f-93f2-aa8326d52e62 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:20.928399 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8db27-9a71-4d0f-93f2-aa8326d52e62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:20.929872 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec8db27-9a71-4d0f-93f2-aa8326d52e62 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:20.949246 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 625/1227] 10.222.0.39 () {56 vars in 1143 bytes} [Tue Jul 26 04:42:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:42:20.955980 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea095c05-b9a4-4573-a0e2-461bbe9b87b1 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:21.073730 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea095c05-b9a4-4573-a0e2-461bbe9b87b1 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:21.109860 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad1d73-e532-4eff-8372-3dd732ec12e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:21.110476 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad1d73-e532-4eff-8372-3dd732ec12e6 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:21.110752 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad1d73-e532-4eff-8372-3dd732ec12e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:21.111022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ad1d73-e532-4eff-8372-3dd732ec12e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:21.125139 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad1d73-e532-4eff-8372-3dd732ec12e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:21.126665 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ad1d73-e532-4eff-8372-3dd732ec12e6 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:21.141779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-34ad1d73-e532-4eff-8372-3dd732ec12e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:42:21.141779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:21.141779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:21.141779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:21.141779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:21.141779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:21.141779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:21.141779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:21.141779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:21.141779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:21.141779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:21.141779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:21.141779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:42:21.141779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:42:21.141779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:42:21.143195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:42:21.143195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:21.143195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:21.143195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:21.143195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:21.143195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:21.143195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:21.143195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:21.143195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:21.143195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:21.143195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:21.143195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:21.143195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:21.143195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:21.143195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:21.143195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:21.143195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:21.144205 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:42:21.144205 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:42:21.144205 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:42:21.144205 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:42:21.144205 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 603/1228] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:42:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 26 04:42:21.150455 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8db27-9a71-4d0f-93f2-aa8326d52e62 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:21.261535 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec8db27-9a71-4d0f-93f2-aa8326d52e62 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:21.264029 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:21.299928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d043d1-dc05-46fa-b5d8-ec7af526edc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:21.300589 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d043d1-dc05-46fa-b5d8-ec7af526edc6 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:21.300873 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d043d1-dc05-46fa-b5d8-ec7af526edc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:21.301146 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d043d1-dc05-46fa-b5d8-ec7af526edc6 None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:21.301845 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d043d1-dc05-46fa-b5d8-ec7af526edc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:21.302188 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d043d1-dc05-46fa-b5d8-ec7af526edc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:21.303607 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d043d1-dc05-46fa-b5d8-ec7af526edc6 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:21.316051 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 626/1229] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:42:21.322475 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad1d73-e532-4eff-8372-3dd732ec12e6 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:21.334092 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:21.429340 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ad1d73-e532-4eff-8372-3dd732ec12e6 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:21.468159 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad6351-f330-44ff-8dec-b1ff5b4576c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:21.468844 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad6351-f330-44ff-8dec-b1ff5b4576c8 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:21.469137 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad6351-f330-44ff-8dec-b1ff5b4576c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:21.469454 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad6351-f330-44ff-8dec-b1ff5b4576c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:21.477084 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad6351-f330-44ff-8dec-b1ff5b4576c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:21.478621 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad6351-f330-44ff-8dec-b1ff5b4576c8 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:21.490648 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-5bad6351-f330-44ff-8dec-b1ff5b4576c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:42:21.490648 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:21.490648 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:21.490648 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:21.490648 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:21.490648 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:21.490648 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:21.490648 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:21.490648 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:21.490648 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:21.490648 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:21.490648 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:21.490648 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:42:21.490648 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:42:21.490648 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:42:21.491734 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:42:21.491734 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:21.491734 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:21.491734 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:21.491734 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:21.491734 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:21.491734 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:21.491734 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:21.491734 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:21.491734 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:21.491734 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:21.491734 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:21.491734 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:21.491734 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:21.491734 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:21.491734 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:21.491734 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:21.492868 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:42:21.492868 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:42:21.492868 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:42:21.492868 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:42:21.492868 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:42:21.492868 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:42:21.492868 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:42:21.492868 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:42:21.492868 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 604/1230] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:42:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:42:21.498392 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d043d1-dc05-46fa-b5d8-ec7af526edc6 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:21.623948 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d043d1-dc05-46fa-b5d8-ec7af526edc6 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:21.663318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c61f3-caf5-45dd-8c14-f5e4e2ad15df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:21.663931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c61f3-caf5-45dd-8c14-f5e4e2ad15df None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:21.664210 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c61f3-caf5-45dd-8c14-f5e4e2ad15df None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:21.664484 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c61f3-caf5-45dd-8c14-f5e4e2ad15df None admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:21.665251 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c61f3-caf5-45dd-8c14-f5e4e2ad15df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:21.665561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c61f3-caf5-45dd-8c14-f5e4e2ad15df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:21.667074 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c61f3-caf5-45dd-8c14-f5e4e2ad15df None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:21.680017 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 627/1231] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:42:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:42:21.686564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad6351-f330-44ff-8dec-b1ff5b4576c8 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:21.764529 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:21.802714 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad6351-f330-44ff-8dec-b1ff5b4576c8 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:21.839657 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e2b33-bfa5-4f30-a1fb-e0512fa2400a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:21.840415 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e2b33-bfa5-4f30-a1fb-e0512fa2400a None admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:21.840744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e2b33-bfa5-4f30-a1fb-e0512fa2400a None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:21.841047 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e2b33-bfa5-4f30-a1fb-e0512fa2400a None admin] PATH_INFO: `/v3/projects/c4d7c29a2b144df6afa96fd6894254a4/users/21dfe7b4d6524ec2885224d77395b00b/roles/a22f1a3785a746048e38205d1996764b` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:21.857646 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e2b33-bfa5-4f30-a1fb-e0512fa2400a None admin] RBAC: Authorizing `identity:create_grant(project_id=c4d7c29a2b144df6afa96fd6894254a4, user_id=21dfe7b4d6524ec2885224d77395b00b, role_id=a22f1a3785a746048e38205d1996764b)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:21.859147 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e2b33-bfa5-4f30-a1fb-e0512fa2400a None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:21.874533 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 605/1232] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 04:42:21 2022] PUT /identity/v3/projects/c4d7c29a2b144df6afa96fd6894254a4/users/21dfe7b4d6524ec2885224d77395b00b/roles/a22f1a3785a746048e38205d1996764b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:42:24.008181 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3c10e-3100-4b03-ad04-60aa90e5c2a4 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:24.008749 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3c10e-3100-4b03-ad04-60aa90e5c2a4 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:24.008749 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3c10e-3100-4b03-ad04-60aa90e5c2a4 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:24.010372 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 628/1233] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:42:24.016405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198f651-3b87-4a98-aee5-446cffaade20 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:24.016990 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198f651-3b87-4a98-aee5-446cffaade20 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:24.016990 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a198f651-3b87-4a98-aee5-446cffaade20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:24.037521 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-a198f651-3b87-4a98-aee5-446cffaade20 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:42:24.038617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-a198f651-3b87-4a98-aee5-446cffaade20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:42:24.117987 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 606/1234] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:42:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:42:24.141450 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3c10e-3100-4b03-ad04-60aa90e5c2a4 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:24.167583 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:24.250536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3c10e-3100-4b03-ad04-60aa90e5c2a4 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:24.292512 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee669c7-6b0d-4652-a4b9-20c18f28f046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:24.293261 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee669c7-6b0d-4652-a4b9-20c18f28f046 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:24.293601 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee669c7-6b0d-4652-a4b9-20c18f28f046 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:24.293945 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee669c7-6b0d-4652-a4b9-20c18f28f046 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:24.305227 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee669c7-6b0d-4652-a4b9-20c18f28f046 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:42:24.310600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-3ee669c7-6b0d-4652-a4b9-20c18f28f046 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:42:24.310600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:24.310600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:24.310600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:24.310600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:24.310600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:24.310600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:24.310600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:24.310600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:24.310600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:24.310600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:24.310600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:24.310600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:42:24.310600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:42:24.310600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:42:24.310600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:42:24.311738 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:42:24.311738 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:42:24.311738 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:42:24.311738 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:42:24.311738 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:24.311738 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:24.311738 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:24.311738 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:24.311738 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:24.311738 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:24.311738 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:24.311738 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:24.311738 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:24.311738 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:24.311738 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:24.311738 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:24.312851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:24.312851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:24.312851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:24.312851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:24.312851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:42:24.312851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:42:24.312851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:42:24.312851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:42:24.312851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:42:24.312851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:42:24.312851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 26 04:42:24.312851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:42:24.312851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 629/1235] 10.222.0.39 () {56 vars in 1102 bytes} [Tue Jul 26 04:42:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:42:24.318201 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198f651-3b87-4a98-aee5-446cffaade20 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:24.368943 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:24.425772 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a198f651-3b87-4a98-aee5-446cffaade20 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:24.463859 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b5e69-3ddc-42bb-98bd-576954ddba79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:24.464505 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b5e69-3ddc-42bb-98bd-576954ddba79 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:24.464777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b5e69-3ddc-42bb-98bd-576954ddba79 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:24.465051 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b5e69-3ddc-42bb-98bd-576954ddba79 None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:24.465780 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b5e69-3ddc-42bb-98bd-576954ddba79 None admin] RBAC: Adding query filter params (name=service) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:24.466117 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b5e69-3ddc-42bb-98bd-576954ddba79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:24.467516 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b5e69-3ddc-42bb-98bd-576954ddba79 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:24.476239 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 607/1236] 10.222.0.39 () {56 vars in 1103 bytes} [Tue Jul 26 04:42:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:42:24.482645 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee669c7-6b0d-4652-a4b9-20c18f28f046 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:24.576509 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:24.593378 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee669c7-6b0d-4652-a4b9-20c18f28f046 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:24.629545 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef2969-33b8-44a7-99d4-9d54aedfdc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:24.630230 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef2969-33b8-44a7-99d4-9d54aedfdc0a None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:24.630507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef2969-33b8-44a7-99d4-9d54aedfdc0a None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:24.630770 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef2969-33b8-44a7-99d4-9d54aedfdc0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:24.641064 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef2969-33b8-44a7-99d4-9d54aedfdc0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:24.642616 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef2969-33b8-44a7-99d4-9d54aedfdc0a None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:24.660339 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-acef2969-33b8-44a7-99d4-9d54aedfdc0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:42:24.660339 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:24.660339 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:24.660339 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:24.660339 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:24.660339 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:24.660339 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:24.660339 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:24.660339 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:24.660339 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:24.660339 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:24.660339 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:24.660339 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:42:24.660339 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:42:24.660339 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:42:24.661319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:42:24.661319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:24.661319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:24.661319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:24.661319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:24.661319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:24.661319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:24.661319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:24.661319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:24.661319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:24.661319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:24.661319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:24.661319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:24.661319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:24.661319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:24.661319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:24.661319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:24.662464 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:42:24.662464 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:42:24.662464 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:42:24.662464 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:42:24.662464 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 630/1237] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:42:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:42:24.667594 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b5e69-3ddc-42bb-98bd-576954ddba79 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:24.788296 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b5e69-3ddc-42bb-98bd-576954ddba79 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:24.799209 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:24.828591 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c8ec9-9b67-451f-a666-8edc45bdbfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:24.829143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c8ec9-9b67-451f-a666-8edc45bdbfdb None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:24.829423 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c8ec9-9b67-451f-a666-8edc45bdbfdb None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:24.829692 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c8ec9-9b67-451f-a666-8edc45bdbfdb None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:24.830425 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c8ec9-9b67-451f-a666-8edc45bdbfdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:24.830722 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c8ec9-9b67-451f-a666-8edc45bdbfdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:24.832229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c8ec9-9b67-451f-a666-8edc45bdbfdb None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:24.845159 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 608/1238] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:42:24.852617 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef2969-33b8-44a7-99d4-9d54aedfdc0a None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:24.962462 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef2969-33b8-44a7-99d4-9d54aedfdc0a None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:24.999578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e4498-5afb-4e0c-8398-a24b27e9fb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:25.000236 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e4498-5afb-4e0c-8398-a24b27e9fb84 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:25.000516 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e4498-5afb-4e0c-8398-a24b27e9fb84 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:25.000791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e4498-5afb-4e0c-8398-a24b27e9fb84 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:25.003752 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:25.010816 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e4498-5afb-4e0c-8398-a24b27e9fb84 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:25.012320 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e4498-5afb-4e0c-8398-a24b27e9fb84 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:25.031553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-211e4498-5afb-4e0c-8398-a24b27e9fb84 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 04:42:25.031553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:25.031553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:25.031553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:25.031553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:25.031553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:25.031553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:25.031553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:25.031553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:25.031553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:25.031553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:25.031553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:25.031553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:42:25.031553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:42:25.031553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:42:25.031553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:42:25.032829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:25.032829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:25.032829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:42:25.032829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:42:25.032829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:42:25.032829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:42:25.032829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:25.032829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:25.032829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:25.032829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:25.032829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:25.032829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:25.032829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:25.032829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:25.032829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:25.032829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:25.032829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:25.032829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:25.034113 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:25.034113 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:25.034113 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:42:25.034113 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:42:25.034113 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:42:25.034113 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:42:25.034113 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:42:25.034113 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:42:25.034113 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 04:42:25.034113 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:42:25.039762 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 631/1239] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:42:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:42:25.040857 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c8ec9-9b67-451f-a666-8edc45bdbfdb None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:25.174720 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c8ec9-9b67-451f-a666-8edc45bdbfdb None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:25.224719 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a2360-c53f-4996-8fe1-a8af25aeb54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:25.225397 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a2360-c53f-4996-8fe1-a8af25aeb54d None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:25.225671 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a2360-c53f-4996-8fe1-a8af25aeb54d None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:25.225938 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a2360-c53f-4996-8fe1-a8af25aeb54d None admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:25.226819 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a2360-c53f-4996-8fe1-a8af25aeb54d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:25.227122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a2360-c53f-4996-8fe1-a8af25aeb54d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:25.228574 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a2360-c53f-4996-8fe1-a8af25aeb54d None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:25.247126 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 609/1240] 10.222.0.39 () {56 vars in 1143 bytes} [Tue Jul 26 04:42:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:42:25.254448 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e4498-5afb-4e0c-8398-a24b27e9fb84 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:25.389809 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e4498-5afb-4e0c-8398-a24b27e9fb84 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:25.434247 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455a7c8-9ce0-4fc6-8f60-53b2b99ff913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:25.435127 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455a7c8-9ce0-4fc6-8f60-53b2b99ff913 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:25.435512 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455a7c8-9ce0-4fc6-8f60-53b2b99ff913 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:25.435981 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455a7c8-9ce0-4fc6-8f60-53b2b99ff913 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:25.508049 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:25.517632 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455a7c8-9ce0-4fc6-8f60-53b2b99ff913 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:25.519540 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455a7c8-9ce0-4fc6-8f60-53b2b99ff913 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:25.641070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 632/1241] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:42:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 04:42:25.647112 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a2360-c53f-4996-8fe1-a8af25aeb54d None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:25.678746 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:25.764457 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a2360-c53f-4996-8fe1-a8af25aeb54d None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:25.806445 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f0ba1e-0ed6-4866-b5e4-495137a85488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:25.807095 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0ba1e-0ed6-4866-b5e4-495137a85488 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:25.807374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0ba1e-0ed6-4866-b5e4-495137a85488 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:25.807649 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0ba1e-0ed6-4866-b5e4-495137a85488 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:25.819815 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f0ba1e-0ed6-4866-b5e4-495137a85488 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:25.821620 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f0ba1e-0ed6-4866-b5e4-495137a85488 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:25.839090 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-e5f0ba1e-0ed6-4866-b5e4-495137a85488 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:42:25.839090 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:25.839090 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:25.839090 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:25.839090 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:25.839090 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:25.839090 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:25.839090 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:25.839090 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:25.839090 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:25.839090 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:25.839090 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:25.839090 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:42:25.839090 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:42:25.839090 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:42:25.840308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:42:25.840308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:25.840308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:25.840308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:25.840308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:25.840308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:25.840308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:25.840308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:25.840308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:25.840308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:25.840308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:25.840308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:25.840308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:25.840308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:25.840308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:25.840308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:25.840308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:25.841269 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:42:25.841269 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:42:25.841269 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:42:25.841269 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:42:25.841269 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 610/1242] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:42:25.847695 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455a7c8-9ce0-4fc6-8f60-53b2b99ff913 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:25.961809 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:25.968831 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455a7c8-9ce0-4fc6-8f60-53b2b99ff913 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:26.008241 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ed5c0-2edf-4c76-be3e-35e3760ce9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:26.008887 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ed5c0-2edf-4c76-be3e-35e3760ce9f8 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:26.009166 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ed5c0-2edf-4c76-be3e-35e3760ce9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:26.009436 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ed5c0-2edf-4c76-be3e-35e3760ce9f8 None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:26.010178 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ed5c0-2edf-4c76-be3e-35e3760ce9f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:26.010480 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ed5c0-2edf-4c76-be3e-35e3760ce9f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:26.011883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ed5c0-2edf-4c76-be3e-35e3760ce9f8 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:26.024672 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 633/1243] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:42:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:42:26.030286 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f0ba1e-0ed6-4866-b5e4-495137a85488 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:26.120997 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:26.145626 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f0ba1e-0ed6-4866-b5e4-495137a85488 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:26.182780 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08fec4d-28a3-4231-96a3-914094b0e730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:26.183439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fec4d-28a3-4231-96a3-914094b0e730 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:26.183720 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fec4d-28a3-4231-96a3-914094b0e730 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:26.183993 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fec4d-28a3-4231-96a3-914094b0e730 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:26.191866 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08fec4d-28a3-4231-96a3-914094b0e730 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:26.193573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08fec4d-28a3-4231-96a3-914094b0e730 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:26.209263 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-f08fec4d-28a3-4231-96a3-914094b0e730 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:42:26.209263 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:26.209263 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:26.209263 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:26.209263 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:26.209263 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:26.209263 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:26.209263 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:26.209263 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:26.209263 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:26.209263 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:26.209263 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:26.209263 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:42:26.209263 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:42:26.209263 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:42:26.210439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:42:26.210439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:26.210439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:26.210439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:26.210439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:26.210439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:26.210439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:26.210439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:26.210439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:26.210439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:26.210439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:26.210439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:26.210439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:26.210439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:26.210439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:26.210439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:26.210439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:26.211585 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:42:26.211585 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:42:26.211585 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:42:26.211585 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:42:26.211585 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:42:26.211585 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:42:26.211585 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:42:26.211585 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:42:26.211585 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 611/1244] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:42:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:42:26.217071 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ed5c0-2edf-4c76-be3e-35e3760ce9f8 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:26.330358 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ed5c0-2edf-4c76-be3e-35e3760ce9f8 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:26.364763 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3290b0d-f336-47d0-840f-c6d563fcfd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:26.365431 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3290b0d-f336-47d0-840f-c6d563fcfd63 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:26.365681 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3290b0d-f336-47d0-840f-c6d563fcfd63 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:26.365950 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3290b0d-f336-47d0-840f-c6d563fcfd63 None admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:26.366746 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3290b0d-f336-47d0-840f-c6d563fcfd63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:26.367046 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3290b0d-f336-47d0-840f-c6d563fcfd63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:26.368511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3290b0d-f336-47d0-840f-c6d563fcfd63 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:26.381411 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 634/1245] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:42:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:42:26.389873 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08fec4d-28a3-4231-96a3-914094b0e730 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:26.495746 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08fec4d-28a3-4231-96a3-914094b0e730 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:26.532102 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a996cc-f571-4b2a-87d8-6fabc0a93bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:26.532718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a996cc-f571-4b2a-87d8-6fabc0a93bf0 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:26.532966 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a996cc-f571-4b2a-87d8-6fabc0a93bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:26.533247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a996cc-f571-4b2a-87d8-6fabc0a93bf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:26.534542 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a996cc-f571-4b2a-87d8-6fabc0a93bf0 None admin] RBAC: Adding query filter params (role.id=a22f1a3785a746048e38205d1996764b, scope.project.id=c4d7c29a2b144df6afa96fd6894254a4, user.id=21dfe7b4d6524ec2885224d77395b00b) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:26.534685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a996cc-f571-4b2a-87d8-6fabc0a93bf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:26.536255 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a996cc-f571-4b2a-87d8-6fabc0a93bf0 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:26.543221 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 612/1246] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:42:26 2022] GET /identity/v3/role_assignments?user.id=21dfe7b4d6524ec2885224d77395b00b&scope.project.id=c4d7c29a2b144df6afa96fd6894254a4&role.id=a22f1a3785a746048e38205d1996764b => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:42:28.743197 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8430cb4-a79d-4966-bc3d-23569f79938f None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:28.743861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8430cb4-a79d-4966-bc3d-23569f79938f None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:28.743861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8430cb4-a79d-4966-bc3d-23569f79938f None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:28.745159 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 635/1247] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:42:28.750685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60f115-263f-4aa2-afb0-ec4e8910d990 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:28.751153 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60f115-263f-4aa2-afb0-ec4e8910d990 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:28.751243 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60f115-263f-4aa2-afb0-ec4e8910d990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:28.758457 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:28.773786 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-1e60f115-263f-4aa2-afb0-ec4e8910d990 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:42:28.775292 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-1e60f115-263f-4aa2-afb0-ec4e8910d990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:42:28.847970 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 613/1248] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:42:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:42:28.870945 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8430cb4-a79d-4966-bc3d-23569f79938f None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:28.891164 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:28.984041 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8430cb4-a79d-4966-bc3d-23569f79938f None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:29.022384 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb0e84-6b39-4688-adfe-2bc781df1d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:29.022961 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb0e84-6b39-4688-adfe-2bc781df1d86 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:29.023243 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb0e84-6b39-4688-adfe-2bc781df1d86 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:29.023598 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb0e84-6b39-4688-adfe-2bc781df1d86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:29.035474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb0e84-6b39-4688-adfe-2bc781df1d86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:42:29.041056 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-befb0e84-6b39-4688-adfe-2bc781df1d86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:42:29.041056 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:29.041056 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:29.041056 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:29.041056 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:29.041056 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:29.041056 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:29.041056 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:29.041056 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:29.041056 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:29.041056 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:29.041056 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:29.041056 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:42:29.041056 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:42:29.041056 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:42:29.041056 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:42:29.042437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:42:29.042437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:42:29.042437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:42:29.042437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:42:29.042437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:29.042437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:29.042437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:29.042437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:29.042437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:29.042437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:29.042437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:29.042437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:29.042437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:29.042437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:29.042437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:29.042437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:29.043345 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:29.043345 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:29.043345 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:29.043345 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:29.043345 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:42:29.043345 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:42:29.043345 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:42:29.043345 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:42:29.043345 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:42:29.043345 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:42:29.043345 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:42:29.043345 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:42:29.043345 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 636/1249] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:42:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:42:29.048821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60f115-263f-4aa2-afb0-ec4e8910d990 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:29.172518 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60f115-263f-4aa2-afb0-ec4e8910d990 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:29.208112 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:29.213715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b19402-d7b0-445c-8b53-fecaa279691d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:29.214384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b19402-d7b0-445c-8b53-fecaa279691d None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:29.214662 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b19402-d7b0-445c-8b53-fecaa279691d None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:29.214983 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b19402-d7b0-445c-8b53-fecaa279691d None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:29.215664 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b19402-d7b0-445c-8b53-fecaa279691d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:29.215959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b19402-d7b0-445c-8b53-fecaa279691d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:29.217378 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b19402-d7b0-445c-8b53-fecaa279691d None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:29.226603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 614/1250] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:42:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:42:29.233232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb0e84-6b39-4688-adfe-2bc781df1d86 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:29.319783 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:29.353063 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb0e84-6b39-4688-adfe-2bc781df1d86 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:29.402301 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6274f5-57a6-4328-9eca-ee2be543f118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:29.403243 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6274f5-57a6-4328-9eca-ee2be543f118 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:29.403709 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6274f5-57a6-4328-9eca-ee2be543f118 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:29.404352 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6274f5-57a6-4328-9eca-ee2be543f118 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:29.417707 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6274f5-57a6-4328-9eca-ee2be543f118 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:29.419243 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6274f5-57a6-4328-9eca-ee2be543f118 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:29.438568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-ea6274f5-57a6-4328-9eca-ee2be543f118 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:42:29.438568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:29.438568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:29.438568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:29.438568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:29.438568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:29.438568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:29.438568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:29.438568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:29.438568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:29.438568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:29.438568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:29.438568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:42:29.438568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:42:29.438568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:42:29.440114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:42:29.440114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:29.440114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:29.440114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:29.440114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:29.440114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:29.440114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:29.440114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:29.440114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:29.440114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:29.440114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:29.440114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:29.440114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:29.440114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:29.440114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:29.440114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:29.440114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:29.441111 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:42:29.441111 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:42:29.441111 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:42:29.441111 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:42:29.441111 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 637/1251] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:42:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:42:29.447276 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b19402-d7b0-445c-8b53-fecaa279691d None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:29.551156 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b19402-d7b0-445c-8b53-fecaa279691d None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:29.589090 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef98f0-902f-4625-a129-a853aa3d8adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:29.589748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef98f0-902f-4625-a129-a853aa3d8adb None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:29.590055 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef98f0-902f-4625-a129-a853aa3d8adb None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:29.590327 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ef98f0-902f-4625-a129-a853aa3d8adb None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:29.591026 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef98f0-902f-4625-a129-a853aa3d8adb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:29.591326 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef98f0-902f-4625-a129-a853aa3d8adb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:29.592696 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ef98f0-902f-4625-a129-a853aa3d8adb None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:29.606324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 615/1252] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:42:29.612465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6274f5-57a6-4328-9eca-ee2be543f118 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:29.733804 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6274f5-57a6-4328-9eca-ee2be543f118 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:29.760625 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:29.770392 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f2fce-4dba-47a2-832f-19881c401835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:29.771137 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f2fce-4dba-47a2-832f-19881c401835 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:29.771465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f2fce-4dba-47a2-832f-19881c401835 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:29.771736 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f2fce-4dba-47a2-832f-19881c401835 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:29.782745 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f2fce-4dba-47a2-832f-19881c401835 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:29.783092 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f2fce-4dba-47a2-832f-19881c401835 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:29.797553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-2a5f2fce-4dba-47a2-832f-19881c401835 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 04:42:29.797553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:29.797553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:29.797553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:29.797553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:29.797553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:29.797553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:29.797553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:29.797553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:29.797553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:29.797553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:29.797553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:29.797553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:42:29.797553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:42:29.797553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:42:29.797553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:42:29.798810 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:29.798810 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:29.798810 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:42:29.798810 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:42:29.798810 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:42:29.798810 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:42:29.798810 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:29.798810 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:29.798810 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:29.798810 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:29.798810 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:29.798810 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:29.798810 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:29.798810 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:29.798810 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:29.798810 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:29.798810 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:29.798810 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:29.799848 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:29.799848 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:29.799848 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:42:29.799848 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:42:29.799848 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:42:29.799848 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:42:29.799848 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:42:29.799848 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:42:29.799848 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 04:42:29.799848 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:42:29.799848 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 638/1253] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:42:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:42:29.806053 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef98f0-902f-4625-a129-a853aa3d8adb None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:29.868654 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:29.921069 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ef98f0-902f-4625-a129-a853aa3d8adb None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:29.964640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5e110-4d7a-4b21-bbe5-f2f2c767afd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:29.965524 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5e110-4d7a-4b21-bbe5-f2f2c767afd5 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:29.965840 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5e110-4d7a-4b21-bbe5-f2f2c767afd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:29.966145 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5e110-4d7a-4b21-bbe5-f2f2c767afd5 None admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:29.967210 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5e110-4d7a-4b21-bbe5-f2f2c767afd5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:29.967564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5e110-4d7a-4b21-bbe5-f2f2c767afd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:29.969186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5e110-4d7a-4b21-bbe5-f2f2c767afd5 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:29.989909 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 616/1254] 10.222.0.39 () {56 vars in 1143 bytes} [Tue Jul 26 04:42:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:42:29.996445 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f2fce-4dba-47a2-832f-19881c401835 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:30.131843 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f2fce-4dba-47a2-832f-19881c401835 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:30.170909 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9bfff-83b3-4c93-9c87-2a883b299a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:30.171544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9bfff-83b3-4c93-9c87-2a883b299a62 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:30.171827 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9bfff-83b3-4c93-9c87-2a883b299a62 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:30.172101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9bfff-83b3-4c93-9c87-2a883b299a62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:30.230807 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:30.246227 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec9bfff-83b3-4c93-9c87-2a883b299a62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:30.247801 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec9bfff-83b3-4c93-9c87-2a883b299a62 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:30.369924 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 639/1255] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:42:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 04:42:30.376131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5e110-4d7a-4b21-bbe5-f2f2c767afd5 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:30.487628 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5e110-4d7a-4b21-bbe5-f2f2c767afd5 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:30.502665 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:30.525508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ce1db-c1ab-4711-84fd-ad1108398a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:30.526330 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ce1db-c1ab-4711-84fd-ad1108398a29 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:30.526612 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ce1db-c1ab-4711-84fd-ad1108398a29 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:30.526891 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ce1db-c1ab-4711-84fd-ad1108398a29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:30.537910 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ce1db-c1ab-4711-84fd-ad1108398a29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:30.539380 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ce1db-c1ab-4711-84fd-ad1108398a29 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:30.554134 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-5b6ce1db-c1ab-4711-84fd-ad1108398a29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:42:30.554134 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:30.554134 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:30.554134 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:30.554134 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:30.554134 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:30.554134 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:30.554134 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:30.554134 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:30.554134 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:30.554134 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:30.554134 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:30.554134 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:42:30.554134 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:42:30.554134 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:42:30.555573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:42:30.555573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:30.555573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:30.555573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:30.555573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:30.555573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:30.555573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:30.555573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:30.555573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:30.555573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:30.555573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:30.555573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:30.555573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:30.555573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:30.555573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:30.555573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:30.555573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:30.556486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:42:30.556486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:42:30.556486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:42:30.556486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:42:30.556486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 617/1256] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:42:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:42:30.561684 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9bfff-83b3-4c93-9c87-2a883b299a62 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:30.665230 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:30.679979 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9bfff-83b3-4c93-9c87-2a883b299a62 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:30.719981 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ad749-c623-40e2-bd41-eb3374d23cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:30.720635 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ad749-c623-40e2-bd41-eb3374d23cbe None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:30.720916 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ad749-c623-40e2-bd41-eb3374d23cbe None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:30.721283 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ad749-c623-40e2-bd41-eb3374d23cbe None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:30.722001 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ad749-c623-40e2-bd41-eb3374d23cbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:30.722311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ad749-c623-40e2-bd41-eb3374d23cbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:30.723842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ad749-c623-40e2-bd41-eb3374d23cbe None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:30.741281 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 640/1257] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:42:30.742994 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ce1db-c1ab-4711-84fd-ad1108398a29 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:30.857775 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ce1db-c1ab-4711-84fd-ad1108398a29 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:30.898329 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a965809-88f2-404a-947c-186d44061dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:30.898983 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a965809-88f2-404a-947c-186d44061dc4 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:30.899324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a965809-88f2-404a-947c-186d44061dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:30.899693 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a965809-88f2-404a-947c-186d44061dc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:30.907357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a965809-88f2-404a-947c-186d44061dc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:30.909271 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a965809-88f2-404a-947c-186d44061dc4 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:30.924258 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-8a965809-88f2-404a-947c-186d44061dc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:42:30.924258 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:30.924258 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:30.924258 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:30.924258 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:30.924258 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:30.924258 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:30.924258 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:30.924258 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:30.924258 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:30.924258 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:30.924258 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:30.924258 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:42:30.924258 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:42:30.924258 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:42:30.925576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:42:30.925576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:30.925576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:30.925576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:30.925576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:30.925576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:30.925576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:30.925576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:30.925576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:30.925576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:30.925576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:30.925576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:30.925576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:30.925576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:30.925576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:30.925576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:30.925576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:30.926591 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:42:30.926591 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:42:30.926591 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:42:30.926591 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:42:30.926591 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:42:30.926591 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:42:30.926591 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:42:30.926591 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:42:30.926591 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 618/1258] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:42:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:42:30.932510 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ad749-c623-40e2-bd41-eb3374d23cbe None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:31.063156 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ad749-c623-40e2-bd41-eb3374d23cbe None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:31.101058 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade491c0-773b-4fd4-9c3e-61c804a924c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:31.101700 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade491c0-773b-4fd4-9c3e-61c804a924c5 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:31.102003 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade491c0-773b-4fd4-9c3e-61c804a924c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:31.102270 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade491c0-773b-4fd4-9c3e-61c804a924c5 None admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:31.103040 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade491c0-773b-4fd4-9c3e-61c804a924c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:31.103342 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade491c0-773b-4fd4-9c3e-61c804a924c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:31.104839 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade491c0-773b-4fd4-9c3e-61c804a924c5 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:31.118451 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 641/1259] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:42:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:42:31.125938 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a965809-88f2-404a-947c-186d44061dc4 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:31.157562 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:31.247082 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a965809-88f2-404a-947c-186d44061dc4 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:31.291299 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca9e89-1a41-45d5-a5d8-d3e847b3435f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:31.292011 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca9e89-1a41-45d5-a5d8-d3e847b3435f None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:31.292425 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca9e89-1a41-45d5-a5d8-d3e847b3435f None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:31.292734 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca9e89-1a41-45d5-a5d8-d3e847b3435f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:31.293851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca9e89-1a41-45d5-a5d8-d3e847b3435f None admin] RBAC: Adding query filter params (role.id=2bfdd65b06554a6da967b3939da753c7, scope.project.id=c4d7c29a2b144df6afa96fd6894254a4, user.id=21dfe7b4d6524ec2885224d77395b00b) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:31.294269 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca9e89-1a41-45d5-a5d8-d3e847b3435f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:31.296006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca9e89-1a41-45d5-a5d8-d3e847b3435f None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:31.302474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 619/1260] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:42:31 2022] GET /identity/v3/role_assignments?user.id=21dfe7b4d6524ec2885224d77395b00b&scope.project.id=c4d7c29a2b144df6afa96fd6894254a4&role.id=2bfdd65b06554a6da967b3939da753c7 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:42:33.267376 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40f459-d2d3-407b-a77d-ea8f8de34c70 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:33.267932 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40f459-d2d3-407b-a77d-ea8f8de34c70 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:33.267932 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40f459-d2d3-407b-a77d-ea8f8de34c70 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:33.269325 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 642/1261] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:42:33.274813 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896cd20-fa9d-4a7c-9f08-424549d745af None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:33.275292 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896cd20-fa9d-4a7c-9f08-424549d745af None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:33.275393 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896cd20-fa9d-4a7c-9f08-424549d745af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:33.294800 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-9896cd20-fa9d-4a7c-9f08-424549d745af None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:42:33.295993 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-9896cd20-fa9d-4a7c-9f08-424549d745af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:42:33.367015 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 620/1262] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:42:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:42:33.389170 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40f459-d2d3-407b-a77d-ea8f8de34c70 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:33.400816 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:33.496837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40f459-d2d3-407b-a77d-ea8f8de34c70 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:33.532509 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee432e-0b06-489d-bd50-ac42f927de6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:33.533064 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee432e-0b06-489d-bd50-ac42f927de6c None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:33.533368 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee432e-0b06-489d-bd50-ac42f927de6c None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:33.533645 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee432e-0b06-489d-bd50-ac42f927de6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:33.544385 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee432e-0b06-489d-bd50-ac42f927de6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:42:33.549342 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-25ee432e-0b06-489d-bd50-ac42f927de6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:42:33.549342 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:33.549342 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:33.549342 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:33.549342 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:33.549342 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:33.549342 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:33.549342 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:33.549342 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:33.549342 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:33.549342 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:33.549342 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:33.549342 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:42:33.549342 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:42:33.549342 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:42:33.549342 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:42:33.550465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:42:33.550465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:42:33.550465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:42:33.550465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:42:33.550465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:33.550465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:33.550465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:33.550465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:33.550465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:33.550465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:33.550465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:33.550465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:33.550465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:33.550465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:33.550465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:33.550465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:33.551352 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:33.551352 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:33.551352 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:33.551352 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:33.551352 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:42:33.551352 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:42:33.551352 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:42:33.551352 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:42:33.551352 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:42:33.551352 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:42:33.551352 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:42:33.551352 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:42:33.551352 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 643/1263] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:42:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:42:33.557074 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896cd20-fa9d-4a7c-9f08-424549d745af None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:33.575999 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:33.659734 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896cd20-fa9d-4a7c-9f08-424549d745af None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:33.695220 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043f254-8c70-4918-9844-dc60cafe1f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:33.695837 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043f254-8c70-4918-9844-dc60cafe1f2e None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:33.696114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043f254-8c70-4918-9844-dc60cafe1f2e None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:33.696385 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043f254-8c70-4918-9844-dc60cafe1f2e None admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:33.697097 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043f254-8c70-4918-9844-dc60cafe1f2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:33.697397 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043f254-8c70-4918-9844-dc60cafe1f2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:33.698809 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043f254-8c70-4918-9844-dc60cafe1f2e None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:33.708261 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 621/1264] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:42:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:42:33.714331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee432e-0b06-489d-bd50-ac42f927de6c None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:33.784607 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:33.822919 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee432e-0b06-489d-bd50-ac42f927de6c None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:33.858647 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc83e21-9bda-4e04-8c9a-dda4f8276614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:33.859292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc83e21-9bda-4e04-8c9a-dda4f8276614 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:33.859565 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc83e21-9bda-4e04-8c9a-dda4f8276614 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:33.859836 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc83e21-9bda-4e04-8c9a-dda4f8276614 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:33.870117 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc83e21-9bda-4e04-8c9a-dda4f8276614 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:33.871592 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc83e21-9bda-4e04-8c9a-dda4f8276614 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:33.886282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-6cc83e21-9bda-4e04-8c9a-dda4f8276614 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:42:33.886282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:33.886282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:33.886282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:33.886282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:33.886282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:33.886282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:33.886282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:33.886282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:33.886282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:33.886282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:33.886282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:33.886282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:42:33.886282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:42:33.886282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:42:33.887324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:42:33.887324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:33.887324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:33.887324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:33.887324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:33.887324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:33.887324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:33.887324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:33.887324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:33.887324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:33.887324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:33.887324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:33.887324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:33.887324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:33.887324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:33.887324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:33.887324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:33.888259 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:42:33.888259 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:42:33.888259 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:42:33.888259 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:42:33.888259 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 644/1265] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:42:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:42:33.893580 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043f254-8c70-4918-9844-dc60cafe1f2e None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:33.980904 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:34.002524 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043f254-8c70-4918-9844-dc60cafe1f2e None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:34.042851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d526d-4f0a-4858-832e-cdc4f75eca6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:34.043631 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d526d-4f0a-4858-832e-cdc4f75eca6f None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:34.044096 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d526d-4f0a-4858-832e-cdc4f75eca6f None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:34.044380 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d526d-4f0a-4858-832e-cdc4f75eca6f None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:34.045382 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d526d-4f0a-4858-832e-cdc4f75eca6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:34.045821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d526d-4f0a-4858-832e-cdc4f75eca6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:34.047721 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d526d-4f0a-4858-832e-cdc4f75eca6f None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:34.065408 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 622/1266] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:42:34.073604 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc83e21-9bda-4e04-8c9a-dda4f8276614 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:34.178396 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc83e21-9bda-4e04-8c9a-dda4f8276614 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:34.198538 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:34.213513 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0be30-7d97-43e4-948e-cd838eb7bf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:34.214189 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0be30-7d97-43e4-948e-cd838eb7bf23 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:34.214467 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0be30-7d97-43e4-948e-cd838eb7bf23 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:34.214734 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0be30-7d97-43e4-948e-cd838eb7bf23 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:34.223422 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a0be30-7d97-43e4-948e-cd838eb7bf23 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:34.224894 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a0be30-7d97-43e4-948e-cd838eb7bf23 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:34.236261 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-47a0be30-7d97-43e4-948e-cd838eb7bf23 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 04:42:34.236261 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:34.236261 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:34.236261 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:34.236261 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:34.236261 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:34.236261 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:34.236261 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:34.236261 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:34.236261 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:34.236261 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:34.236261 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:34.236261 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:42:34.236261 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:42:34.236261 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:42:34.236261 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:42:34.237474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:34.237474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:34.237474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:42:34.237474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:42:34.237474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:42:34.237474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:42:34.237474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:34.237474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:34.237474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:34.237474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:34.237474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:34.237474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:34.237474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:34.237474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:34.237474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:34.237474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:34.237474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:34.237474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:34.238712 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:34.238712 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:34.238712 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:42:34.238712 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:42:34.238712 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:42:34.238712 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:42:34.238712 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:42:34.238712 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:42:34.238712 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 04:42:34.238712 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:42:34.238712 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 645/1267] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:42:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:42:34.243456 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d526d-4f0a-4858-832e-cdc4f75eca6f None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:34.360030 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d526d-4f0a-4858-832e-cdc4f75eca6f None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:34.396849 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cd064-86f3-40c0-ba41-321a0d261768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:34.397483 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cd064-86f3-40c0-ba41-321a0d261768 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:34.397765 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cd064-86f3-40c0-ba41-321a0d261768 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:34.398037 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cd064-86f3-40c0-ba41-321a0d261768 None admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:34.398873 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cd064-86f3-40c0-ba41-321a0d261768 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:34.399177 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cd064-86f3-40c0-ba41-321a0d261768 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:34.400639 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cd064-86f3-40c0-ba41-321a0d261768 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:34.410323 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:34.419407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 623/1268] 10.222.0.39 () {56 vars in 1143 bytes} [Tue Jul 26 04:42:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:42:34.425431 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0be30-7d97-43e4-948e-cd838eb7bf23 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:34.533421 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0be30-7d97-43e4-948e-cd838eb7bf23 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:34.569105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77efe1-039d-4127-a57a-e29fc3b45029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:34.569748 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77efe1-039d-4127-a57a-e29fc3b45029 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:34.570015 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77efe1-039d-4127-a57a-e29fc3b45029 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:34.570327 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77efe1-039d-4127-a57a-e29fc3b45029 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:34.581967 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77efe1-039d-4127-a57a-e29fc3b45029 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:34.583495 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77efe1-039d-4127-a57a-e29fc3b45029 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:34.598892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-0b77efe1-039d-4127-a57a-e29fc3b45029 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:42:34.598892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:34.598892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:34.598892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:34.598892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:34.598892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:34.598892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:34.598892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:34.598892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:34.598892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:34.598892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:34.598892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:34.598892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:42:34.598892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:42:34.598892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:42:34.600014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:42:34.600014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:34.600014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:34.600014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:34.600014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:34.600014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:34.600014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:34.600014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:34.600014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:34.600014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:34.600014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:34.600014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:34.600014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:34.600014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:34.600014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:34.600014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:34.600014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:34.601081 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:42:34.601081 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:42:34.601081 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:42:34.601081 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:42:34.601081 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 646/1269] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:42:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:42:34.606123 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cd064-86f3-40c0-ba41-321a0d261768 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:34.730461 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cd064-86f3-40c0-ba41-321a0d261768 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:34.769096 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b000ed7-b8d2-43b0-985d-c3435ae3bada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:34.769718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b000ed7-b8d2-43b0-985d-c3435ae3bada None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:34.770021 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b000ed7-b8d2-43b0-985d-c3435ae3bada None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:34.770288 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b000ed7-b8d2-43b0-985d-c3435ae3bada None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:34.770988 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b000ed7-b8d2-43b0-985d-c3435ae3bada None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:34.771255 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b000ed7-b8d2-43b0-985d-c3435ae3bada None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:34.772653 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b000ed7-b8d2-43b0-985d-c3435ae3bada None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:34.784937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 624/1270] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:42:34.790952 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77efe1-039d-4127-a57a-e29fc3b45029 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:34.824033 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:34.896518 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77efe1-039d-4127-a57a-e29fc3b45029 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:34.931767 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a664d-5e6a-4a71-ad22-11385a2eebe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:34.932404 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a664d-5e6a-4a71-ad22-11385a2eebe3 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:34.932682 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a664d-5e6a-4a71-ad22-11385a2eebe3 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:34.932940 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a664d-5e6a-4a71-ad22-11385a2eebe3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:34.940056 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a664d-5e6a-4a71-ad22-11385a2eebe3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:34.941483 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a664d-5e6a-4a71-ad22-11385a2eebe3 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:34.952887 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-327a664d-5e6a-4a71-ad22-11385a2eebe3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:42:34.952887 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:34.952887 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:34.952887 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:34.952887 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:34.952887 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:34.952887 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:34.952887 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:34.952887 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:34.952887 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:34.952887 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:34.952887 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:34.952887 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:42:34.952887 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:42:34.952887 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:42:34.953911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:42:34.953911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:34.953911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:34.953911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:34.953911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:34.953911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:34.953911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:34.953911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:34.953911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:34.953911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:34.953911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:34.953911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:34.953911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:34.953911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:34.953911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:34.953911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:34.953911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:34.954955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:42:34.954955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:42:34.954955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:42:34.954955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:42:34.954955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:42:34.954955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:42:34.954955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:42:34.954955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:42:34.954955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 647/1271] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:42:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:42:34.960217 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b000ed7-b8d2-43b0-985d-c3435ae3bada None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:35.027410 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:35.076895 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b000ed7-b8d2-43b0-985d-c3435ae3bada None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:35.112721 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9e2fe-a139-494b-aa6f-5bd6d373659c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:35.113343 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9e2fe-a139-494b-aa6f-5bd6d373659c None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:35.113622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9e2fe-a139-494b-aa6f-5bd6d373659c None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:35.113889 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9e2fe-a139-494b-aa6f-5bd6d373659c None admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:35.114676 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9e2fe-a139-494b-aa6f-5bd6d373659c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:35.114979 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9e2fe-a139-494b-aa6f-5bd6d373659c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:35.116429 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9e2fe-a139-494b-aa6f-5bd6d373659c None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:35.129808 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 625/1272] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:42:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:42:35.136179 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a664d-5e6a-4a71-ad22-11385a2eebe3 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:35.232596 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:35.243075 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a664d-5e6a-4a71-ad22-11385a2eebe3 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:35.278198 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa91c7-1b62-4189-90f6-e85bf6c2cae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:35.278791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa91c7-1b62-4189-90f6-e85bf6c2cae3 None admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:35.279065 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa91c7-1b62-4189-90f6-e85bf6c2cae3 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:35.279337 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa91c7-1b62-4189-90f6-e85bf6c2cae3 None admin] PATH_INFO: `/v3/projects/c4d7c29a2b144df6afa96fd6894254a4/users/21dfe7b4d6524ec2885224d77395b00b/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:35.281406 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa91c7-1b62-4189-90f6-e85bf6c2cae3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4d7c29a2b144df6afa96fd6894254a4, user_id=21dfe7b4d6524ec2885224d77395b00b, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:35.283467 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa91c7-1b62-4189-90f6-e85bf6c2cae3 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:35.302413 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 648/1273] 10.222.0.39 () {58 vars in 1439 bytes} [Tue Jul 26 04:42:35 2022] PUT /identity/v3/projects/c4d7c29a2b144df6afa96fd6894254a4/users/21dfe7b4d6524ec2885224d77395b00b/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:42:37.285813 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb62a0b-f2b9-47ce-8362-d16baad09cd1 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:37.286313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb62a0b-f2b9-47ce-8362-d16baad09cd1 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:37.286431 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb62a0b-f2b9-47ce-8362-d16baad09cd1 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:37.287835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 626/1274] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:42:37.293808 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a02776-0546-41a4-aee8-d85ae5e66b84 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:37.294326 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a02776-0546-41a4-aee8-d85ae5e66b84 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:37.294420 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a02776-0546-41a4-aee8-d85ae5e66b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:37.314543 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-17a02776-0546-41a4-aee8-d85ae5e66b84 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:42:37.315750 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-17a02776-0546-41a4-aee8-d85ae5e66b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:42:37.388928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 649/1275] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:42:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:42:37.412192 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb62a0b-f2b9-47ce-8362-d16baad09cd1 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:37.524826 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb62a0b-f2b9-47ce-8362-d16baad09cd1 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:37.542798 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:37.561310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522f486-e268-4b9f-b76a-b69ec66dde1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:37.561997 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522f486-e268-4b9f-b76a-b69ec66dde1b None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:37.562284 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522f486-e268-4b9f-b76a-b69ec66dde1b None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:37.562550 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522f486-e268-4b9f-b76a-b69ec66dde1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:37.574239 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522f486-e268-4b9f-b76a-b69ec66dde1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 26 04:42:37.579185 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-e522f486-e268-4b9f-b76a-b69ec66dde1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:42:37.579185 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:37.579185 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:37.579185 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:37.579185 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:37.579185 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:37.579185 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:37.579185 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:37.579185 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:37.579185 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:37.579185 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:37.579185 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:37.579185 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 26 04:42:37.579185 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 26 04:42:37.579185 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 26 04:42:37.579185 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 26 04:42:37.580377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 26 04:42:37.580377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 26 04:42:37.580377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 26 04:42:37.580377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 26 04:42:37.580377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:37.580377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:37.580377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:37.580377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:37.580377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:37.580377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:37.580377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:37.580377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:37.580377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:37.580377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:37.580377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:37.580377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:37.581395 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:37.581395 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:37.581395 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:37.581395 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:37.581395 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 26 04:42:37.581395 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 26 04:42:37.581395 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 26 04:42:37.581395 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 26 04:42:37.581395 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 26 04:42:37.581395 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 26 04:42:37.581395 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 26 04:42:37.581395 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:42:37.581395 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 627/1276] 10.222.0.39 () {56 vars in 1096 bytes} [Tue Jul 26 04:42:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:42:37.586732 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a02776-0546-41a4-aee8-d85ae5e66b84 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:37.670554 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:37.691180 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a02776-0546-41a4-aee8-d85ae5e66b84 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:37.728565 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58224b86-a685-4381-984e-8e09205f2972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:37.729184 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58224b86-a685-4381-984e-8e09205f2972 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:37.729463 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58224b86-a685-4381-984e-8e09205f2972 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:37.729737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58224b86-a685-4381-984e-8e09205f2972 None admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:37.730488 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58224b86-a685-4381-984e-8e09205f2972 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:37.730790 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58224b86-a685-4381-984e-8e09205f2972 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:37.732196 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58224b86-a685-4381-984e-8e09205f2972 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:37.740385 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 650/1277] 10.222.0.39 () {56 vars in 1099 bytes} [Tue Jul 26 04:42:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:42:37.746347 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522f486-e268-4b9f-b76a-b69ec66dde1b None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:37.851131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522f486-e268-4b9f-b76a-b69ec66dde1b None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:37.885627 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f58023-dc14-4985-b6e9-6ef584528242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:37.886301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f58023-dc14-4985-b6e9-6ef584528242 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:37.886577 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f58023-dc14-4985-b6e9-6ef584528242 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:37.886851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f58023-dc14-4985-b6e9-6ef584528242 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:37.897938 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f58023-dc14-4985-b6e9-6ef584528242 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:37.899416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f58023-dc14-4985-b6e9-6ef584528242 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:37.913906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-f4f58023-dc14-4985-b6e9-6ef584528242 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:42:37.913906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:37.913906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:37.913906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:37.913906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:37.913906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:37.913906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:37.913906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:37.913906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:37.913906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:37.913906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:37.913906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:37.913906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:42:37.913906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:42:37.913906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:42:37.914916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:42:37.914916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:37.914916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:37.914916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:37.914916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:37.914916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:37.914916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:37.914916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:37.914916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:37.914916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:37.914916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:37.914916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:37.914916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:37.914916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:37.914916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:37.914916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:37.914916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:37.916252 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:42:37.916252 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:42:37.916252 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:42:37.916252 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:42:37.916252 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 628/1278] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:42:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:42:37.921134 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58224b86-a685-4381-984e-8e09205f2972 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:38.033881 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58224b86-a685-4381-984e-8e09205f2972 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:38.076570 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e60170-6ed7-43be-9544-a9d34b38dfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:38.077182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e60170-6ed7-43be-9544-a9d34b38dfc9 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:38.077437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e60170-6ed7-43be-9544-a9d34b38dfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:38.077727 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e60170-6ed7-43be-9544-a9d34b38dfc9 None admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:38.078448 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e60170-6ed7-43be-9544-a9d34b38dfc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:38.078747 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e60170-6ed7-43be-9544-a9d34b38dfc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:38.080205 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e60170-6ed7-43be-9544-a9d34b38dfc9 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:38.092024 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 651/1279] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:42:38.098011 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f58023-dc14-4985-b6e9-6ef584528242 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:38.132215 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:38.205726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f58023-dc14-4985-b6e9-6ef584528242 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:38.241414 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131d4a4-a34a-4aee-b714-b0c730509ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:38.242087 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131d4a4-a34a-4aee-b714-b0c730509ac5 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:38.242366 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131d4a4-a34a-4aee-b714-b0c730509ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:38.242633 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131d4a4-a34a-4aee-b714-b0c730509ac5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:38.250347 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131d4a4-a34a-4aee-b714-b0c730509ac5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:38.251832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131d4a4-a34a-4aee-b714-b0c730509ac5 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:38.262973 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-6131d4a4-a34a-4aee-b714-b0c730509ac5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 26 04:42:38.262973 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:38.262973 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:38.262973 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:38.262973 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:38.262973 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:38.262973 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:38.262973 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:38.262973 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:38.262973 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:38.262973 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:38.262973 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:38.262973 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 26 04:42:38.262973 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 26 04:42:38.262973 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 26 04:42:38.262973 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 26 04:42:38.264131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:38.264131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:38.264131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 26 04:42:38.264131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:42:38.264131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 26 04:42:38.264131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 26 04:42:38.264131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:38.264131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:38.264131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:38.264131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:38.264131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:38.264131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:38.264131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:38.264131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:38.264131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:38.264131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:38.264131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:38.264131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:38.265324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:38.265324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:38.265324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 26 04:42:38.265324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 26 04:42:38.265324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 26 04:42:38.265324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 26 04:42:38.265324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 26 04:42:38.265324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 26 04:42:38.265324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 26 04:42:38.265324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:42:38.265324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 629/1280] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:42:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:42:38.270823 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e60170-6ed7-43be-9544-a9d34b38dfc9 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:38.274902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:38.380878 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e60170-6ed7-43be-9544-a9d34b38dfc9 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:38.420916 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265eb21-291c-4c31-92bb-092f53f287a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:38.421450 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265eb21-291c-4c31-92bb-092f53f287a6 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:38.421728 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265eb21-291c-4c31-92bb-092f53f287a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:38.422022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265eb21-291c-4c31-92bb-092f53f287a6 None admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:38.422825 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265eb21-291c-4c31-92bb-092f53f287a6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:38.423139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265eb21-291c-4c31-92bb-092f53f287a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:38.424598 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265eb21-291c-4c31-92bb-092f53f287a6 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:38.442050 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 652/1281] 10.222.0.39 () {56 vars in 1143 bytes} [Tue Jul 26 04:42:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:42:38.448174 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131d4a4-a34a-4aee-b714-b0c730509ac5 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:38.544683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:38.556331 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131d4a4-a34a-4aee-b714-b0c730509ac5 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:38.591085 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce90cb6-6838-47f3-ba24-ff647b60d3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:38.591707 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce90cb6-6838-47f3-ba24-ff647b60d3b1 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:38.591983 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce90cb6-6838-47f3-ba24-ff647b60d3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:38.592248 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce90cb6-6838-47f3-ba24-ff647b60d3b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:38.663075 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce90cb6-6838-47f3-ba24-ff647b60d3b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:38.664539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce90cb6-6838-47f3-ba24-ff647b60d3b1 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:38.763314 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:38.775112 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 630/1282] 10.222.0.39 () {58 vars in 1282 bytes} [Tue Jul 26 04:42:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 26 04:42:38.781385 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265eb21-291c-4c31-92bb-092f53f287a6 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:38.847927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:38.887083 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265eb21-291c-4c31-92bb-092f53f287a6 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:38.921599 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea63ba7-23d9-4b45-b5d9-8952f39c522f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:38.922264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea63ba7-23d9-4b45-b5d9-8952f39c522f None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:38.922545 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea63ba7-23d9-4b45-b5d9-8952f39c522f None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:38.922814 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea63ba7-23d9-4b45-b5d9-8952f39c522f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:38.933365 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea63ba7-23d9-4b45-b5d9-8952f39c522f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:38.934863 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea63ba7-23d9-4b45-b5d9-8952f39c522f None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:38.950260 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-9ea63ba7-23d9-4b45-b5d9-8952f39c522f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:42:38.950260 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:38.950260 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:38.950260 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:38.950260 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:38.950260 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:38.950260 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:38.950260 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:38.950260 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:38.950260 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:38.950260 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:38.950260 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:38.950260 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 26 04:42:38.950260 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 26 04:42:38.950260 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 26 04:42:38.951399 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 26 04:42:38.951399 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:38.951399 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:38.951399 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:38.951399 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:38.951399 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:38.951399 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:38.951399 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:38.951399 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:38.951399 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:38.951399 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:38.951399 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:38.951399 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:38.951399 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:38.951399 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:38.951399 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:38.951399 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:38.952482 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 26 04:42:38.952482 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 26 04:42:38.952482 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 26 04:42:38.952482 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:42:38.952482 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 653/1283] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:42:38.957907 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce90cb6-6838-47f3-ba24-ff647b60d3b1 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:39.066014 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce90cb6-6838-47f3-ba24-ff647b60d3b1 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:39.103218 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b6a34-9286-4b62-b6e3-d8f484bcae75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:39.103848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b6a34-9286-4b62-b6e3-d8f484bcae75 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:39.104128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b6a34-9286-4b62-b6e3-d8f484bcae75 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:39.104401 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b6a34-9286-4b62-b6e3-d8f484bcae75 None admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:39.105097 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b6a34-9286-4b62-b6e3-d8f484bcae75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:39.105402 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b6a34-9286-4b62-b6e3-d8f484bcae75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:39.106823 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b6a34-9286-4b62-b6e3-d8f484bcae75 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:39.118770 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 631/1284] 10.222.0.39 () {56 vars in 1109 bytes} [Tue Jul 26 04:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:42:39.124729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea63ba7-23d9-4b45-b5d9-8952f39c522f None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:39.228307 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea63ba7-23d9-4b45-b5d9-8952f39c522f None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:39.242048 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:39.265500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7294de7-6963-473c-af62-069b741476d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:39.266212 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7294de7-6963-473c-af62-069b741476d8 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:39.266496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7294de7-6963-473c-af62-069b741476d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:39.266772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7294de7-6963-473c-af62-069b741476d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:39.274862 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7294de7-6963-473c-af62-069b741476d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:39.276360 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7294de7-6963-473c-af62-069b741476d8 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:39.289600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application [None req-a7294de7-6963-473c-af62-069b741476d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:42:39.289600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:39.289600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:39.289600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:39.289600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:39.289600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:39.289600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:39.289600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:39.289600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:39.289600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:39.289600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:39.289600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:39.289600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 26 04:42:39.289600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 26 04:42:39.289600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 26 04:42:39.290680 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 26 04:42:39.290680 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:39.290680 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:39.290680 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:39.290680 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:39.290680 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:39.290680 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:39.290680 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:39.290680 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:39.290680 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:39.290680 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:39.290680 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:39.290680 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:39.290680 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:39.290680 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:39.290680 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:39.290680 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:39.291700 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 26 04:42:39.291700 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 26 04:42:39.291700 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 26 04:42:39.291700 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 26 04:42:39.291700 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 26 04:42:39.291700 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 26 04:42:39.291700 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 26 04:42:39.291700 dv-cinder-850574-1-smb devstack@keystone.service[86744]: ERROR keystone.server.flask.application Jul 26 04:42:39.291700 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 654/1285] 10.222.0.39 () {56 vars in 1111 bytes} [Tue Jul 26 04:42:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:42:39.296723 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b6a34-9286-4b62-b6e3-d8f484bcae75 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:39.349121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:39.402946 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b6a34-9286-4b62-b6e3-d8f484bcae75 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:39.439573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f135c1-26fd-467b-98e2-b674bce3ddbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:39.440191 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f135c1-26fd-467b-98e2-b674bce3ddbe None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:39.440470 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f135c1-26fd-467b-98e2-b674bce3ddbe None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:39.440742 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f135c1-26fd-467b-98e2-b674bce3ddbe None admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:39.441490 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f135c1-26fd-467b-98e2-b674bce3ddbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:39.441794 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f135c1-26fd-467b-98e2-b674bce3ddbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:39.443282 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f135c1-26fd-467b-98e2-b674bce3ddbe None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:39.455345 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 632/1286] 10.222.0.39 () {56 vars in 1148 bytes} [Tue Jul 26 04:42:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:42:39.461787 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7294de7-6963-473c-af62-069b741476d8 None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:39.565612 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7294de7-6963-473c-af62-069b741476d8 None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:39.599691 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d814a47b-232b-4a81-8e2c-9e1223c17c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:39.600224 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814a47b-232b-4a81-8e2c-9e1223c17c4f None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:39.600499 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814a47b-232b-4a81-8e2c-9e1223c17c4f None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:39.600768 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814a47b-232b-4a81-8e2c-9e1223c17c4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:39.601544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d814a47b-232b-4a81-8e2c-9e1223c17c4f None admin] RBAC: Adding query filter params (role.id=2bfdd65b06554a6da967b3939da753c7, scope.project.id=c4d7c29a2b144df6afa96fd6894254a4, user.id=21dfe7b4d6524ec2885224d77395b00b) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:39.601847 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d814a47b-232b-4a81-8e2c-9e1223c17c4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:39.603331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d814a47b-232b-4a81-8e2c-9e1223c17c4f None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:39.609197 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 655/1287] 10.222.0.39 () {56 vars in 1374 bytes} [Tue Jul 26 04:42:39 2022] GET /identity/v3/role_assignments?user.id=21dfe7b4d6524ec2885224d77395b00b&scope.project.id=c4d7c29a2b144df6afa96fd6894254a4&role.id=2bfdd65b06554a6da967b3939da753c7 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:42:41.612814 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec1283-8579-4dff-b2a1-3539664e4c3a None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:41.613365 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec1283-8579-4dff-b2a1-3539664e4c3a None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:41.613365 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec1283-8579-4dff-b2a1-3539664e4c3a None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:41.614708 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 633/1288] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:42:41.620166 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359d4f7-0068-401a-ad54-6d9a17be2d42 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:41.620604 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359d4f7-0068-401a-ad54-6d9a17be2d42 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:41.620720 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359d4f7-0068-401a-ad54-6d9a17be2d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:41.640338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-6359d4f7-0068-401a-ad54-6d9a17be2d42 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:42:41.641563 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-6359d4f7-0068-401a-ad54-6d9a17be2d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:42:41.675518 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:41.716058 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 656/1289] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:42:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:42:41.738347 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec1283-8579-4dff-b2a1-3539664e4c3a None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:41.857781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec1283-8579-4dff-b2a1-3539664e4c3a None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:41.872674 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:41.898760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d5a11-1b60-4e29-a2a7-bcbc8edecd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:41.899422 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d5a11-1b60-4e29-a2a7-bcbc8edecd5c None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:41.899700 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d5a11-1b60-4e29-a2a7-bcbc8edecd5c None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:41.899975 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d5a11-1b60-4e29-a2a7-bcbc8edecd5c None admin] PATH_INFO: `/v3/services/placement` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:41.900607 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06d5a11-1b60-4e29-a2a7-bcbc8edecd5c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:41.902222 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06d5a11-1b60-4e29-a2a7-bcbc8edecd5c None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:41.911900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-c06d5a11-1b60-4e29-a2a7-bcbc8edecd5c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 04:42:41.911900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:41.911900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 04:42:41.911900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 04:42:41.911900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 04:42:41.911900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 04:42:41.911900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 04:42:41.911900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:42:41.911900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 04:42:41.911900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:42:41.911900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 04:42:41.911900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:42:41.911900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:41.911900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:41.911900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:41.911900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:41.911900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:41.913241 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:41.913241 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:41.913241 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:41.913241 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:41.913241 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:41.913241 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:41.913241 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 04:42:41.913241 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 04:42:41.913241 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 04:42:41.913241 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 04:42:41.913241 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:41.913241 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:41.913241 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:41.913241 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:41.913241 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:41.913241 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:41.914296 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:41.914296 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:41.914296 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:41.914296 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:41.914296 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:41.914296 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:41.914296 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:41.914296 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:41.914296 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:41.914296 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:41.914296 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 04:42:41.914296 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:42:41.914296 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 04:42:41.914296 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:42:41.914296 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 634/1290] 10.222.0.39 () {56 vars in 1117 bytes} [Tue Jul 26 04:42:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:42:41.919613 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359d4f7-0068-401a-ad54-6d9a17be2d42 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:42.037704 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359d4f7-0068-401a-ad54-6d9a17be2d42 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:42.084329 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca80e766-5e4f-413f-a864-a10d517c92ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:42.085031 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80e766-5e4f-413f-a864-a10d517c92ad None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:42.085322 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80e766-5e4f-413f-a864-a10d517c92ad None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:42.085641 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80e766-5e4f-413f-a864-a10d517c92ad None admin] PATH_INFO: `/v3/services` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:42.086428 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80e766-5e4f-413f-a864-a10d517c92ad None admin] RBAC: Adding query filter params (name=placement) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:42.086774 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80e766-5e4f-413f-a864-a10d517c92ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:42.088375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca80e766-5e4f-413f-a864-a10d517c92ad None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:42.094776 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 657/1291] 10.222.0.39 () {56 vars in 1116 bytes} [Tue Jul 26 04:42:41 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:42:42.101667 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d5a11-1b60-4e29-a2a7-bcbc8edecd5c None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:42.223186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d5a11-1b60-4e29-a2a7-bcbc8edecd5c None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:42.261775 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac67ae6-aefd-477d-8adf-9933ed44090e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:42.262733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac67ae6-aefd-477d-8adf-9933ed44090e None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:42.263048 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac67ae6-aefd-477d-8adf-9933ed44090e None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:42.263358 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac67ae6-aefd-477d-8adf-9933ed44090e None admin] PATH_INFO: `/v3/services` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:42.264134 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac67ae6-aefd-477d-8adf-9933ed44090e None admin] RBAC: Adding query filter params (type=placement) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:42.264622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac67ae6-aefd-477d-8adf-9933ed44090e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:42.266386 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac67ae6-aefd-477d-8adf-9933ed44090e None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:42.273158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 635/1292] 10.222.0.39 () {56 vars in 1116 bytes} [Tue Jul 26 04:42:42 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:42:44.243192 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a433aae-6c0f-46ef-866c-5af25f014a52 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:44.244069 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a433aae-6c0f-46ef-866c-5af25f014a52 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:44.244069 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a433aae-6c0f-46ef-866c-5af25f014a52 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:44.245793 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 658/1293] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:42:44.251538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbf1bf-4c01-4c8f-b4cf-ada52d8bca43 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:44.251998 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbf1bf-4c01-4c8f-b4cf-ada52d8bca43 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:44.252114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cbf1bf-4c01-4c8f-b4cf-ada52d8bca43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:44.275258 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-b7cbf1bf-4c01-4c8f-b4cf-ada52d8bca43 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:42:44.275812 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-b7cbf1bf-4c01-4c8f-b4cf-ada52d8bca43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:42:44.312232 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:44.354635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 636/1294] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:42:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:42:44.377651 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a433aae-6c0f-46ef-866c-5af25f014a52 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:44.412230 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:44.487768 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a433aae-6c0f-46ef-866c-5af25f014a52 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:44.527515 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e42436-3596-457d-93eb-b850edde9799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:44.528073 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e42436-3596-457d-93eb-b850edde9799 None admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:44.528347 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e42436-3596-457d-93eb-b850edde9799 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:44.528614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e42436-3596-457d-93eb-b850edde9799 None admin] PATH_INFO: `/v3/services` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:44.529300 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e42436-3596-457d-93eb-b850edde9799 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:44.530735 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e42436-3596-457d-93eb-b850edde9799 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:44.548303 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 659/1295] 10.222.0.39 () {60 vars in 1141 bytes} [Tue Jul 26 04:42:44 2022] POST /identity/v3/services => generated 246 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:42:46.597615 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59baed-59e4-4bda-89e4-99b84c264e72 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:46.598184 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59baed-59e4-4bda-89e4-99b84c264e72 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:46.598184 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59baed-59e4-4bda-89e4-99b84c264e72 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:46.599435 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 637/1296] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:42:46.604915 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79eb29-fb02-4060-830b-ebd2a8e5ddb4 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:46.605317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79eb29-fb02-4060-830b-ebd2a8e5ddb4 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:46.605452 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79eb29-fb02-4060-830b-ebd2a8e5ddb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:46.624678 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-bb79eb29-fb02-4060-830b-ebd2a8e5ddb4 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:42:46.625886 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-bb79eb29-fb02-4060-830b-ebd2a8e5ddb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:42:46.705898 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 660/1297] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:42:46 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:42:46.728317 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59baed-59e4-4bda-89e4-99b84c264e72 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:46.844422 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59baed-59e4-4bda-89e4-99b84c264e72 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:46.880063 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf4134-00a5-4c1c-8d91-38528badb866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:46.880617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf4134-00a5-4c1c-8d91-38528badb866 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:46.880895 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf4134-00a5-4c1c-8d91-38528badb866 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:46.881156 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf4134-00a5-4c1c-8d91-38528badb866 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:46.881773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf4134-00a5-4c1c-8d91-38528badb866 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:46.883186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf4134-00a5-4c1c-8d91-38528badb866 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:46.892234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-0cbf4134-00a5-4c1c-8d91-38528badb866 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 04:42:46.892234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:46.892234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 04:42:46.892234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 04:42:46.892234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 04:42:46.892234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 04:42:46.892234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 04:42:46.892234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:42:46.892234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 04:42:46.892234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:42:46.892234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 04:42:46.892234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:42:46.892234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:46.892234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:46.892234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:46.892234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:46.892234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:46.893387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:46.893387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:46.893387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:46.893387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:46.893387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:46.893387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:46.893387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 04:42:46.893387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 04:42:46.893387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 04:42:46.893387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 04:42:46.893387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:46.893387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:46.893387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:46.893387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:46.893387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:46.893387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:46.894374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:46.894374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:46.894374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:46.894374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:46.894374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:46.894374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:46.894374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:46.894374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:46.894374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:46.894374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:46.894374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 04:42:46.894374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:42:46.894374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 04:42:46.894374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:42:46.894374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 638/1298] 10.222.0.39 () {56 vars in 1117 bytes} [Tue Jul 26 04:42:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:42:46.899977 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79eb29-fb02-4060-830b-ebd2a8e5ddb4 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:46.920010 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:47.008022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79eb29-fb02-4060-830b-ebd2a8e5ddb4 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:47.046168 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a7f1e-ca42-4993-af10-e9f713e6ccec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:47.046973 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a7f1e-ca42-4993-af10-e9f713e6ccec None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:47.047396 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a7f1e-ca42-4993-af10-e9f713e6ccec None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:47.047968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a7f1e-ca42-4993-af10-e9f713e6ccec None admin] PATH_INFO: `/v3/services` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:47.048951 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a7f1e-ca42-4993-af10-e9f713e6ccec None admin] RBAC: Adding query filter params (name=placement) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:47.049334 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a7f1e-ca42-4993-af10-e9f713e6ccec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:47.051423 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819a7f1e-ca42-4993-af10-e9f713e6ccec None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:47.063615 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 661/1299] 10.222.0.39 () {56 vars in 1116 bytes} [Tue Jul 26 04:42:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:42:47.065266 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf4134-00a5-4c1c-8d91-38528badb866 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:47.101772 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:47.175081 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf4134-00a5-4c1c-8d91-38528badb866 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:47.208296 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd2811-8a30-4107-9cbb-f61d73289426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:47.208916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd2811-8a30-4107-9cbb-f61d73289426 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:47.209186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd2811-8a30-4107-9cbb-f61d73289426 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:47.209474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd2811-8a30-4107-9cbb-f61d73289426 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:47.210236 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd2811-8a30-4107-9cbb-f61d73289426 None admin] RBAC: Adding query filter params (interface=public, service_id=f0e1ad7cb24b43a09acccb19462ca2b4, region_id=RegionOne) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:47.210540 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd2811-8a30-4107-9cbb-f61d73289426 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:47.211933 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd2811-8a30-4107-9cbb-f61d73289426 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:47.217013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 639/1300] 10.222.0.39 () {56 vars in 1251 bytes} [Tue Jul 26 04:42:47 2022] GET /identity/v3/endpoints?service_id=f0e1ad7cb24b43a09acccb19462ca2b4&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:42:47.222975 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a7f1e-ca42-4993-af10-e9f713e6ccec None admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:47.318471 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:47.337941 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819a7f1e-ca42-4993-af10-e9f713e6ccec None admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:47.379172 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27d885-3733-4fb2-97cc-f965009f088a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:47.379808 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27d885-3733-4fb2-97cc-f965009f088a None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:47.380088 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27d885-3733-4fb2-97cc-f965009f088a None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:47.380358 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27d885-3733-4fb2-97cc-f965009f088a None admin] PATH_INFO: `/v3/services` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:47.381017 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27d885-3733-4fb2-97cc-f965009f088a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:47.382453 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27d885-3733-4fb2-97cc-f965009f088a None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:47.389642 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 662/1301] 10.222.0.39 () {56 vars in 1087 bytes} [Tue Jul 26 04:42:47 2022] GET /identity/v3/services => generated 2191 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:42:49.360812 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae32fd-8dc8-4201-8b25-9e029a79ec20 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:49.361369 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae32fd-8dc8-4201-8b25-9e029a79ec20 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:49.361369 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae32fd-8dc8-4201-8b25-9e029a79ec20 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:49.362770 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 640/1302] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:42:49.368489 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e3e1f-1cc1-4d48-8f20-3db67b14cac0 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:49.368945 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e3e1f-1cc1-4d48-8f20-3db67b14cac0 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:49.369035 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e3e1f-1cc1-4d48-8f20-3db67b14cac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:49.388939 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-2b8e3e1f-1cc1-4d48-8f20-3db67b14cac0 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:42:49.390218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-2b8e3e1f-1cc1-4d48-8f20-3db67b14cac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:42:49.473035 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 663/1303] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:42:49 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 26 04:42:49.500809 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae32fd-8dc8-4201-8b25-9e029a79ec20 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:49.605370 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:49.613466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae32fd-8dc8-4201-8b25-9e029a79ec20 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:49.649449 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81a002-63d1-4ccd-bb0c-95ae68beb741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:49.650117 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81a002-63d1-4ccd-bb0c-95ae68beb741 None admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:49.650403 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81a002-63d1-4ccd-bb0c-95ae68beb741 None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:49.650676 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81a002-63d1-4ccd-bb0c-95ae68beb741 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:49.651300 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81a002-63d1-4ccd-bb0c-95ae68beb741 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:49.652687 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81a002-63d1-4ccd-bb0c-95ae68beb741 None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:49.662144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application [None req-4d81a002-63d1-4ccd-bb0c-95ae68beb741 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 04:42:49.662144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:49.662144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 26 04:42:49.662144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 26 04:42:49.662144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 26 04:42:49.662144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 26 04:42:49.662144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 26 04:42:49.662144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:42:49.662144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 04:42:49.662144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:42:49.662144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 26 04:42:49.662144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:42:49.662144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 26 04:42:49.662144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 26 04:42:49.662144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 26 04:42:49.662144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 26 04:42:49.662144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 26 04:42:49.663344 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 26 04:42:49.663344 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 26 04:42:49.663344 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 26 04:42:49.663344 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 26 04:42:49.663344 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 26 04:42:49.663344 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 26 04:42:49.663344 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 26 04:42:49.663344 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 26 04:42:49.663344 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 26 04:42:49.663344 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 26 04:42:49.663344 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 26 04:42:49.663344 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 26 04:42:49.663344 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 26 04:42:49.663344 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 26 04:42:49.663344 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 26 04:42:49.663344 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.get_or_create( Jul 26 04:42:49.664462 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 26 04:42:49.664462 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application with Lock( Jul 26 04:42:49.664462 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 26 04:42:49.664462 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self._enter() Jul 26 04:42:49.664462 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 26 04:42:49.664462 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 26 04:42:49.664462 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 26 04:42:49.664462 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application return self.creator() Jul 26 04:42:49.664462 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 26 04:42:49.664462 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application created_value = creator( Jul 26 04:42:49.664462 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 26 04:42:49.664462 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 26 04:42:49.664462 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 26 04:42:49.664462 dv-cinder-850574-1-smb devstack@keystone.service[86745]: ERROR keystone.server.flask.application Jul 26 04:42:49.664462 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 641/1304] 10.222.0.39 () {56 vars in 1117 bytes} [Tue Jul 26 04:42:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 26 04:42:49.670129 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e3e1f-1cc1-4d48-8f20-3db67b14cac0 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:49.754055 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:42:49.790086 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e3e1f-1cc1-4d48-8f20-3db67b14cac0 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:49.828943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0994de5-8c79-453a-9854-1fb168f062a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:49.829575 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0994de5-8c79-453a-9854-1fb168f062a2 None admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:49.829859 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0994de5-8c79-453a-9854-1fb168f062a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:49.830166 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0994de5-8c79-453a-9854-1fb168f062a2 None admin] PATH_INFO: `/v3/services` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:49.830859 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0994de5-8c79-453a-9854-1fb168f062a2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:42:49.831174 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0994de5-8c79-453a-9854-1fb168f062a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:49.834682 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0994de5-8c79-453a-9854-1fb168f062a2 None admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:49.840835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 664/1305] 10.222.0.39 () {56 vars in 1116 bytes} [Tue Jul 26 04:42:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:42:49.848191 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81a002-63d1-4ccd-bb0c-95ae68beb741 None admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:42:49.953885 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81a002-63d1-4ccd-bb0c-95ae68beb741 None admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:42:49.989597 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41768e-f56c-4af4-a1a6-937987749b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:42:49.990249 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41768e-f56c-4af4-a1a6-937987749b0d None admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:42:49.990529 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41768e-f56c-4af4-a1a6-937987749b0d None admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:42:49.990804 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41768e-f56c-4af4-a1a6-937987749b0d None admin] PATH_INFO: `/v3/endpoints` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:42:49.991510 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41768e-f56c-4af4-a1a6-937987749b0d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:42:49.992895 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41768e-f56c-4af4-a1a6-937987749b0d None admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:42:50.016853 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 642/1306] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:42:49 2022] POST /identity/v3/endpoints => generated 331 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:42:59.837290 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=30 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:43:00.011715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:43:53.183025 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317828bc-a558-45ba-a0dc-29ff8eb178dd None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:43:53.183612 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317828bc-a558-45ba-a0dc-29ff8eb178dd None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:43:53.183612 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317828bc-a558-45ba-a0dc-29ff8eb178dd None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:43:53.188927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 665/1307] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:43:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:43:53.190344 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9312d-5816-4e4a-afc7-7753e517adee None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:43:53.190777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9312d-5816-4e4a-afc7-7753e517adee None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:43:53.190893 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9312d-5816-4e4a-afc7-7753e517adee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:43:53.350661 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-8fd9312d-5816-4e4a-afc7-7753e517adee None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:43:53.351900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-8fd9312d-5816-4e4a-afc7-7753e517adee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:43:53.590779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 643/1308] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:43:53.650222 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2786ea1-6e26-41dd-a524-f95051b828c5 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:43:53.650505 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2786ea1-6e26-41dd-a524-f95051b828c5 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:43:53.651022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2786ea1-6e26-41dd-a524-f95051b828c5 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:43:53.652897 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 666/1309] 10.222.0.39 () {54 vars in 965 bytes} [Tue Jul 26 04:43:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:43:53.660700 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37adf40-5ab0-465e-b8ad-901b321a11d4 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:43:53.661298 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37adf40-5ab0-465e-b8ad-901b321a11d4 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:43:53.661810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37adf40-5ab0-465e-b8ad-901b321a11d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:43:53.766252 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-e37adf40-5ab0-465e-b8ad-901b321a11d4 None None] MFA Rules not processed for user `74fee029d5214ce18b4b9ddc2df72a23`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:43:53.767830 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-e37adf40-5ab0-465e-b8ad-901b321a11d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:43:53.789790 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:43:53.849739 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 644/1310] 10.222.0.39 () {58 vars in 1062 bytes} [Tue Jul 26 04:43:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:43:53.858996 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2786ea1-6e26-41dd-a524-f95051b828c5 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:43:53.861233 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-e2786ea1-6e26-41dd-a524-f95051b828c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:43:53.984640 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2786ea1-6e26-41dd-a524-f95051b828c5 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:43:54.081001 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e817a13c-37dc-4dac-88f4-0aa67622396b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:43:54.081552 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817a13c-37dc-4dac-88f4-0aa67622396b service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:43:54.081828 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817a13c-37dc-4dac-88f4-0aa67622396b service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:43:54.082128 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e817a13c-37dc-4dac-88f4-0aa67622396b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:43:54.084152 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-e817a13c-37dc-4dac-88f4-0aa67622396b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:43:54.155383 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:43:54.224236 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817a13c-37dc-4dac-88f4-0aa67622396b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:43:54.225907 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e817a13c-37dc-4dac-88f4-0aa67622396b service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:43:54.248870 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 667/1311] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:43:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:43:56.567219 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1768e04-acb4-4567-ae48-6b1d28b2f081 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:43:56.567754 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1768e04-acb4-4567-ae48-6b1d28b2f081 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:43:56.567754 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1768e04-acb4-4567-ae48-6b1d28b2f081 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:43:56.569348 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 645/1312] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:43:56.574580 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de2742-d876-4440-bdb5-877e84465993 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:43:56.575069 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de2742-d876-4440-bdb5-877e84465993 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:43:56.575166 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de2742-d876-4440-bdb5-877e84465993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:43:56.652334 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-39de2742-d876-4440-bdb5-877e84465993 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:43:56.653581 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-39de2742-d876-4440-bdb5-877e84465993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:43:56.769233 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 668/1313] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:43:56.808152 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1768e04-acb4-4567-ae48-6b1d28b2f081 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:43:56.809766 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-a1768e04-acb4-4567-ae48-6b1d28b2f081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:43:56.962917 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1768e04-acb4-4567-ae48-6b1d28b2f081 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:43:57.065751 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:43:57.069257 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb491d7-8f9b-46dd-93fe-d821f8d96349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:43:57.070163 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb491d7-8f9b-46dd-93fe-d821f8d96349 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:43:57.070656 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb491d7-8f9b-46dd-93fe-d821f8d96349 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:43:57.071252 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb491d7-8f9b-46dd-93fe-d821f8d96349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:43:57.073001 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-7cb491d7-8f9b-46dd-93fe-d821f8d96349 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:43:57.188058 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb491d7-8f9b-46dd-93fe-d821f8d96349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:43:57.189516 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb491d7-8f9b-46dd-93fe-d821f8d96349 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:43:57.207932 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 646/1314] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:43:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:43:59.510767 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73082351-b8ac-4b44-a11b-fe3c79772817 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:43:59.511357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73082351-b8ac-4b44-a11b-fe3c79772817 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:43:59.511357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73082351-b8ac-4b44-a11b-fe3c79772817 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:43:59.512802 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 669/1315] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:43:59.519055 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ed305-4621-4015-8a58-9ea04c8bd599 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:43:59.519595 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ed305-4621-4015-8a58-9ea04c8bd599 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:43:59.519685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1ed305-4621-4015-8a58-9ea04c8bd599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:43:59.592268 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-dd1ed305-4621-4015-8a58-9ea04c8bd599 None None] MFA Rules not processed for user `70a3f2a158524f4eb65391e71dffc61b`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:43:59.593530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-dd1ed305-4621-4015-8a58-9ea04c8bd599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:43:59.647095 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:43:59.693946 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 647/1316] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:43:59 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:43:59.750025 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f24291-df97-4d3c-82ca-37e1fe3e89d0 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:43:59.750279 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f24291-df97-4d3c-82ca-37e1fe3e89d0 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:43:59.750577 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f24291-df97-4d3c-82ca-37e1fe3e89d0 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:43:59.752002 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 670/1317] 10.222.0.39 () {54 vars in 965 bytes} [Tue Jul 26 04:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:43:59.758403 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6ba92-0a38-487e-9b0a-f9db03f49564 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:43:59.758691 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6ba92-0a38-487e-9b0a-f9db03f49564 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:43:59.758968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6ba92-0a38-487e-9b0a-f9db03f49564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:43:59.847725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-18b6ba92-0a38-487e-9b0a-f9db03f49564 None None] MFA Rules not processed for user `74fee029d5214ce18b4b9ddc2df72a23`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:43:59.848888 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-18b6ba92-0a38-487e-9b0a-f9db03f49564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:43:59.932184 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 648/1318] 10.222.0.39 () {58 vars in 1062 bytes} [Tue Jul 26 04:43:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:43:59.941531 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f24291-df97-4d3c-82ca-37e1fe3e89d0 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:43:59.943239 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-40f24291-df97-4d3c-82ca-37e1fe3e89d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:43:59.953592 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:00.051302 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f24291-df97-4d3c-82ca-37e1fe3e89d0 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:44:00.127691 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e363072-d499-40ca-a937-3db8e06c62aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:44:00.128224 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e363072-d499-40ca-a937-3db8e06c62aa service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:00.128507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e363072-d499-40ca-a937-3db8e06c62aa service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:00.128780 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e363072-d499-40ca-a937-3db8e06c62aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:00.130527 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-9e363072-d499-40ca-a937-3db8e06c62aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:00.194555 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:00.243940 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e363072-d499-40ca-a937-3db8e06c62aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:44:00.245408 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e363072-d499-40ca-a937-3db8e06c62aa service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:44:00.265967 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 671/1319] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:43:59 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:44:03.163266 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df33980-360d-4589-bbfc-2ac2c25461fa None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:03.163852 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df33980-360d-4589-bbfc-2ac2c25461fa None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:03.163852 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df33980-360d-4589-bbfc-2ac2c25461fa None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:03.165185 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 649/1320] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:44:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:44:03.170605 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed1653-33bd-49bb-95b6-58b559bb8716 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:03.171058 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed1653-33bd-49bb-95b6-58b559bb8716 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:03.171156 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed1653-33bd-49bb-95b6-58b559bb8716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:03.239422 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-83ed1653-33bd-49bb-95b6-58b559bb8716 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:44:03.240640 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-83ed1653-33bd-49bb-95b6-58b559bb8716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:03.339667 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 672/1321] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:44:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:44:03.378017 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df33980-360d-4589-bbfc-2ac2c25461fa None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:44:03.379564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-0df33980-360d-4589-bbfc-2ac2c25461fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:03.433161 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:03.487589 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df33980-360d-4589-bbfc-2ac2c25461fa None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:44:03.565860 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49add36-5f71-4dbe-8396-d316760b3b31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:44:03.566526 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49add36-5f71-4dbe-8396-d316760b3b31 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:03.566802 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49add36-5f71-4dbe-8396-d316760b3b31 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:03.567066 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49add36-5f71-4dbe-8396-d316760b3b31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:03.568723 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-b49add36-5f71-4dbe-8396-d316760b3b31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:03.671517 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:03.687513 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49add36-5f71-4dbe-8396-d316760b3b31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:44:03.688990 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49add36-5f71-4dbe-8396-d316760b3b31 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:44:03.707358 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 650/1322] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:44:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:44:06.450431 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e618d25-f4e6-436d-8400-60cba26a41b6 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:06.451120 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e618d25-f4e6-436d-8400-60cba26a41b6 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:06.451120 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e618d25-f4e6-436d-8400-60cba26a41b6 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:06.452413 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 673/1323] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:44:06.458129 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2582b6-0d25-47ed-a2d0-93e44fcc3cd1 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:06.458647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2582b6-0d25-47ed-a2d0-93e44fcc3cd1 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:06.458728 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2582b6-0d25-47ed-a2d0-93e44fcc3cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:06.534998 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-5d2582b6-0d25-47ed-a2d0-93e44fcc3cd1 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:44:06.537922 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-5d2582b6-0d25-47ed-a2d0-93e44fcc3cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:06.668172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 651/1324] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:44:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:44:06.707324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e618d25-f4e6-436d-8400-60cba26a41b6 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:44:06.708896 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-7e618d25-f4e6-436d-8400-60cba26a41b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:06.732657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:06.838847 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e618d25-f4e6-436d-8400-60cba26a41b6 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:44:06.917823 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca66b6-a174-4aab-b477-a268f58c7626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:44:06.918511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca66b6-a174-4aab-b477-a268f58c7626 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:06.918787 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca66b6-a174-4aab-b477-a268f58c7626 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:06.919053 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca66b6-a174-4aab-b477-a268f58c7626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:06.920721 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-bfca66b6-a174-4aab-b477-a268f58c7626 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:07.003045 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:07.045166 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca66b6-a174-4aab-b477-a268f58c7626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:44:07.046965 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca66b6-a174-4aab-b477-a268f58c7626 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:44:07.066586 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 674/1325] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:44:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:44:09.142349 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df298be0-abf4-4473-b051-4d1610158ab6 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:09.142886 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df298be0-abf4-4473-b051-4d1610158ab6 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:09.142886 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df298be0-abf4-4473-b051-4d1610158ab6 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:09.144162 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 652/1326] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:44:09.149812 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6dce4-cf69-4795-a588-5cf4b8eed85e None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:09.150307 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6dce4-cf69-4795-a588-5cf4b8eed85e None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:09.150575 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6dce4-cf69-4795-a588-5cf4b8eed85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:09.225486 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-b4a6dce4-cf69-4795-a588-5cf4b8eed85e None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:44:09.226768 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-b4a6dce4-cf69-4795-a588-5cf4b8eed85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:09.334737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 675/1327] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:44:09.371090 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df298be0-abf4-4473-b051-4d1610158ab6 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:44:09.372772 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-df298be0-abf4-4473-b051-4d1610158ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:09.442207 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:09.491189 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df298be0-abf4-4473-b051-4d1610158ab6 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:44:09.574829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b1f38-b469-4dd9-80d5-0dc299b9be87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:44:09.575581 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b1f38-b469-4dd9-80d5-0dc299b9be87 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:09.575861 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b1f38-b469-4dd9-80d5-0dc299b9be87 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:09.576130 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b1f38-b469-4dd9-80d5-0dc299b9be87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:09.577790 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-c13b1f38-b469-4dd9-80d5-0dc299b9be87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:09.696724 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:09.699144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b1f38-b469-4dd9-80d5-0dc299b9be87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:44:09.701126 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b1f38-b469-4dd9-80d5-0dc299b9be87 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:44:09.721747 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 653/1328] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:44:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:44:11.781770 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bf50b-937b-48a4-a710-ce3bc6b5ad30 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:11.782440 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bf50b-937b-48a4-a710-ce3bc6b5ad30 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:11.782440 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bf50b-937b-48a4-a710-ce3bc6b5ad30 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:11.783845 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 676/1329] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:44:11.789151 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64437df-5a1a-4594-9d7c-48deca404216 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:11.789602 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64437df-5a1a-4594-9d7c-48deca404216 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:11.789718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64437df-5a1a-4594-9d7c-48deca404216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:11.862560 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-d64437df-5a1a-4594-9d7c-48deca404216 None None] MFA Rules not processed for user `70a3f2a158524f4eb65391e71dffc61b`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:44:11.863729 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-d64437df-5a1a-4594-9d7c-48deca404216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:11.968238 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 654/1330] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:44:11 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:44:12.006012 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52bf50b-937b-48a4-a710-ce3bc6b5ad30 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:44:12.007560 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-d52bf50b-937b-48a4-a710-ce3bc6b5ad30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:12.039461 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:12.116817 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52bf50b-937b-48a4-a710-ce3bc6b5ad30 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:44:12.193970 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e66eb-50b6-4d6a-8c4d-5d86a218b680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:44:12.194701 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e66eb-50b6-4d6a-8c4d-5d86a218b680 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:12.195055 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e66eb-50b6-4d6a-8c4d-5d86a218b680 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:12.195389 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e66eb-50b6-4d6a-8c4d-5d86a218b680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:12.197051 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-4c7e66eb-50b6-4d6a-8c4d-5d86a218b680 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:12.276904 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:12.311442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e66eb-50b6-4d6a-8c4d-5d86a218b680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:44:12.312909 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e66eb-50b6-4d6a-8c4d-5d86a218b680 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:44:12.336035 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 677/1331] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:44:12 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:44:14.628618 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93909b83-51f8-4ccd-bada-e4335c7766c3 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:14.629178 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93909b83-51f8-4ccd-bada-e4335c7766c3 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:14.629178 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93909b83-51f8-4ccd-bada-e4335c7766c3 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:14.630510 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 655/1332] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:44:14.636120 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb8ad6-d936-42e9-880e-2c555c777d1c None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:14.636590 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb8ad6-d936-42e9-880e-2c555c777d1c None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:14.636689 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb8ad6-d936-42e9-880e-2c555c777d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:14.706800 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-1eeb8ad6-d936-42e9-880e-2c555c777d1c None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:44:14.708018 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-1eeb8ad6-d936-42e9-880e-2c555c777d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:14.810403 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 678/1333] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:44:14.846763 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93909b83-51f8-4ccd-bada-e4335c7766c3 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:44:14.848326 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-93909b83-51f8-4ccd-bada-e4335c7766c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:14.921727 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:14.957990 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93909b83-51f8-4ccd-bada-e4335c7766c3 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:44:15.034697 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799730ed-e235-4a0b-b6ac-2b13673699e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:44:15.035335 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799730ed-e235-4a0b-b6ac-2b13673699e9 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:15.035637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799730ed-e235-4a0b-b6ac-2b13673699e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:15.035912 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799730ed-e235-4a0b-b6ac-2b13673699e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:15.037580 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-799730ed-e235-4a0b-b6ac-2b13673699e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:15.154359 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799730ed-e235-4a0b-b6ac-2b13673699e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:44:15.155864 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799730ed-e235-4a0b-b6ac-2b13673699e9 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:44:15.166908 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:15.177404 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 656/1334] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:44:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:44:17.238191 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b413450-d039-4c0c-9bfd-2c9afe23b654 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:17.238747 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b413450-d039-4c0c-9bfd-2c9afe23b654 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:17.238747 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b413450-d039-4c0c-9bfd-2c9afe23b654 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:17.240121 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 679/1335] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:44:17.245788 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0b8c3-4730-468b-bb82-92116e299d01 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:17.246274 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0b8c3-4730-468b-bb82-92116e299d01 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:17.246390 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0b8c3-4730-468b-bb82-92116e299d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:17.317283 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-22b0b8c3-4730-468b-bb82-92116e299d01 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:44:17.318669 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-22b0b8c3-4730-468b-bb82-92116e299d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:17.417247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 657/1336] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:44:17.457481 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b413450-d039-4c0c-9bfd-2c9afe23b654 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:44:17.459087 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-9b413450-d039-4c0c-9bfd-2c9afe23b654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:17.497842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:17.565571 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b413450-d039-4c0c-9bfd-2c9afe23b654 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:44:17.645456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9af52-7f7f-4eb1-956a-eb2a34bc8105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:44:17.646134 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9af52-7f7f-4eb1-956a-eb2a34bc8105 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:17.646422 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9af52-7f7f-4eb1-956a-eb2a34bc8105 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:17.646691 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9af52-7f7f-4eb1-956a-eb2a34bc8105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:17.648425 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-a4c9af52-7f7f-4eb1-956a-eb2a34bc8105 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:17.734005 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:17.761264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c9af52-7f7f-4eb1-956a-eb2a34bc8105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:44:17.762834 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c9af52-7f7f-4eb1-956a-eb2a34bc8105 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:44:17.781212 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 680/1337] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:44:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:44:20.182437 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de89825-593e-47eb-be1c-f14d6707a080 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:20.183102 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de89825-593e-47eb-be1c-f14d6707a080 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:20.183102 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de89825-593e-47eb-be1c-f14d6707a080 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:20.184421 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 658/1338] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:44:20.190397 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd310661-c91f-48a1-afbf-f48ff0ce0bbe None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:20.191062 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd310661-c91f-48a1-afbf-f48ff0ce0bbe None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:20.191062 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd310661-c91f-48a1-afbf-f48ff0ce0bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:20.267549 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-bd310661-c91f-48a1-afbf-f48ff0ce0bbe None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:44:20.268810 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-bd310661-c91f-48a1-afbf-f48ff0ce0bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:20.389386 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 681/1339] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:44:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:44:20.427410 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de89825-593e-47eb-be1c-f14d6707a080 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:44:20.429273 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-1de89825-593e-47eb-be1c-f14d6707a080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:20.562703 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:20.597670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de89825-593e-47eb-be1c-f14d6707a080 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:44:20.687071 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f67940-61f5-4015-b348-46f1c3a94e71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:44:20.687784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f67940-61f5-4015-b348-46f1c3a94e71 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:20.688111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f67940-61f5-4015-b348-46f1c3a94e71 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:20.688430 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f67940-61f5-4015-b348-46f1c3a94e71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:20.690243 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-65f67940-61f5-4015-b348-46f1c3a94e71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:20.823064 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f67940-61f5-4015-b348-46f1c3a94e71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:44:20.824529 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f67940-61f5-4015-b348-46f1c3a94e71 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:44:20.846579 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 659/1340] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:44:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:44:25.298007 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6af85-f57a-49ad-a307-ec04ca1dd3c7 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:25.298007 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6af85-f57a-49ad-a307-ec04ca1dd3c7 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:25.298007 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6af85-f57a-49ad-a307-ec04ca1dd3c7 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:25.302913 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 682/1341] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:44:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:44:25.306979 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d7947-7847-4502-8a72-f835238ee22f None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:25.307552 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d7947-7847-4502-8a72-f835238ee22f None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:25.308116 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d7947-7847-4502-8a72-f835238ee22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:25.318535 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:25.423761 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-a74d7947-7847-4502-8a72-f835238ee22f None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:44:25.425721 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-a74d7947-7847-4502-8a72-f835238ee22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:25.614810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 660/1342] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:44:25.662867 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6af85-f57a-49ad-a307-ec04ca1dd3c7 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:44:25.664502 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-0ab6af85-f57a-49ad-a307-ec04ca1dd3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:25.762293 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:25.862302 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6af85-f57a-49ad-a307-ec04ca1dd3c7 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:44:25.974149 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f3b96-b3f2-468c-8cf2-eeaf722d0641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:44:25.974844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f3b96-b3f2-468c-8cf2-eeaf722d0641 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:25.975227 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f3b96-b3f2-468c-8cf2-eeaf722d0641 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:25.975594 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f3b96-b3f2-468c-8cf2-eeaf722d0641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:25.977597 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-814f3b96-b3f2-468c-8cf2-eeaf722d0641 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:26.092460 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:26.113796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f3b96-b3f2-468c-8cf2-eeaf722d0641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:44:26.115473 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f3b96-b3f2-468c-8cf2-eeaf722d0641 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:44:26.138299 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 683/1343] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:44:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:44:29.112981 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6c5dc-4413-41d8-98a0-0bd38e02cda9 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:29.113829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6c5dc-4413-41d8-98a0-0bd38e02cda9 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:29.113829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6c5dc-4413-41d8-98a0-0bd38e02cda9 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:29.117234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 661/1344] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:44:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:44:29.124358 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e3ffc-fc87-44d4-a1de-b4f7fab912de None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:29.124923 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e3ffc-fc87-44d4-a1de-b4f7fab912de None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:29.125021 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e3ffc-fc87-44d4-a1de-b4f7fab912de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:29.210010 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-a57e3ffc-fc87-44d4-a1de-b4f7fab912de None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:44:29.211439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-a57e3ffc-fc87-44d4-a1de-b4f7fab912de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:29.332646 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 684/1345] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:44:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:44:29.370861 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6c5dc-4413-41d8-98a0-0bd38e02cda9 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:44:29.372443 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-92f6c5dc-4413-41d8-98a0-0bd38e02cda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:29.481145 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:29.503701 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6c5dc-4413-41d8-98a0-0bd38e02cda9 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:44:29.596359 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c03f2-0909-4e83-9be3-ceb55dc1ff99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:44:29.597047 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c03f2-0909-4e83-9be3-ceb55dc1ff99 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:29.597329 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c03f2-0909-4e83-9be3-ceb55dc1ff99 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:29.597609 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c03f2-0909-4e83-9be3-ceb55dc1ff99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:29.599445 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-661c03f2-0909-4e83-9be3-ceb55dc1ff99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:29.727538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c03f2-0909-4e83-9be3-ceb55dc1ff99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:44:29.729027 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c03f2-0909-4e83-9be3-ceb55dc1ff99 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:44:29.750493 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 662/1346] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:44:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:44:34.189666 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a5017-2cb2-4a9d-87de-284db0ffdc45 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:34.190343 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a5017-2cb2-4a9d-87de-284db0ffdc45 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:34.190343 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a5017-2cb2-4a9d-87de-284db0ffdc45 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:34.191787 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 685/1347] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:44:34.199423 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356e56c-feae-44be-a4ab-6c56edd03990 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:34.199976 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356e56c-feae-44be-a4ab-6c56edd03990 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:34.200389 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356e56c-feae-44be-a4ab-6c56edd03990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:34.218151 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:34.278931 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-2356e56c-feae-44be-a4ab-6c56edd03990 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:44:34.280262 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-2356e56c-feae-44be-a4ab-6c56edd03990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:34.397525 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 663/1348] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:44:34.437894 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a5017-2cb2-4a9d-87de-284db0ffdc45 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:44:34.439467 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-178a5017-2cb2-4a9d-87de-284db0ffdc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:34.533628 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:34.591510 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a5017-2cb2-4a9d-87de-284db0ffdc45 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:44:34.684051 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc16de7-8421-4bef-939b-ba872892ac6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:44:34.684708 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc16de7-8421-4bef-939b-ba872892ac6b service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:34.684989 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc16de7-8421-4bef-939b-ba872892ac6b service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:34.685263 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc16de7-8421-4bef-939b-ba872892ac6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:34.687184 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-fbc16de7-8421-4bef-939b-ba872892ac6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:34.812476 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:34.816774 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc16de7-8421-4bef-939b-ba872892ac6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:44:34.818770 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc16de7-8421-4bef-939b-ba872892ac6b service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:44:34.838691 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 686/1349] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:44:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:44:39.864080 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973753c3-16a7-451e-8666-a695f9a48ce8 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:39.864080 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973753c3-16a7-451e-8666-a695f9a48ce8 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:39.864080 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973753c3-16a7-451e-8666-a695f9a48ce8 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:39.867746 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 664/1350] 10.222.0.39 () {54 vars in 921 bytes} [Tue Jul 26 04:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:44:39.882402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc50fd-82de-4ed5-9324-a0fc2aec9cd9 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:39.882912 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc50fd-82de-4ed5-9324-a0fc2aec9cd9 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:39.883004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc50fd-82de-4ed5-9324-a0fc2aec9cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:40.001383 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-aadc50fd-82de-4ed5-9324-a0fc2aec9cd9 None None] MFA Rules not processed for user `21dfe7b4d6524ec2885224d77395b00b`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:44:40.003341 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-aadc50fd-82de-4ed5-9324-a0fc2aec9cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:40.142780 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 687/1351] 10.222.0.39 () {58 vars in 1018 bytes} [Tue Jul 26 04:44:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:44:44.229109 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574015a-07ef-4755-aa9d-ab758d26a2ed None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:44.229689 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574015a-07ef-4755-aa9d-ab758d26a2ed None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:44.229689 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574015a-07ef-4755-aa9d-ab758d26a2ed None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:44.231377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 665/1352] 10.222.0.39 () {54 vars in 921 bytes} [Tue Jul 26 04:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:44:44.237068 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b428a-3f6e-41df-8fda-369dbc12f610 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:44.237633 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b428a-3f6e-41df-8fda-369dbc12f610 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:44.237633 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b428a-3f6e-41df-8fda-369dbc12f610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:44.310273 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:44.335477 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-0c8b428a-3f6e-41df-8fda-369dbc12f610 None None] MFA Rules not processed for user `21dfe7b4d6524ec2885224d77395b00b`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:44:44.336707 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-0c8b428a-3f6e-41df-8fda-369dbc12f610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:44.395165 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=59 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:44.451149 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 688/1353] 10.222.0.39 () {58 vars in 1018 bytes} [Tue Jul 26 04:44:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:44:45.733891 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5d410-4cea-44ef-836b-cddf869060a1 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:45.734483 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5d410-4cea-44ef-836b-cddf869060a1 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:45.734483 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5d410-4cea-44ef-836b-cddf869060a1 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:45.735862 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 666/1354] 10.222.0.39 () {54 vars in 921 bytes} [Tue Jul 26 04:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:44:45.741597 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd09aa-1649-48ff-b5a7-64b7d9db465e None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:45.742220 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd09aa-1649-48ff-b5a7-64b7d9db465e None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:45.742330 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd09aa-1649-48ff-b5a7-64b7d9db465e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:45.833619 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-f3bd09aa-1649-48ff-b5a7-64b7d9db465e None None] MFA Rules not processed for user `21dfe7b4d6524ec2885224d77395b00b`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:44:45.834905 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-f3bd09aa-1649-48ff-b5a7-64b7d9db465e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:45.882050 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:45.956406 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 689/1355] 10.222.0.39 () {58 vars in 1018 bytes} [Tue Jul 26 04:44:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:44:49.436448 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb37bae-4740-4ae5-a780-b74bc3daf3af None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:49.436981 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb37bae-4740-4ae5-a780-b74bc3daf3af None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:49.437211 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb37bae-4740-4ae5-a780-b74bc3daf3af None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:49.439127 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 667/1356] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:44:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:44:49.446530 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931760d-af6e-4177-ad5e-4da25376a51b None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:49.447363 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931760d-af6e-4177-ad5e-4da25376a51b None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:49.447363 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931760d-af6e-4177-ad5e-4da25376a51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:49.540009 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-d931760d-af6e-4177-ad5e-4da25376a51b None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:44:49.541272 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-d931760d-af6e-4177-ad5e-4da25376a51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:49.678201 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 690/1357] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:44:49.736231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b23fa7-e36d-48e2-a9a7-6200d65a1b00 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:49.736778 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b23fa7-e36d-48e2-a9a7-6200d65a1b00 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:49.737136 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b23fa7-e36d-48e2-a9a7-6200d65a1b00 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:49.738862 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 668/1358] 10.222.0.39 () {54 vars in 962 bytes} [Tue Jul 26 04:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:44:49.749061 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ffd81-eaaf-4897-995c-bca9669e616b None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:49.749769 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ffd81-eaaf-4897-995c-bca9669e616b None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:49.750323 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ffd81-eaaf-4897-995c-bca9669e616b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:49.768623 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:49.844820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-f01ffd81-eaaf-4897-995c-bca9669e616b None None] MFA Rules not processed for user `ae8593e125da4b208dd100608aa2b462`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:44:49.846896 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-f01ffd81-eaaf-4897-995c-bca9669e616b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:50.006079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 691/1359] 10.222.0.39 () {58 vars in 1059 bytes} [Tue Jul 26 04:44:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:44:50.014161 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b23fa7-e36d-48e2-a9a7-6200d65a1b00 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:44:50.016267 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-00b23fa7-e36d-48e2-a9a7-6200d65a1b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:50.195237 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b23fa7-e36d-48e2-a9a7-6200d65a1b00 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:44:50.326154 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:50.389173 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20b6416-2d22-48a6-830d-7aaffd9a7a29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:44:50.390136 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b6416-2d22-48a6-830d-7aaffd9a7a29 service nova] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:50.390443 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b6416-2d22-48a6-830d-7aaffd9a7a29 service nova] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:50.390719 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b6416-2d22-48a6-830d-7aaffd9a7a29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:50.392419 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-c20b6416-2d22-48a6-830d-7aaffd9a7a29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:50.494205 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b6416-2d22-48a6-830d-7aaffd9a7a29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:44:50.496614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20b6416-2d22-48a6-830d-7aaffd9a7a29 service nova] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:44:50.518033 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 669/1360] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:44:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:44:52.761027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf3dc5-1770-4566-b695-cb3c2c53b37d None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:52.761939 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf3dc5-1770-4566-b695-cb3c2c53b37d None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:52.762249 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf3dc5-1770-4566-b695-cb3c2c53b37d None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:52.764033 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 692/1361] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:44:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:44:52.769691 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291d53c-ee21-445b-b449-883bbf11b831 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:52.770185 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291d53c-ee21-445b-b449-883bbf11b831 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:52.770267 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291d53c-ee21-445b-b449-883bbf11b831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:52.869202 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-0291d53c-ee21-445b-b449-883bbf11b831 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:44:52.870787 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-0291d53c-ee21-445b-b449-883bbf11b831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:52.913480 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:52.983759 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 670/1362] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:44:53.029675 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf3dc5-1770-4566-b695-cb3c2c53b37d None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:44:53.031739 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-adcf3dc5-1770-4566-b695-cb3c2c53b37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:53.118540 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:53.227434 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcf3dc5-1770-4566-b695-cb3c2c53b37d None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:44:53.396150 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad4d00-0267-404c-afcf-28474ba21f08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:44:53.396872 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad4d00-0267-404c-afcf-28474ba21f08 service nova] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:53.397213 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad4d00-0267-404c-afcf-28474ba21f08 service nova] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:53.397547 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad4d00-0267-404c-afcf-28474ba21f08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:53.399289 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-32ad4d00-0267-404c-afcf-28474ba21f08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:53.426798 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:53.505880 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad4d00-0267-404c-afcf-28474ba21f08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:44:53.507568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ad4d00-0267-404c-afcf-28474ba21f08 service nova] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:44:53.527524 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 693/1363] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:44:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:44:55.921657 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e8229-0da7-4c22-b045-a8c921c49ae5 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:55.922639 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e8229-0da7-4c22-b045-a8c921c49ae5 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:55.922919 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e8229-0da7-4c22-b045-a8c921c49ae5 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:55.924351 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 671/1364] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:44:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:44:55.931037 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05496f2b-efdb-4edf-831b-ac652620f90b None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:55.931522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05496f2b-efdb-4edf-831b-ac652620f90b None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:55.932504 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05496f2b-efdb-4edf-831b-ac652620f90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:56.030997 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-05496f2b-efdb-4edf-831b-ac652620f90b None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:44:56.032721 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-05496f2b-efdb-4edf-831b-ac652620f90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:56.157891 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:56.170453 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 694/1365] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:44:56.217493 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76e2e3-75d5-409e-8139-c1e9e8cfdf47 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:56.217786 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76e2e3-75d5-409e-8139-c1e9e8cfdf47 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:56.218223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76e2e3-75d5-409e-8139-c1e9e8cfdf47 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:56.219886 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 672/1366] 10.222.0.39 () {54 vars in 962 bytes} [Tue Jul 26 04:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:44:56.227434 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7e58e-36d3-46e8-85c9-3ca0bf56d9ec None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:56.228052 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7e58e-36d3-46e8-85c9-3ca0bf56d9ec None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:56.228620 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7e58e-36d3-46e8-85c9-3ca0bf56d9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:56.358771 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-a9b7e58e-36d3-46e8-85c9-3ca0bf56d9ec None None] MFA Rules not processed for user `ae8593e125da4b208dd100608aa2b462`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:44:56.360870 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-a9b7e58e-36d3-46e8-85c9-3ca0bf56d9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:56.579146 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 695/1367] 10.222.0.39 () {58 vars in 1059 bytes} [Tue Jul 26 04:44:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:44:56.587745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76e2e3-75d5-409e-8139-c1e9e8cfdf47 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:44:56.589652 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-2b76e2e3-75d5-409e-8139-c1e9e8cfdf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:56.757405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76e2e3-75d5-409e-8139-c1e9e8cfdf47 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:44:56.780789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:56.888205 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953eac31-a2b7-44ea-90c2-df0732511f37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:44:56.888729 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953eac31-a2b7-44ea-90c2-df0732511f37 service nova] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:56.889001 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953eac31-a2b7-44ea-90c2-df0732511f37 service nova] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:56.889278 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953eac31-a2b7-44ea-90c2-df0732511f37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:56.891009 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-953eac31-a2b7-44ea-90c2-df0732511f37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:56.996999 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953eac31-a2b7-44ea-90c2-df0732511f37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:44:56.998689 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953eac31-a2b7-44ea-90c2-df0732511f37 service nova] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:44:57.022625 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 673/1368] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:44:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:44:57.973475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2db2ce-a6ff-400d-9e9c-dc3c1b8c7f0e None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:57.974205 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2db2ce-a6ff-400d-9e9c-dc3c1b8c7f0e None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:57.974205 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2db2ce-a6ff-400d-9e9c-dc3c1b8c7f0e None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:57.975716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 696/1369] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:44:57.981533 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc3f6e-6da7-460a-ab8c-e6589ff72a8e None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:57.981819 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc3f6e-6da7-460a-ab8c-e6589ff72a8e None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:57.982121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc3f6e-6da7-460a-ab8c-e6589ff72a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:58.017300 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:58.059486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-52fc3f6e-6da7-460a-ab8c-e6589ff72a8e None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:44:58.060802 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-52fc3f6e-6da7-460a-ab8c-e6589ff72a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:58.189327 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 674/1370] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:44:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:44:58.585957 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39012249-aefe-40ba-aa64-d6ebeb1a91b7 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:58.586578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39012249-aefe-40ba-aa64-d6ebeb1a91b7 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:58.586993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39012249-aefe-40ba-aa64-d6ebeb1a91b7 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:58.588623 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 697/1371] 10.222.0.39 () {54 vars in 964 bytes} [Tue Jul 26 04:44:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:44:58.594379 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e9efa-ac5f-48ac-ba05-b6012a52bdc6 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:58.597367 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e9efa-ac5f-48ac-ba05-b6012a52bdc6 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:58.598013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e9efa-ac5f-48ac-ba05-b6012a52bdc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:58.725514 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-9c9e9efa-ac5f-48ac-ba05-b6012a52bdc6 None None] MFA Rules not processed for user `9bb16e4960af4c03bc274dea6bea2e1a`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:44:58.727026 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-9c9e9efa-ac5f-48ac-ba05-b6012a52bdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:58.791444 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:58.831287 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 675/1372] 10.222.0.39 () {58 vars in 1061 bytes} [Tue Jul 26 04:44:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:44:58.840160 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39012249-aefe-40ba-aa64-d6ebeb1a91b7 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:44:58.842162 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-39012249-aefe-40ba-aa64-d6ebeb1a91b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:58.908555 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:58.993896 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39012249-aefe-40ba-aa64-d6ebeb1a91b7 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:44:59.082086 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6559e-01a4-452c-84fc-6a65338819f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:44:59.082643 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6559e-01a4-452c-84fc-6a65338819f4 service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:59.082994 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6559e-01a4-452c-84fc-6a65338819f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:59.083180 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6559e-01a4-452c-84fc-6a65338819f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:59.085280 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-9cc6559e-01a4-452c-84fc-6a65338819f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:59.212651 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:59.240894 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6559e-01a4-452c-84fc-6a65338819f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:44:59.243575 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6559e-01a4-452c-84fc-6a65338819f4 service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:44:59.247503 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40f0cc-5471-4ad1-b4e9-a8ad763dc1a6 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:59.248243 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40f0cc-5471-4ad1-b4e9-a8ad763dc1a6 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:59.248243 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40f0cc-5471-4ad1-b4e9-a8ad763dc1a6 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:59.250141 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 676/1373] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:44:59.256554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b8759-ecec-4c01-a7b0-ee5096c7cfa4 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:59.257110 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b8759-ecec-4c01-a7b0-ee5096c7cfa4 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:59.257639 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b8759-ecec-4c01-a7b0-ee5096c7cfa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:59.302175 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 698/1374] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:44:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:44:59.393269 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-146b8759-ecec-4c01-a7b0-ee5096c7cfa4 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:44:59.396170 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-146b8759-ecec-4c01-a7b0-ee5096c7cfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:59.551173 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 677/1375] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:44:59.598881 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6559e-01a4-452c-84fc-6a65338819f4 service cinder] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:44:59.600181 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-9cc6559e-01a4-452c-84fc-6a65338819f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:59.702021 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6559e-01a4-452c-84fc-6a65338819f4 service cinder] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:44:59.819092 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:44:59.839684 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf07f47-5711-4647-8390-ef8e7a4fc014 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:44:59.840612 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf07f47-5711-4647-8390-ef8e7a4fc014 service nova] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:44:59.841093 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf07f47-5711-4647-8390-ef8e7a4fc014 service nova] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:44:59.841563 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf07f47-5711-4647-8390-ef8e7a4fc014 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:44:59.844638 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-daf07f47-5711-4647-8390-ef8e7a4fc014 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:44:59.955366 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf07f47-5711-4647-8390-ef8e7a4fc014 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:44:59.957047 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf07f47-5711-4647-8390-ef8e7a4fc014 service nova] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:44:59.977439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 699/1376] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:44:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:45:02.055030 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774379d-f053-49ea-855a-67b07250f25a None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:02.055589 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774379d-f053-49ea-855a-67b07250f25a None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:02.055589 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774379d-f053-49ea-855a-67b07250f25a None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:02.056871 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 678/1377] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:45:02.062630 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb9bf4-9f5b-4bb0-a670-c7c36e0f2eb2 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:02.063146 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb9bf4-9f5b-4bb0-a670-c7c36e0f2eb2 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:02.063146 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb9bf4-9f5b-4bb0-a670-c7c36e0f2eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:02.132130 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-39fb9bf4-9f5b-4bb0-a670-c7c36e0f2eb2 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:45:02.133386 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-39fb9bf4-9f5b-4bb0-a670-c7c36e0f2eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:02.194571 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:02.235984 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 700/1378] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:45:02.280635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774379d-f053-49ea-855a-67b07250f25a None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:45:02.282292 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-7774379d-f053-49ea-855a-67b07250f25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:02.348468 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:02.485285 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774379d-f053-49ea-855a-67b07250f25a None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:45:02.618855 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2b52fd-2e1f-4f02-a55e-38356979e7ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:45:02.619394 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b52fd-2e1f-4f02-a55e-38356979e7ce service nova] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:02.619672 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b52fd-2e1f-4f02-a55e-38356979e7ce service nova] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:02.619912 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2b52fd-2e1f-4f02-a55e-38356979e7ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:02.621566 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-ee2b52fd-2e1f-4f02-a55e-38356979e7ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:02.634486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:02.721763 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b52fd-2e1f-4f02-a55e-38356979e7ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:45:02.723408 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2b52fd-2e1f-4f02-a55e-38356979e7ce service nova] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:45:02.744091 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 679/1379] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:45:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:45:04.873252 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922f828-45d6-44fb-991e-4d41f46b1018 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:04.873853 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922f828-45d6-44fb-991e-4d41f46b1018 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:04.874208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922f828-45d6-44fb-991e-4d41f46b1018 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:04.875733 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 701/1380] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:45:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:45:04.881440 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275af5d8-d86e-46e5-97a0-92608e3f03e3 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:04.881912 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275af5d8-d86e-46e5-97a0-92608e3f03e3 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:04.881912 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275af5d8-d86e-46e5-97a0-92608e3f03e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:04.969103 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-275af5d8-d86e-46e5-97a0-92608e3f03e3 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:45:04.971065 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-275af5d8-d86e-46e5-97a0-92608e3f03e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:05.098727 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:05.113179 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 680/1381] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:45:05.157141 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922f828-45d6-44fb-991e-4d41f46b1018 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:45:05.159050 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-5922f828-45d6-44fb-991e-4d41f46b1018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:05.338166 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922f828-45d6-44fb-991e-4d41f46b1018 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:45:05.399632 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:05.488708 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08064cc0-931f-4e60-93c3-930c130b8b8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:45:05.489465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08064cc0-931f-4e60-93c3-930c130b8b8a service nova] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:05.489798 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08064cc0-931f-4e60-93c3-930c130b8b8a service nova] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:05.490169 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08064cc0-931f-4e60-93c3-930c130b8b8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:05.491950 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-08064cc0-931f-4e60-93c3-930c130b8b8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:05.603239 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08064cc0-931f-4e60-93c3-930c130b8b8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:45:05.605246 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08064cc0-931f-4e60-93c3-930c130b8b8a service nova] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:45:05.629495 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 702/1382] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:45:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:45:07.713624 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5a4fc-07dd-46bb-82a8-fc6f0b07bf0d None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:07.714465 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5a4fc-07dd-46bb-82a8-fc6f0b07bf0d None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:07.714465 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5a4fc-07dd-46bb-82a8-fc6f0b07bf0d None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:07.715759 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 681/1383] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:45:07.722011 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba35ecc-94a5-4900-b18e-49c98477fc77 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:07.722666 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba35ecc-94a5-4900-b18e-49c98477fc77 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:07.723111 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba35ecc-94a5-4900-b18e-49c98477fc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:07.817844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-5ba35ecc-94a5-4900-b18e-49c98477fc77 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:45:07.819167 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-5ba35ecc-94a5-4900-b18e-49c98477fc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:07.821502 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:07.926233 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 703/1384] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:45:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:45:07.970281 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5a4fc-07dd-46bb-82a8-fc6f0b07bf0d None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:45:07.971754 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-2ea5a4fc-07dd-46bb-82a8-fc6f0b07bf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:08.160694 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5a4fc-07dd-46bb-82a8-fc6f0b07bf0d None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:45:08.238625 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:08.294622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73abf99-6fbc-46b8-9f3e-c659da2dc3a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:45:08.295288 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73abf99-6fbc-46b8-9f3e-c659da2dc3a8 service nova] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:08.295573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73abf99-6fbc-46b8-9f3e-c659da2dc3a8 service nova] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:08.295843 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73abf99-6fbc-46b8-9f3e-c659da2dc3a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:08.297563 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-f73abf99-6fbc-46b8-9f3e-c659da2dc3a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:08.396405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73abf99-6fbc-46b8-9f3e-c659da2dc3a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:45:08.398246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73abf99-6fbc-46b8-9f3e-c659da2dc3a8 service nova] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:45:08.421908 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 682/1385] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:45:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:45:10.543152 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c79bb-314d-408f-9a7f-f2347a563c46 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:10.543739 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c79bb-314d-408f-9a7f-f2347a563c46 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:10.543739 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c79bb-314d-408f-9a7f-f2347a563c46 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:10.545092 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 704/1386] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:45:10.551201 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ff519-24e6-4bf7-8da0-bd2b77aaa6a3 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:10.551748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ff519-24e6-4bf7-8da0-bd2b77aaa6a3 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:10.551748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ff519-24e6-4bf7-8da0-bd2b77aaa6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:10.635325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-a14ff519-24e6-4bf7-8da0-bd2b77aaa6a3 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:45:10.636586 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-a14ff519-24e6-4bf7-8da0-bd2b77aaa6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:10.674333 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:10.778030 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 683/1387] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:45:10.833505 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c79bb-314d-408f-9a7f-f2347a563c46 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:45:10.835962 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-6c6c79bb-314d-408f-9a7f-f2347a563c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:11.044845 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:11.065909 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c79bb-314d-408f-9a7f-f2347a563c46 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:45:11.239036 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473a761-a662-4966-b207-943913d98b20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:45:11.239688 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473a761-a662-4966-b207-943913d98b20 service nova] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:11.239971 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473a761-a662-4966-b207-943913d98b20 service nova] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:11.240236 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473a761-a662-4966-b207-943913d98b20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:11.241970 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-4473a761-a662-4966-b207-943913d98b20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:11.371868 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4473a761-a662-4966-b207-943913d98b20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:45:11.373643 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4473a761-a662-4966-b207-943913d98b20 service nova] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:45:11.379114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:11.394434 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 705/1388] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:45:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:45:13.500593 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92dc6a-6458-4c20-8f5b-ba101b30dd3c None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:13.501268 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92dc6a-6458-4c20-8f5b-ba101b30dd3c None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:13.501268 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92dc6a-6458-4c20-8f5b-ba101b30dd3c None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:13.502552 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 684/1389] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:45:13.508436 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7077a-56af-411c-a4db-d727daf302db None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:13.508932 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7077a-56af-411c-a4db-d727daf302db None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:13.509033 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d7077a-56af-411c-a4db-d727daf302db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:13.579606 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-58d7077a-56af-411c-a4db-d727daf302db None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:45:13.580956 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-58d7077a-56af-411c-a4db-d727daf302db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:13.687306 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 706/1390] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:45:13.731053 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92dc6a-6458-4c20-8f5b-ba101b30dd3c None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:45:13.732610 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-9d92dc6a-6458-4c20-8f5b-ba101b30dd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:13.893049 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92dc6a-6458-4c20-8f5b-ba101b30dd3c None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:45:13.904467 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:14.020263 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668442f-16e5-4979-8b2d-f88e8e670b2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:45:14.020926 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668442f-16e5-4979-8b2d-f88e8e670b2f service nova] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:14.021197 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668442f-16e5-4979-8b2d-f88e8e670b2f service nova] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:14.021460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668442f-16e5-4979-8b2d-f88e8e670b2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:14.023231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-9668442f-16e5-4979-8b2d-f88e8e670b2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:14.121546 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668442f-16e5-4979-8b2d-f88e8e670b2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:45:14.123247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668442f-16e5-4979-8b2d-f88e8e670b2f service nova] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:45:14.142732 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 685/1391] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:45:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:45:14.567273 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75550e-5f38-42e4-b33c-115351c3b7a6 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:14.567914 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75550e-5f38-42e4-b33c-115351c3b7a6 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:14.567914 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75550e-5f38-42e4-b33c-115351c3b7a6 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:14.569198 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 707/1392] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:45:14.575176 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6eda4-2876-47df-b8d0-7f8ebbb0dc36 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:14.575821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6eda4-2876-47df-b8d0-7f8ebbb0dc36 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:14.575821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6eda4-2876-47df-b8d0-7f8ebbb0dc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:14.595545 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:14.651125 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-85f6eda4-2876-47df-b8d0-7f8ebbb0dc36 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:45:14.652643 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-85f6eda4-2876-47df-b8d0-7f8ebbb0dc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:14.754506 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 686/1393] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:45:14.810697 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb50763-d020-488c-86df-4cf1040bacf0 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:14.810955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb50763-d020-488c-86df-4cf1040bacf0 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:14.811244 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb50763-d020-488c-86df-4cf1040bacf0 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:14.812611 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 708/1394] 10.222.0.39 () {54 vars in 966 bytes} [Tue Jul 26 04:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:45:14.818259 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d69c5b-200a-4d31-8d77-0c4f25e4567b None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:14.818466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d69c5b-200a-4d31-8d77-0c4f25e4567b None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:14.818698 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d69c5b-200a-4d31-8d77-0c4f25e4567b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:14.902257 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-a4d69c5b-200a-4d31-8d77-0c4f25e4567b None None] MFA Rules not processed for user `7cfbf2c03eb740ed8b72c4825cffc341`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:45:14.903615 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-a4d69c5b-200a-4d31-8d77-0c4f25e4567b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:14.943200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:14.986968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 687/1395] 10.222.0.39 () {58 vars in 1063 bytes} [Tue Jul 26 04:45:14 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:45:14.994617 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb50763-d020-488c-86df-4cf1040bacf0 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:45:14.996125 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-dfb50763-d020-488c-86df-4cf1040bacf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:15.087088 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:15.120464 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb50763-d020-488c-86df-4cf1040bacf0 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:45:15.202449 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c2626-0e4e-4922-86b8-b3f53b923c29 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfbf2c03eb740ed8b72c4825cffc341', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:45:15.203081 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c2626-0e4e-4922-86b8-b3f53b923c29 service glance] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:15.203376 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c2626-0e4e-4922-86b8-b3f53b923c29 service glance] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:15.203654 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c2626-0e4e-4922-86b8-b3f53b923c29 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:15.205311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-f82c2626-0e4e-4922-86b8-b3f53b923c29 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:15.351195 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c2626-0e4e-4922-86b8-b3f53b923c29 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:45:15.352569 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c2626-0e4e-4922-86b8-b3f53b923c29 service glance] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:45:15.369064 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:15.372339 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 709/1396] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:45:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:45:16.112515 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ccfcf-9589-479d-ad19-3314d877249a None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:16.113042 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ccfcf-9589-479d-ad19-3314d877249a None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:16.113151 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ccfcf-9589-479d-ad19-3314d877249a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:16.184619 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-fc9ccfcf-9589-479d-ad19-3314d877249a None None] MFA Rules not processed for user `b613dee1148c4822af2e7847b28cf4aa`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:45:16.185854 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-fc9ccfcf-9589-479d-ad19-3314d877249a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:16.196990 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc73c6e-b050-43ea-b77d-cb5297e194a0 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:16.197516 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc73c6e-b050-43ea-b77d-cb5297e194a0 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:16.197516 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc73c6e-b050-43ea-b77d-cb5297e194a0 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:16.198879 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 710/1397] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:45:16.204044 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a06ae-672c-48c0-8a79-130d03f13f17 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:16.204361 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a06ae-672c-48c0-8a79-130d03f13f17 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:16.204644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a06ae-672c-48c0-8a79-130d03f13f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:16.274806 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 688/1398] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Jul 26 04:45:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:45:16.278033 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-a58a06ae-672c-48c0-8a79-130d03f13f17 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:45:16.279296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-a58a06ae-672c-48c0-8a79-130d03f13f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:16.322617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a93808-a465-4604-8283-3fe1ab1da808 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:16.322906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a93808-a465-4604-8283-3fe1ab1da808 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:16.323193 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a93808-a465-4604-8283-3fe1ab1da808 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:16.324708 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 689/1399] 10.222.0.39 () {54 vars in 943 bytes} [Tue Jul 26 04:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:45:16.331015 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70966ce-955e-47e5-b026-d2204be60ddc None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:16.331316 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70966ce-955e-47e5-b026-d2204be60ddc None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:16.331600 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70966ce-955e-47e5-b026-d2204be60ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:16.387199 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 711/1400] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:45:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:45:16.391885 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:16.411247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-e70966ce-955e-47e5-b026-d2204be60ddc None None] MFA Rules not processed for user `0e089e39e9de419b9e2fb1d7fc2d245a`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:45:16.412454 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-e70966ce-955e-47e5-b026-d2204be60ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:16.433487 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a06ae-672c-48c0-8a79-130d03f13f17 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:45:16.434633 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-a58a06ae-672c-48c0-8a79-130d03f13f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:16.523206 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:16.526626 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 690/1401] 10.222.0.39 () {58 vars in 1040 bytes} [Tue Jul 26 04:45:16 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:45:16.536117 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70966ce-955e-47e5-b026-d2204be60ddc None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:45:16.546612 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70966ce-955e-47e5-b026-d2204be60ddc None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:45:16.566759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a06ae-672c-48c0-8a79-130d03f13f17 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:45:16.650597 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:16.657132 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ae45b-cde7-43cd-a9e6-131d298cce7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e089e39e9de419b9e2fb1d7fc2d245a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:45:16.657967 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ae45b-cde7-43cd-a9e6-131d298cce7b service swift] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:16.658415 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ae45b-cde7-43cd-a9e6-131d298cce7b service swift] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:16.658688 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ae45b-cde7-43cd-a9e6-131d298cce7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:16.660530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-231ae45b-cde7-43cd-a9e6-131d298cce7b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:16.692248 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599203a6-9b97-43a0-8565-71704bb717a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:45:16.692902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599203a6-9b97-43a0-8565-71704bb717a0 service nova] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:16.693174 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599203a6-9b97-43a0-8565-71704bb717a0 service nova] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:16.693450 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599203a6-9b97-43a0-8565-71704bb717a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:16.695121 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-599203a6-9b97-43a0-8565-71704bb717a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:16.752409 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ae45b-cde7-43cd-a9e6-131d298cce7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:45:16.754085 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ae45b-cde7-43cd-a9e6-131d298cce7b service swift] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:45:16.762683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 691/1402] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 04:45:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 04:45:16.774113 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:16.792894 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599203a6-9b97-43a0-8565-71704bb717a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:45:16.795932 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599203a6-9b97-43a0-8565-71704bb717a0 service nova] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:45:16.815880 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 712/1403] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:45:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:45:18.930889 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1a9df-b527-46f1-a45b-c9fd103aae87 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:18.931509 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1a9df-b527-46f1-a45b-c9fd103aae87 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:18.931509 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1a9df-b527-46f1-a45b-c9fd103aae87 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:18.932797 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 692/1404] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:45:18.938351 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308c120-917b-4128-bdb9-fe0309b3b55d None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:18.938807 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308c120-917b-4128-bdb9-fe0309b3b55d None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:18.938892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e308c120-917b-4128-bdb9-fe0309b3b55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:19.019638 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-e308c120-917b-4128-bdb9-fe0309b3b55d None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:45:19.020853 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-e308c120-917b-4128-bdb9-fe0309b3b55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:19.183081 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 713/1405] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:45:19.228178 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1a9df-b527-46f1-a45b-c9fd103aae87 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:45:19.229773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-a3b1a9df-b527-46f1-a45b-c9fd103aae87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:19.389256 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:19.402842 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1a9df-b527-46f1-a45b-c9fd103aae87 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:45:19.531106 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5222d9-431f-4dd5-8c00-9fd534abdc4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:45:19.532584 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5222d9-431f-4dd5-8c00-9fd534abdc4a service nova] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:19.532946 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5222d9-431f-4dd5-8c00-9fd534abdc4a service nova] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:19.533279 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5222d9-431f-4dd5-8c00-9fd534abdc4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:19.535050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-3b5222d9-431f-4dd5-8c00-9fd534abdc4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:19.636406 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5222d9-431f-4dd5-8c00-9fd534abdc4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:45:19.638050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5222d9-431f-4dd5-8c00-9fd534abdc4a service nova] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:45:19.648445 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:19.659231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 693/1406] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:45:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:45:21.695490 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46129b2a-df89-4715-b786-4c3dbd36eb60 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:21.696083 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46129b2a-df89-4715-b786-4c3dbd36eb60 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:21.696083 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46129b2a-df89-4715-b786-4c3dbd36eb60 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:21.697409 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 714/1407] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:45:21.702892 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994cd8b-a266-4db7-8687-62f5186e5388 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:21.703319 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994cd8b-a266-4db7-8687-62f5186e5388 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:21.703501 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994cd8b-a266-4db7-8687-62f5186e5388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:21.780695 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-2994cd8b-a266-4db7-8687-62f5186e5388 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:45:21.781921 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-2994cd8b-a266-4db7-8687-62f5186e5388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:21.895534 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 694/1408] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:45:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:45:21.939987 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46129b2a-df89-4715-b786-4c3dbd36eb60 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:45:21.941625 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-46129b2a-df89-4715-b786-4c3dbd36eb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:22.004008 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:22.109996 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46129b2a-df89-4715-b786-4c3dbd36eb60 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:45:22.245744 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb502300-44f9-43da-989f-0ac932da4337 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:45:22.246408 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb502300-44f9-43da-989f-0ac932da4337 service nova] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:22.246836 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb502300-44f9-43da-989f-0ac932da4337 service nova] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:22.247109 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb502300-44f9-43da-989f-0ac932da4337 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:22.249079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-cb502300-44f9-43da-989f-0ac932da4337 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:22.263075 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:22.359438 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb502300-44f9-43da-989f-0ac932da4337 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:45:22.361183 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb502300-44f9-43da-989f-0ac932da4337 service nova] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:45:22.381650 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 715/1409] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:45:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:45:31.893034 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=67 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:32.377752 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=39 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:38.878992 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2acf2b-a1fd-4f56-8854-02d6acb22014 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:38.879721 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2acf2b-a1fd-4f56-8854-02d6acb22014 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:38.879721 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2acf2b-a1fd-4f56-8854-02d6acb22014 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:38.880968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 695/1410] 10.222.0.39 () {54 vars in 918 bytes} [Tue Jul 26 04:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:45:38.886622 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e493495-2fa1-4d58-a9ad-cb588a6a458d None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:38.887086 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e493495-2fa1-4d58-a9ad-cb588a6a458d None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:38.887215 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e493495-2fa1-4d58-a9ad-cb588a6a458d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:38.969745 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-8e493495-2fa1-4d58-a9ad-cb588a6a458d None None] MFA Rules not processed for user `21dfe7b4d6524ec2885224d77395b00b`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:45:38.971003 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-8e493495-2fa1-4d58-a9ad-cb588a6a458d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:39.085379 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 716/1411] 10.222.0.39 () {58 vars in 1015 bytes} [Tue Jul 26 04:45:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:45:39.100277 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ed3e1-9a08-43ea-8de8-e597d2ffd152 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:39.100558 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ed3e1-9a08-43ea-8de8-e597d2ffd152 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:39.100828 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ed3e1-9a08-43ea-8de8-e597d2ffd152 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:39.102219 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 696/1412] 10.222.0.39 () {54 vars in 918 bytes} [Tue Jul 26 04:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:45:39.107131 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278b446-f979-424d-93fd-26992ba7680c None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:39.107426 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278b446-f979-424d-93fd-26992ba7680c None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:39.107697 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278b446-f979-424d-93fd-26992ba7680c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:39.186685 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:39.190293 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-c278b446-f979-424d-93fd-26992ba7680c None None] MFA Rules not processed for user `ae8593e125da4b208dd100608aa2b462`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:45:39.192053 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-c278b446-f979-424d-93fd-26992ba7680c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:39.321193 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 717/1413] 10.222.0.39 () {58 vars in 1015 bytes} [Tue Jul 26 04:45:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:45:41.826494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8885f-17a7-4a40-9efa-3eae1116dac0 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:41.827107 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8885f-17a7-4a40-9efa-3eae1116dac0 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:41.827107 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8885f-17a7-4a40-9efa-3eae1116dac0 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:41.828374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 697/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 04:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:45:41.834215 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ca6de-3592-42c9-8ec9-d756aa27571a None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:41.834687 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ca6de-3592-42c9-8ec9-d756aa27571a None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:41.834790 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ca6de-3592-42c9-8ec9-d756aa27571a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:41.907554 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-616ca6de-3592-42c9-8ec9-d756aa27571a None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:45:41.909098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-616ca6de-3592-42c9-8ec9-d756aa27571a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:41.989844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:42.036206 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 718/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 04:45:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:45:42.080182 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8885f-17a7-4a40-9efa-3eae1116dac0 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:45:42.081963 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-61f8885f-17a7-4a40-9efa-3eae1116dac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:42.234364 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8885f-17a7-4a40-9efa-3eae1116dac0 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:45:42.319281 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:42.362818 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfb29b-cbdb-4477-9942-7bee8925fd5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:45:42.363334 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfb29b-cbdb-4477-9942-7bee8925fd5c service nova] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:42.363611 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfb29b-cbdb-4477-9942-7bee8925fd5c service nova] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:42.363955 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfb29b-cbdb-4477-9942-7bee8925fd5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:42.365585 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-dcbfb29b-cbdb-4477-9942-7bee8925fd5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:42.592051 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfb29b-cbdb-4477-9942-7bee8925fd5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:45:42.594406 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfb29b-cbdb-4477-9942-7bee8925fd5c service nova] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:45:42.615858 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 698/1416] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:45:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:45:43.535740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ff43a-c5cc-43fd-8204-c6412f8ab5f0 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:43.536338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ff43a-c5cc-43fd-8204-c6412f8ab5f0 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:43.536338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ff43a-c5cc-43fd-8204-c6412f8ab5f0 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:43.538167 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 719/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 04:45:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:45:43.543533 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4f5d5-cc93-442c-95e6-d2d348bfb192 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:43.544065 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4f5d5-cc93-442c-95e6-d2d348bfb192 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:43.544065 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4f5d5-cc93-442c-95e6-d2d348bfb192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:43.636037 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-9dd4f5d5-cc93-442c-95e6-d2d348bfb192 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:45:43.637343 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-9dd4f5d5-cc93-442c-95e6-d2d348bfb192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:43.670083 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:43.744325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 699/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 04:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:45:43.898852 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ff43a-c5cc-43fd-8204-c6412f8ab5f0 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:45:43.900294 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-103ff43a-c5cc-43fd-8204-c6412f8ab5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:44.061814 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ff43a-c5cc-43fd-8204-c6412f8ab5f0 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:45:44.107157 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:44.191384 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1393832-fa0b-4c0c-9187-f835b033d699 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:45:44.192243 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1393832-fa0b-4c0c-9187-f835b033d699 service nova] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:44.192568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1393832-fa0b-4c0c-9187-f835b033d699 service nova] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:44.192890 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1393832-fa0b-4c0c-9187-f835b033d699 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:44.194627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-b1393832-fa0b-4c0c-9187-f835b033d699 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:44.295601 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1393832-fa0b-4c0c-9187-f835b033d699 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:45:44.297338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1393832-fa0b-4c0c-9187-f835b033d699 service nova] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:45:44.317559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 720/1419] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:45:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:45:45.229618 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3152bfd-7c0d-40d0-a649-51d5f4452046 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:45.230271 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3152bfd-7c0d-40d0-a649-51d5f4452046 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:45.230271 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3152bfd-7c0d-40d0-a649-51d5f4452046 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:45.231781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 700/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 04:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:45:45.237391 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1944f57-5b89-4337-9888-dfcdd3efb236 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:45.237892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1944f57-5b89-4337-9888-dfcdd3efb236 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:45.238040 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1944f57-5b89-4337-9888-dfcdd3efb236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:45.300004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:45.324263 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-c1944f57-5b89-4337-9888-dfcdd3efb236 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:45:45.325494 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-c1944f57-5b89-4337-9888-dfcdd3efb236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:45.429714 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 721/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 04:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:45:45.581440 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3152bfd-7c0d-40d0-a649-51d5f4452046 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:45:45.583288 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-a3152bfd-7c0d-40d0-a649-51d5f4452046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:45.748985 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3152bfd-7c0d-40d0-a649-51d5f4452046 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:45:45.771902 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:45.890994 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45d701-acf7-4a85-8093-fc31f6ac5abb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:45:45.891618 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45d701-acf7-4a85-8093-fc31f6ac5abb service nova] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:45.891915 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45d701-acf7-4a85-8093-fc31f6ac5abb service nova] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:45.892170 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45d701-acf7-4a85-8093-fc31f6ac5abb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:45.894016 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-fc45d701-acf7-4a85-8093-fc31f6ac5abb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:45.992832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45d701-acf7-4a85-8093-fc31f6ac5abb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:45:45.994715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45d701-acf7-4a85-8093-fc31f6ac5abb service nova] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:45:46.016700 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 701/1422] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:45:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:45:46.891764 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d086a-08df-40c6-9a9d-1ff62f1ae96c None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:46.892407 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d086a-08df-40c6-9a9d-1ff62f1ae96c None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:46.892407 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d086a-08df-40c6-9a9d-1ff62f1ae96c None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:46.893693 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 722/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 04:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:45:46.899775 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c3e84-f489-481c-9462-5ed544214a71 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:46.900325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c3e84-f489-481c-9462-5ed544214a71 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:46.900425 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c3e84-f489-481c-9462-5ed544214a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:46.934368 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:47.011567 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-3e7c3e84-f489-481c-9462-5ed544214a71 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:45:47.012802 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-3e7c3e84-f489-481c-9462-5ed544214a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:47.127379 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 702/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 04:45:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:45:47.277802 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d086a-08df-40c6-9a9d-1ff62f1ae96c None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:45:47.279462 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-3e3d086a-08df-40c6-9a9d-1ff62f1ae96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:47.406645 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:47.445942 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d086a-08df-40c6-9a9d-1ff62f1ae96c None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:45:47.569116 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba520348-3fcb-47f6-ad3a-b87e92c0342f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:45:47.569748 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba520348-3fcb-47f6-ad3a-b87e92c0342f service nova] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:47.570054 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba520348-3fcb-47f6-ad3a-b87e92c0342f service nova] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:47.570331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba520348-3fcb-47f6-ad3a-b87e92c0342f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:47.571992 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-ba520348-3fcb-47f6-ad3a-b87e92c0342f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:47.655704 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:47.678831 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba520348-3fcb-47f6-ad3a-b87e92c0342f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:45:47.680469 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba520348-3fcb-47f6-ad3a-b87e92c0342f service nova] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:45:47.703319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 723/1425] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:45:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:45:48.584566 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf5fe1-a5e8-40ee-ab90-41624d36e8d5 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:48.585193 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf5fe1-a5e8-40ee-ab90-41624d36e8d5 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:48.585193 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf5fe1-a5e8-40ee-ab90-41624d36e8d5 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:48.586531 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 703/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 04:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:45:48.592525 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286eb4ee-d113-4b33-9a18-38ddda569e7e None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:48.593175 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286eb4ee-d113-4b33-9a18-38ddda569e7e None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:48.593175 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286eb4ee-d113-4b33-9a18-38ddda569e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:48.693387 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-286eb4ee-d113-4b33-9a18-38ddda569e7e None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:45:48.694779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-286eb4ee-d113-4b33-9a18-38ddda569e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:48.815532 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 724/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 04:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:45:48.972947 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf5fe1-a5e8-40ee-ab90-41624d36e8d5 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:45:48.974615 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-7ddf5fe1-a5e8-40ee-ab90-41624d36e8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:49.083644 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:49.166570 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf5fe1-a5e8-40ee-ab90-41624d36e8d5 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:45:49.297430 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3af0b4-8204-46b6-bdc1-fbe1d197003c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:45:49.298096 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3af0b4-8204-46b6-bdc1-fbe1d197003c service nova] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:49.298371 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3af0b4-8204-46b6-bdc1-fbe1d197003c service nova] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:49.298638 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3af0b4-8204-46b6-bdc1-fbe1d197003c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:49.300324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-2c3af0b4-8204-46b6-bdc1-fbe1d197003c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:49.356017 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:49.402479 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3af0b4-8204-46b6-bdc1-fbe1d197003c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:45:49.404370 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3af0b4-8204-46b6-bdc1-fbe1d197003c service nova] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:45:49.424373 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 704/1428] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:45:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:45:50.449676 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df4751-b5e9-477f-b59a-a4a3d2ad2875 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:50.450661 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df4751-b5e9-477f-b59a-a4a3d2ad2875 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:50.450661 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df4751-b5e9-477f-b59a-a4a3d2ad2875 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:50.452169 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 725/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 04:45:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:45:50.458305 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5824a2a-6d45-43de-8dbe-1ac3c6d0daaa None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:50.458854 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5824a2a-6d45-43de-8dbe-1ac3c6d0daaa None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:50.458989 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5824a2a-6d45-43de-8dbe-1ac3c6d0daaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:50.540501 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-a5824a2a-6d45-43de-8dbe-1ac3c6d0daaa None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:45:50.541746 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-a5824a2a-6d45-43de-8dbe-1ac3c6d0daaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:50.668267 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 705/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 04:45:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:45:50.822587 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df4751-b5e9-477f-b59a-a4a3d2ad2875 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:45:50.824123 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-29df4751-b5e9-477f-b59a-a4a3d2ad2875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:50.876421 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:50.987615 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df4751-b5e9-477f-b59a-a4a3d2ad2875 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:45:51.113218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc821b24-4ace-4b01-8872-ec1f04ccac61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:45:51.113766 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc821b24-4ace-4b01-8872-ec1f04ccac61 service nova] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:51.114071 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc821b24-4ace-4b01-8872-ec1f04ccac61 service nova] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:51.114364 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc821b24-4ace-4b01-8872-ec1f04ccac61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:51.116078 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-fc821b24-4ace-4b01-8872-ec1f04ccac61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:51.124290 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:51.224352 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc821b24-4ace-4b01-8872-ec1f04ccac61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:45:51.226062 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc821b24-4ace-4b01-8872-ec1f04ccac61 service nova] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:45:51.247318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 726/1431] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:45:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:45:52.076531 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf3390-f314-424f-96f1-1668a307035f None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:52.077209 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf3390-f314-424f-96f1-1668a307035f None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:52.077209 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf3390-f314-424f-96f1-1668a307035f None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:52.078653 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 706/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 04:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:45:52.084494 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e1300-5851-483a-a1f6-97aec489c60b None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:52.085127 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e1300-5851-483a-a1f6-97aec489c60b None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:52.085127 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e1300-5851-483a-a1f6-97aec489c60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:52.196559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-085e1300-5851-483a-a1f6-97aec489c60b None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:45:52.198754 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-085e1300-5851-483a-a1f6-97aec489c60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:52.324707 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:52.360026 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 727/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 04:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:45:52.521481 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf3390-f314-424f-96f1-1668a307035f None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:45:52.523099 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-a1cf3390-f314-424f-96f1-1668a307035f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:52.542699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:52.701474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf3390-f314-424f-96f1-1668a307035f None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:45:52.807930 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:52.838366 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac22c14-836a-4b66-aaab-8ef085a76d37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:45:52.838992 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac22c14-836a-4b66-aaab-8ef085a76d37 service nova] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:52.839266 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac22c14-836a-4b66-aaab-8ef085a76d37 service nova] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:52.839609 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac22c14-836a-4b66-aaab-8ef085a76d37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:52.841319 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-dac22c14-836a-4b66-aaab-8ef085a76d37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:52.946016 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac22c14-836a-4b66-aaab-8ef085a76d37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:45:52.947765 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac22c14-836a-4b66-aaab-8ef085a76d37 service nova] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:45:52.972427 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 707/1434] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:45:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:45:53.816005 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f307fd5-5d48-4122-9f0f-6ad30bf3c2a2 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:53.816698 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f307fd5-5d48-4122-9f0f-6ad30bf3c2a2 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:53.816698 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f307fd5-5d48-4122-9f0f-6ad30bf3c2a2 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:53.818108 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 728/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 04:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:45:53.827529 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f04666-6441-4983-bfd0-219542cface3 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:53.828160 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f04666-6441-4983-bfd0-219542cface3 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:53.828392 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f04666-6441-4983-bfd0-219542cface3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:53.932382 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-11f04666-6441-4983-bfd0-219542cface3 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:45:53.933542 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-11f04666-6441-4983-bfd0-219542cface3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:54.002360 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:54.095457 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 708/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 04:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:45:54.247298 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f307fd5-5d48-4122-9f0f-6ad30bf3c2a2 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:45:54.249052 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-8f307fd5-5d48-4122-9f0f-6ad30bf3c2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:54.481933 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f307fd5-5d48-4122-9f0f-6ad30bf3c2a2 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:45:54.548296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:54.619164 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae07b81-bcb6-4ae3-884c-1dc05902724a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:45:54.619955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae07b81-bcb6-4ae3-884c-1dc05902724a service nova] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:54.620349 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae07b81-bcb6-4ae3-884c-1dc05902724a service nova] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:54.620768 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae07b81-bcb6-4ae3-884c-1dc05902724a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:54.622647 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-dae07b81-bcb6-4ae3-884c-1dc05902724a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:54.729265 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae07b81-bcb6-4ae3-884c-1dc05902724a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:45:54.731240 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae07b81-bcb6-4ae3-884c-1dc05902724a service nova] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:45:54.752715 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 729/1437] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:45:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:45:55.587647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968326f0-f612-4236-b6ea-0a78652b3a53 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:55.588395 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968326f0-f612-4236-b6ea-0a78652b3a53 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:55.588395 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968326f0-f612-4236-b6ea-0a78652b3a53 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:55.590027 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 709/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 04:45:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:45:55.595674 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853d041-36e0-486f-af5b-aed6c110afbc None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:55.596246 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853d041-36e0-486f-af5b-aed6c110afbc None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:55.596410 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853d041-36e0-486f-af5b-aed6c110afbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:55.687435 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-0853d041-36e0-486f-af5b-aed6c110afbc None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:45:55.688849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-0853d041-36e0-486f-af5b-aed6c110afbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:55.691287 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:55.828603 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 730/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 04:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:45:55.980000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968326f0-f612-4236-b6ea-0a78652b3a53 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:45:55.981591 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-968326f0-f612-4236-b6ea-0a78652b3a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:56.149033 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968326f0-f612-4236-b6ea-0a78652b3a53 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:45:56.194176 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:56.304303 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffb8e0-4a6f-485d-b862-9841b71a4703 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:45:56.304958 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffb8e0-4a6f-485d-b862-9841b71a4703 service nova] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:56.305234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffb8e0-4a6f-485d-b862-9841b71a4703 service nova] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:56.305502 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffb8e0-4a6f-485d-b862-9841b71a4703 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:56.307371 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-e5ffb8e0-4a6f-485d-b862-9841b71a4703 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:56.412691 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffb8e0-4a6f-485d-b862-9841b71a4703 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:45:56.414447 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffb8e0-4a6f-485d-b862-9841b71a4703 service nova] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:45:56.447533 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 710/1440] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:45:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:45:58.391656 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8bba7-bc31-4e4a-b472-9c27047ff380 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:58.392277 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8bba7-bc31-4e4a-b472-9c27047ff380 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:58.392277 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8bba7-bc31-4e4a-b472-9c27047ff380 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:58.393743 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 731/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 04:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:45:58.400386 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c086dc5-4d9a-42fc-b3fd-b0608eb96a5d None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:58.400989 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c086dc5-4d9a-42fc-b3fd-b0608eb96a5d None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:58.400989 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c086dc5-4d9a-42fc-b3fd-b0608eb96a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:58.449409 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:58.478603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-1c086dc5-4d9a-42fc-b3fd-b0608eb96a5d None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:45:58.479858 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-1c086dc5-4d9a-42fc-b3fd-b0608eb96a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:58.595237 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 711/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 04:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:45:58.635203 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8bba7-bc31-4e4a-b472-9c27047ff380 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:45:58.637176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-eac8bba7-bc31-4e4a-b472-9c27047ff380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:58.797555 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8bba7-bc31-4e4a-b472-9c27047ff380 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:45:58.835914 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:45:58.887291 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1c074-d259-4f66-8686-510c300aa776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:45:58.888014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1c074-d259-4f66-8686-510c300aa776 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:45:58.888401 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1c074-d259-4f66-8686-510c300aa776 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:45:58.888780 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1c074-d259-4f66-8686-510c300aa776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:45:58.890780 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-cde1c074-d259-4f66-8686-510c300aa776 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:45:59.054961 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1c074-d259-4f66-8686-510c300aa776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:45:59.057551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1c074-d259-4f66-8686-510c300aa776 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:45:59.092791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 732/1443] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:45:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:46:01.324831 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7d5ea-16ad-40ab-ba76-dac74241a2de None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:01.325413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7d5ea-16ad-40ab-ba76-dac74241a2de None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:01.325579 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7d5ea-16ad-40ab-ba76-dac74241a2de None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:01.327276 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 712/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 04:46:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:46:01.333336 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85c7c2-ad15-468c-b1ca-c6654ecd97b3 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:01.333918 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85c7c2-ad15-468c-b1ca-c6654ecd97b3 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:01.333918 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85c7c2-ad15-468c-b1ca-c6654ecd97b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:01.446192 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-bb85c7c2-ad15-468c-b1ca-c6654ecd97b3 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:46:01.448289 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-bb85c7c2-ad15-468c-b1ca-c6654ecd97b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:01.471848 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:01.599627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 733/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 04:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:46:01.639274 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7d5ea-16ad-40ab-ba76-dac74241a2de None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:46:01.640833 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-b9c7d5ea-16ad-40ab-ba76-dac74241a2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:01.767790 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7d5ea-16ad-40ab-ba76-dac74241a2de None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:46:01.781052 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:01.847317 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22be27-b0a7-4a0e-bd5e-fb9d4e1c2561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:46:01.847941 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22be27-b0a7-4a0e-bd5e-fb9d4e1c2561 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:01.848244 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22be27-b0a7-4a0e-bd5e-fb9d4e1c2561 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:01.848514 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22be27-b0a7-4a0e-bd5e-fb9d4e1c2561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:01.850239 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-5b22be27-b0a7-4a0e-bd5e-fb9d4e1c2561 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:01.972420 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b22be27-b0a7-4a0e-bd5e-fb9d4e1c2561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:46:01.973898 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b22be27-b0a7-4a0e-bd5e-fb9d4e1c2561 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:46:01.993275 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 713/1446] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:46:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:46:04.500796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6621d-f14b-4448-9998-7f365a471be9 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:04.501405 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6621d-f14b-4448-9998-7f365a471be9 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:04.501405 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a6621d-f14b-4448-9998-7f365a471be9 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:04.502876 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 734/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 04:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:46:04.508848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad0f28-6922-48bb-b69d-100a7162b206 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:04.509325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad0f28-6922-48bb-b69d-100a7162b206 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:04.509434 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad0f28-6922-48bb-b69d-100a7162b206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:04.564073 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:04.585109 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-2cad0f28-6922-48bb-b69d-100a7162b206 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:46:04.586378 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-2cad0f28-6922-48bb-b69d-100a7162b206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:04.705871 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 714/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 04:46:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:46:04.746347 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6621d-f14b-4448-9998-7f365a471be9 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:46:04.748076 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-73a6621d-f14b-4448-9998-7f365a471be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:04.863877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a6621d-f14b-4448-9998-7f365a471be9 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:46:04.907425 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:04.946024 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a6f09-cef7-47ad-891f-43b7c950dd59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:46:04.946647 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a6f09-cef7-47ad-891f-43b7c950dd59 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:04.946931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a6f09-cef7-47ad-891f-43b7c950dd59 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:04.947200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a6f09-cef7-47ad-891f-43b7c950dd59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:04.948905 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-437a6f09-cef7-47ad-891f-43b7c950dd59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:05.083295 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a6f09-cef7-47ad-891f-43b7c950dd59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:46:05.084791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a6f09-cef7-47ad-891f-43b7c950dd59 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:46:05.105138 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 735/1449] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:46:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:46:07.301531 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0ac84-8437-4e20-b18f-8f93e9028ae7 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:07.302162 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0ac84-8437-4e20-b18f-8f93e9028ae7 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:07.302162 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0ac84-8437-4e20-b18f-8f93e9028ae7 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:07.303463 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 715/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 04:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:46:07.312105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80357e70-ea5e-4468-aeb6-9e60d853d1f4 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:07.312858 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80357e70-ea5e-4468-aeb6-9e60d853d1f4 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:07.313021 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80357e70-ea5e-4468-aeb6-9e60d853d1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:07.407165 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-80357e70-ea5e-4468-aeb6-9e60d853d1f4 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:46:07.409249 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-80357e70-ea5e-4468-aeb6-9e60d853d1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:07.445943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:07.563912 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 736/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 04:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:46:07.629028 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0ac84-8437-4e20-b18f-8f93e9028ae7 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:46:07.630708 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-8bc0ac84-8437-4e20-b18f-8f93e9028ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:07.749126 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0ac84-8437-4e20-b18f-8f93e9028ae7 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:46:07.771977 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:07.841882 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26103142-a4f3-4378-9230-54049d46a106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:46:07.842560 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26103142-a4f3-4378-9230-54049d46a106 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:07.842845 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26103142-a4f3-4378-9230-54049d46a106 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:07.843116 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26103142-a4f3-4378-9230-54049d46a106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:07.844839 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-26103142-a4f3-4378-9230-54049d46a106 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:07.968153 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26103142-a4f3-4378-9230-54049d46a106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:46:07.969625 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26103142-a4f3-4378-9230-54049d46a106 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:46:07.988744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 716/1452] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:46:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:46:10.542054 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad9511-fcad-445c-839f-96ffb74c918b None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:10.542677 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad9511-fcad-445c-839f-96ffb74c918b None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:10.542677 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad9511-fcad-445c-839f-96ffb74c918b None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:10.544237 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 737/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 04:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:46:10.550769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6080d-974d-4a07-8682-c613b3f8dbe6 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:10.551374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6080d-974d-4a07-8682-c613b3f8dbe6 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:10.551374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6080d-974d-4a07-8682-c613b3f8dbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:10.628321 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:10.632675 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-3ff6080d-974d-4a07-8682-c613b3f8dbe6 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:46:10.634277 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-3ff6080d-974d-4a07-8682-c613b3f8dbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:10.740224 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 717/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 04:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:46:10.779300 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad9511-fcad-445c-839f-96ffb74c918b None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:46:10.782381 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-26ad9511-fcad-445c-839f-96ffb74c918b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:10.948926 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad9511-fcad-445c-839f-96ffb74c918b None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:46:11.001130 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:11.028863 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa845cc-8edf-4379-8f5e-2d87fa1a6ceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:46:11.029556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa845cc-8edf-4379-8f5e-2d87fa1a6ceb service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:11.029877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa845cc-8edf-4379-8f5e-2d87fa1a6ceb service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:11.030218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa845cc-8edf-4379-8f5e-2d87fa1a6ceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:11.031954 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-ffa845cc-8edf-4379-8f5e-2d87fa1a6ceb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:11.176059 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa845cc-8edf-4379-8f5e-2d87fa1a6ceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:46:11.177540 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa845cc-8edf-4379-8f5e-2d87fa1a6ceb service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:46:11.198573 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 738/1455] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:46:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:46:13.345120 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f3ab4-51aa-4453-b704-b3e367dfa3d0 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:13.346068 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f3ab4-51aa-4453-b704-b3e367dfa3d0 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:13.346068 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f3ab4-51aa-4453-b704-b3e367dfa3d0 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:13.347714 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 718/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 04:46:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:46:13.354169 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc40ef-39f8-40f8-88d4-040de856f50e None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:13.354871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc40ef-39f8-40f8-88d4-040de856f50e None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:13.354871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc40ef-39f8-40f8-88d4-040de856f50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:13.435140 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-13bc40ef-39f8-40f8-88d4-040de856f50e None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:46:13.436409 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-13bc40ef-39f8-40f8-88d4-040de856f50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:13.469513 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:13.546631 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 739/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 04:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:46:13.610584 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f3ab4-51aa-4453-b704-b3e367dfa3d0 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:46:13.612238 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-d44f3ab4-51aa-4453-b704-b3e367dfa3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:13.742201 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f3ab4-51aa-4453-b704-b3e367dfa3d0 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:46:13.774220 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:13.825871 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec73339-d273-42cd-9aa5-b23f72527539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:46:13.826537 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec73339-d273-42cd-9aa5-b23f72527539 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:13.826899 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec73339-d273-42cd-9aa5-b23f72527539 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:13.827177 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec73339-d273-42cd-9aa5-b23f72527539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:13.828907 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-aec73339-d273-42cd-9aa5-b23f72527539 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:13.974652 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec73339-d273-42cd-9aa5-b23f72527539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:46:13.976296 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec73339-d273-42cd-9aa5-b23f72527539 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:46:13.997857 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 719/1458] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:46:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:46:16.104405 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033d2c6-f4b1-4412-bfe5-f2fd21fbfcfa None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:16.104990 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033d2c6-f4b1-4412-bfe5-f2fd21fbfcfa None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:16.105123 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033d2c6-f4b1-4412-bfe5-f2fd21fbfcfa None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:16.107770 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 740/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 04:46:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:46:16.116173 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2725b-415f-46de-99bd-e4303976d886 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:16.116790 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2725b-415f-46de-99bd-e4303976d886 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:16.116790 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2725b-415f-46de-99bd-e4303976d886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:16.187601 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-64f2725b-415f-46de-99bd-e4303976d886 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:46:16.188888 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-64f2725b-415f-46de-99bd-e4303976d886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:16.198349 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:16.307627 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 720/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 04:46:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:46:16.345526 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033d2c6-f4b1-4412-bfe5-f2fd21fbfcfa None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:46:16.347107 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-e033d2c6-f4b1-4412-bfe5-f2fd21fbfcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:16.467444 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033d2c6-f4b1-4412-bfe5-f2fd21fbfcfa None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:46:16.539353 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:16.564430 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27936ecc-0b21-4dc9-9ce2-e15a64c2abcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:46:16.565221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27936ecc-0b21-4dc9-9ce2-e15a64c2abcf service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:16.565633 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27936ecc-0b21-4dc9-9ce2-e15a64c2abcf service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:16.566190 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27936ecc-0b21-4dc9-9ce2-e15a64c2abcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:16.568142 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-27936ecc-0b21-4dc9-9ce2-e15a64c2abcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:16.699942 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27936ecc-0b21-4dc9-9ce2-e15a64c2abcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:46:16.701433 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27936ecc-0b21-4dc9-9ce2-e15a64c2abcf service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:46:16.722767 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 741/1461] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:46:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:46:18.896476 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbf946-72c0-4140-af00-218f2b4cabce None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:18.897222 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbf946-72c0-4140-af00-218f2b4cabce None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:18.897222 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbf946-72c0-4140-af00-218f2b4cabce None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:18.898390 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 721/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 04:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:46:18.904416 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb707bc6-d9cf-4358-a0f5-18c203a84638 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:18.904962 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb707bc6-d9cf-4358-a0f5-18c203a84638 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:18.905143 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb707bc6-d9cf-4358-a0f5-18c203a84638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:18.998540 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-bb707bc6-d9cf-4358-a0f5-18c203a84638 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:46:18.999795 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-bb707bc6-d9cf-4358-a0f5-18c203a84638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:19.046546 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:19.118833 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 742/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 04:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:46:19.157040 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbf946-72c0-4140-af00-218f2b4cabce None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:46:19.158748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-f0cbf946-72c0-4140-af00-218f2b4cabce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:19.302549 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbf946-72c0-4140-af00-218f2b4cabce None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:46:19.347919 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:19.391848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f998b52-e55f-4bb9-810a-f20929e7dda2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:46:19.392488 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f998b52-e55f-4bb9-810a-f20929e7dda2 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:19.392765 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f998b52-e55f-4bb9-810a-f20929e7dda2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:19.393037 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f998b52-e55f-4bb9-810a-f20929e7dda2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:19.394796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-2f998b52-e55f-4bb9-810a-f20929e7dda2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:19.553624 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f998b52-e55f-4bb9-810a-f20929e7dda2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:46:19.555901 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f998b52-e55f-4bb9-810a-f20929e7dda2 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:46:19.577830 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 722/1464] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:46:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:46:21.650362 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1ff82-93e5-413b-b2ab-a274f34eb516 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:21.651252 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1ff82-93e5-413b-b2ab-a274f34eb516 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:21.651252 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c1ff82-93e5-413b-b2ab-a274f34eb516 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:21.652430 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 743/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 04:46:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:46:21.659787 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7f9f4-86f3-4412-8da1-091c4ea84d3d None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:21.660500 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7f9f4-86f3-4412-8da1-091c4ea84d3d None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:21.660500 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7f9f4-86f3-4412-8da1-091c4ea84d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:21.750009 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-83a7f9f4-86f3-4412-8da1-091c4ea84d3d None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:46:21.752161 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-83a7f9f4-86f3-4412-8da1-091c4ea84d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:21.784787 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:21.925530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 723/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 04:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:46:21.986787 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1ff82-93e5-413b-b2ab-a274f34eb516 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:46:21.988858 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-a2c1ff82-93e5-413b-b2ab-a274f34eb516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:22.122778 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c1ff82-93e5-413b-b2ab-a274f34eb516 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:46:22.201165 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:22.210412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf10778-4680-4ad8-9401-54ae5c2dc96a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:46:22.211159 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf10778-4680-4ad8-9401-54ae5c2dc96a service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:22.211549 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf10778-4680-4ad8-9401-54ae5c2dc96a service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:22.211881 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf10778-4680-4ad8-9401-54ae5c2dc96a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:22.213769 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-dbf10778-4680-4ad8-9401-54ae5c2dc96a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:22.357335 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf10778-4680-4ad8-9401-54ae5c2dc96a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:46:22.360130 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf10778-4680-4ad8-9401-54ae5c2dc96a service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:46:22.394944 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 744/1467] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:46:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:46:24.485803 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a8f5d-2787-4fe5-93d7-bf5601c4ddfd None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:24.486559 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a8f5d-2787-4fe5-93d7-bf5601c4ddfd None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:24.486559 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a8f5d-2787-4fe5-93d7-bf5601c4ddfd None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:24.488062 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 724/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 04:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:46:24.494544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e3988-fa7e-4c8e-8897-5f15b44146af None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:24.495222 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e3988-fa7e-4c8e-8897-5f15b44146af None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:24.495222 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e3988-fa7e-4c8e-8897-5f15b44146af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:24.579771 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-a10e3988-fa7e-4c8e-8897-5f15b44146af None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:46:24.581290 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-a10e3988-fa7e-4c8e-8897-5f15b44146af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:24.641659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:24.698975 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 745/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 04:46:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:46:24.738266 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a8f5d-2787-4fe5-93d7-bf5601c4ddfd None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:46:24.739748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-346a8f5d-2787-4fe5-93d7-bf5601c4ddfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:24.861580 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a8f5d-2787-4fe5-93d7-bf5601c4ddfd None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:46:24.917492 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:24.949203 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac336c47-57f5-42b4-8711-9c115ee63096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:46:24.949872 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac336c47-57f5-42b4-8711-9c115ee63096 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:24.950181 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac336c47-57f5-42b4-8711-9c115ee63096 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:24.950457 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac336c47-57f5-42b4-8711-9c115ee63096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:24.952317 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-ac336c47-57f5-42b4-8711-9c115ee63096 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:25.078601 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac336c47-57f5-42b4-8711-9c115ee63096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:46:25.080462 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac336c47-57f5-42b4-8711-9c115ee63096 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:46:25.101708 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 725/1470] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:46:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:46:34.696826 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=22 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:35.099142 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=66 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:45.781748 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcf55a-3d93-4fd2-966c-e88600e6cd91 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:45.782734 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcf55a-3d93-4fd2-966c-e88600e6cd91 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:45.782734 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcf55a-3d93-4fd2-966c-e88600e6cd91 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:45.784080 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 746/1471] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:46:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:46:45.790377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09607a-97bc-47a5-aabe-f1be55ecc1ff None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:45.791246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09607a-97bc-47a5-aabe-f1be55ecc1ff None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:45.791246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09607a-97bc-47a5-aabe-f1be55ecc1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:45.869533 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-ea09607a-97bc-47a5-aabe-f1be55ecc1ff None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:46:45.870854 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-ea09607a-97bc-47a5-aabe-f1be55ecc1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:46.000083 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 726/1472] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:46:46.133917 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597e16f-c676-4f29-81db-3d4e641283fd None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:46.134312 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597e16f-c676-4f29-81db-3d4e641283fd None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:46.134646 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597e16f-c676-4f29-81db-3d4e641283fd None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:46.136258 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 747/1473] 10.222.0.39 () {54 vars in 966 bytes} [Tue Jul 26 04:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:46:46.142363 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23acf7-67da-4336-853f-3c613f9f3f12 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:46.142689 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23acf7-67da-4336-853f-3c613f9f3f12 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:46.142935 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23acf7-67da-4336-853f-3c613f9f3f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:46.233718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-7e23acf7-67da-4336-853f-3c613f9f3f12 None None] MFA Rules not processed for user `7cfbf2c03eb740ed8b72c4825cffc341`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:46:46.235015 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-7e23acf7-67da-4336-853f-3c613f9f3f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:46.258049 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:46.325941 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 727/1474] 10.222.0.39 () {58 vars in 1063 bytes} [Tue Jul 26 04:46:46 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:46:46.334236 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597e16f-c676-4f29-81db-3d4e641283fd None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:46:46.335996 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-4597e16f-c676-4f29-81db-3d4e641283fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:46.462002 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597e16f-c676-4f29-81db-3d4e641283fd None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:46:46.549378 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385aa2e-6d9d-4eaf-b326-950568f1aa85 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfbf2c03eb740ed8b72c4825cffc341', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:46:46.550161 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385aa2e-6d9d-4eaf-b326-950568f1aa85 service glance] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:46.550498 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385aa2e-6d9d-4eaf-b326-950568f1aa85 service glance] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:46.550837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385aa2e-6d9d-4eaf-b326-950568f1aa85 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:46.552598 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-5385aa2e-6d9d-4eaf-b326-950568f1aa85 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:46.617449 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:46.686777 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5385aa2e-6d9d-4eaf-b326-950568f1aa85 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:46:46.688327 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5385aa2e-6d9d-4eaf-b326-950568f1aa85 service glance] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:46:46.843172 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 748/1475] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:46:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:46:49.095485 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd50d9-3c8b-417b-931e-3a5536706831 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:49.096187 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd50d9-3c8b-417b-931e-3a5536706831 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:49.096187 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd50d9-3c8b-417b-931e-3a5536706831 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:49.097416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 728/1476] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:46:49.103693 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8945a0b-4996-4183-bfea-999bcd6b721d None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:49.104232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8945a0b-4996-4183-bfea-999bcd6b721d None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:49.104348 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8945a0b-4996-4183-bfea-999bcd6b721d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:49.179653 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-c8945a0b-4996-4183-bfea-999bcd6b721d None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:46:49.181084 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-c8945a0b-4996-4183-bfea-999bcd6b721d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:49.306591 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 749/1477] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:46:49.330446 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd50d9-3c8b-417b-931e-3a5536706831 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:46:49.332255 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-14bd50d9-3c8b-417b-931e-3a5536706831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:49.483036 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd50d9-3c8b-417b-931e-3a5536706831 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:46:49.536253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:49.591814 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93bd9a-5208-4229-a2aa-3f98dc92772c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:46:49.592880 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93bd9a-5208-4229-a2aa-3f98dc92772c admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:49.593276 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93bd9a-5208-4229-a2aa-3f98dc92772c admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:49.593742 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93bd9a-5208-4229-a2aa-3f98dc92772c admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:49.595058 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93bd9a-5208-4229-a2aa-3f98dc92772c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:46:49.598203 dv-cinder-850574-1-smb devstack@keystone.service[86745]: WARNING py.warnings [None req-6f93bd9a-5208-4229-a2aa-3f98dc92772c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:46:49.598203 dv-cinder-850574-1-smb devstack@keystone.service[86745]: warnings.warn(msg) Jul 26 04:46:49.598203 dv-cinder-850574-1-smb devstack@keystone.service[86745]: Jul 26 04:46:49.600357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93bd9a-5208-4229-a2aa-3f98dc92772c admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:46:49.633535 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 729/1478] 10.222.0.39 () {56 vars in 1108 bytes} [Tue Jul 26 04:46:49 2022] GET /identity/v3/projects => generated 2553 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:46:51.719307 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3121efc-c4ea-488b-8d0c-b4a19e6f83ae None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:51.720025 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3121efc-c4ea-488b-8d0c-b4a19e6f83ae None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:51.720025 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3121efc-c4ea-488b-8d0c-b4a19e6f83ae None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:51.721240 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 750/1479] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:46:51.728188 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d665b7d-52d5-46a2-ae02-ea61fb9c6b2d None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:51.728738 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d665b7d-52d5-46a2-ae02-ea61fb9c6b2d None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:51.729141 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d665b7d-52d5-46a2-ae02-ea61fb9c6b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:51.811758 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-7d665b7d-52d5-46a2-ae02-ea61fb9c6b2d None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:46:51.816998 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-7d665b7d-52d5-46a2-ae02-ea61fb9c6b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:51.929338 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 730/1480] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:46:51.974173 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3121efc-c4ea-488b-8d0c-b4a19e6f83ae None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:46:51.975944 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-c3121efc-c4ea-488b-8d0c-b4a19e6f83ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:51.986409 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:52.192295 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3121efc-c4ea-488b-8d0c-b4a19e6f83ae None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:46:52.299813 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:52.359227 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da359dfe-bb91-4be3-b563-95e2e37e32f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:46:52.359869 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da359dfe-bb91-4be3-b563-95e2e37e32f9 service nova] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:52.360143 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da359dfe-bb91-4be3-b563-95e2e37e32f9 service nova] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:52.360413 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da359dfe-bb91-4be3-b563-95e2e37e32f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:52.362132 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-da359dfe-bb91-4be3-b563-95e2e37e32f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:52.464294 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da359dfe-bb91-4be3-b563-95e2e37e32f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:46:52.465949 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da359dfe-bb91-4be3-b563-95e2e37e32f9 service nova] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:46:52.493372 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 751/1481] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:46:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:46:54.779611 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df29d2c-95b3-4ad9-b9dc-7ecff4a011b1 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:54.780533 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df29d2c-95b3-4ad9-b9dc-7ecff4a011b1 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:54.780533 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df29d2c-95b3-4ad9-b9dc-7ecff4a011b1 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:54.782511 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 731/1482] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:46:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:46:54.788629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca9903-8fdb-4d8e-9586-1251b5c81946 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:54.789469 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca9903-8fdb-4d8e-9586-1251b5c81946 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:54.789469 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca9903-8fdb-4d8e-9586-1251b5c81946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:54.869534 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-40ca9903-8fdb-4d8e-9586-1251b5c81946 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:46:54.870844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-40ca9903-8fdb-4d8e-9586-1251b5c81946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:54.923766 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:54.985229 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 752/1483] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:46:55.045771 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df29d2c-95b3-4ad9-b9dc-7ecff4a011b1 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:46:55.047466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-3df29d2c-95b3-4ad9-b9dc-7ecff4a011b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:55.077140 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:55.169599 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df29d2c-95b3-4ad9-b9dc-7ecff4a011b1 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:46:55.252047 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ebb513-cdf6-49ba-81ec-23a99846722d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:46:55.252678 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebb513-cdf6-49ba-81ec-23a99846722d service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:55.252948 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebb513-cdf6-49ba-81ec-23a99846722d service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:55.253207 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebb513-cdf6-49ba-81ec-23a99846722d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:55.254926 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-a9ebb513-cdf6-49ba-81ec-23a99846722d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:55.391916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:55.446437 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ebb513-cdf6-49ba-81ec-23a99846722d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:46:55.447961 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ebb513-cdf6-49ba-81ec-23a99846722d service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:46:55.468719 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 732/1484] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:46:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:46:57.550864 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1f526-3cba-41c8-a3e1-8cc45993952d None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:57.550864 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1f526-3cba-41c8-a3e1-8cc45993952d None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:57.551766 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1f526-3cba-41c8-a3e1-8cc45993952d None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:57.552538 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 753/1485] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:46:57.559554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42bf01-e26c-474a-92c8-0bdd223c3497 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:57.560411 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42bf01-e26c-474a-92c8-0bdd223c3497 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:57.560908 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42bf01-e26c-474a-92c8-0bdd223c3497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:57.646473 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-0d42bf01-e26c-474a-92c8-0bdd223c3497 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:46:57.647719 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-0d42bf01-e26c-474a-92c8-0bdd223c3497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:57.774996 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 733/1486] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:46:57.821133 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1f526-3cba-41c8-a3e1-8cc45993952d None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:46:57.822763 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-96a1f526-3cba-41c8-a3e1-8cc45993952d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:57.956293 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1f526-3cba-41c8-a3e1-8cc45993952d None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:46:58.037952 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:46:58.040056 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d369669-12ad-415e-b4b9-9a79163e5cfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:46:58.040861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d369669-12ad-415e-b4b9-9a79163e5cfa service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:46:58.041168 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d369669-12ad-415e-b4b9-9a79163e5cfa service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:46:58.041538 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d369669-12ad-415e-b4b9-9a79163e5cfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:46:58.044658 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-6d369669-12ad-415e-b4b9-9a79163e5cfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:46:58.187095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d369669-12ad-415e-b4b9-9a79163e5cfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:46:58.189336 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d369669-12ad-415e-b4b9-9a79163e5cfa service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:46:58.221038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 754/1487] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:46:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:47:00.365131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1685e0-e72d-444f-9853-d85442551252 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:47:00.365738 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1685e0-e72d-444f-9853-d85442551252 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:47:00.365738 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1685e0-e72d-444f-9853-d85442551252 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:47:00.367094 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 734/1488] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:47:00.373171 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b84c4-cc26-4772-8cea-bb4e813aa732 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:47:00.373755 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b84c4-cc26-4772-8cea-bb4e813aa732 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:47:00.373755 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041b84c4-cc26-4772-8cea-bb4e813aa732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:47:00.444729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-041b84c4-cc26-4772-8cea-bb4e813aa732 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:47:00.445969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-041b84c4-cc26-4772-8cea-bb4e813aa732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:47:00.513437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:00.564837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 755/1489] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:47:00.607420 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1685e0-e72d-444f-9853-d85442551252 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:47:00.609086 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-6a1685e0-e72d-444f-9853-d85442551252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:47:00.652641 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:00.733688 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1685e0-e72d-444f-9853-d85442551252 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:47:00.822845 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59406421-1b9a-4ea9-9e86-d02a2c9d68de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:47:00.823541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59406421-1b9a-4ea9-9e86-d02a2c9d68de service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:47:00.823872 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59406421-1b9a-4ea9-9e86-d02a2c9d68de service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:47:00.824147 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59406421-1b9a-4ea9-9e86-d02a2c9d68de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:47:00.825947 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-59406421-1b9a-4ea9-9e86-d02a2c9d68de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:47:00.915282 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:00.949366 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59406421-1b9a-4ea9-9e86-d02a2c9d68de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:47:00.950955 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59406421-1b9a-4ea9-9e86-d02a2c9d68de service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:47:00.971570 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 735/1490] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:47:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:47:03.300885 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b6138-1a13-4ff0-9f0f-475460886dbe None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:47:03.301476 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b6138-1a13-4ff0-9f0f-475460886dbe None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:47:03.301476 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b6138-1a13-4ff0-9f0f-475460886dbe None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:47:03.302876 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 756/1491] 10.222.0.39 () {54 vars in 926 bytes} [Tue Jul 26 04:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:47:03.309790 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2e2ed-0932-468c-b5ea-9e00b5e6b432 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:47:03.310367 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2e2ed-0932-468c-b5ea-9e00b5e6b432 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:47:03.310827 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2e2ed-0932-468c-b5ea-9e00b5e6b432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:47:03.428339 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-56f2e2ed-0932-468c-b5ea-9e00b5e6b432 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:47:03.430512 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-56f2e2ed-0932-468c-b5ea-9e00b5e6b432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:47:03.557397 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 736/1492] 10.222.0.39 () {58 vars in 1023 bytes} [Tue Jul 26 04:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:47:03.597621 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b6138-1a13-4ff0-9f0f-475460886dbe None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:47:03.599286 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-300b6138-1a13-4ff0-9f0f-475460886dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:47:03.728590 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b6138-1a13-4ff0-9f0f-475460886dbe None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:47:03.814394 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1ac677-120f-47e6-ad56-6a0111b99544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:47:03.814924 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ac677-120f-47e6-ad56-6a0111b99544 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:47:03.815207 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ac677-120f-47e6-ad56-6a0111b99544 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:47:03.815479 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ac677-120f-47e6-ad56-6a0111b99544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:47:03.817142 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-3a1ac677-120f-47e6-ad56-6a0111b99544 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:47:03.829108 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:03.949172 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ac677-120f-47e6-ad56-6a0111b99544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:47:03.950826 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1ac677-120f-47e6-ad56-6a0111b99544 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:47:03.974375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 757/1493] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:47:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:47:13.555608 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=82 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:47:13.972063 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=50 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:32.959980 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf4f9b-afd9-49c2-8d6f-a6f9670490f8 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:48:32.960609 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf4f9b-afd9-49c2-8d6f-a6f9670490f8 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:48:32.960728 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf4f9b-afd9-49c2-8d6f-a6f9670490f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:48:33.040702 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-59bf4f9b-afd9-49c2-8d6f-a6f9670490f8 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:48:33.042016 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-59bf4f9b-afd9-49c2-8d6f-a6f9670490f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:48:33.145285 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 737/1494] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:48:33.153895 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6288a-095f-493b-968d-1e6229bad9de None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:48:33.154500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6288a-095f-493b-968d-1e6229bad9de None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:48:33.154500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6288a-095f-493b-968d-1e6229bad9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:48:33.235149 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-48f6288a-095f-493b-968d-1e6229bad9de None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:48:33.236269 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-48f6288a-095f-493b-968d-1e6229bad9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:48:33.338955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 758/1495] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:48:33.343899 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf4f9b-afd9-49c2-8d6f-a6f9670490f8 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:48:33.345122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-59bf4f9b-afd9-49c2-8d6f-a6f9670490f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:48:33.357013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf4f9b-afd9-49c2-8d6f-a6f9670490f8 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:48:33.423270 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:33.458834 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59f1dd-e8e7-4fe7-adb8-5d76fb1216de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:48:33.459453 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59f1dd-e8e7-4fe7-adb8-5d76fb1216de admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:48:33.459728 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59f1dd-e8e7-4fe7-adb8-5d76fb1216de admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:48:33.459967 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59f1dd-e8e7-4fe7-adb8-5d76fb1216de admin admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:48:33.460731 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59f1dd-e8e7-4fe7-adb8-5d76fb1216de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:48:33.461033 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59f1dd-e8e7-4fe7-adb8-5d76fb1216de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:48:33.462134 dv-cinder-850574-1-smb devstack@keystone.service[86745]: WARNING py.warnings [None req-5e59f1dd-e8e7-4fe7-adb8-5d76fb1216de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:48:33.462134 dv-cinder-850574-1-smb devstack@keystone.service[86745]: warnings.warn(msg) Jul 26 04:48:33.462134 dv-cinder-850574-1-smb devstack@keystone.service[86745]: Jul 26 04:48:33.463389 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59f1dd-e8e7-4fe7-adb8-5d76fb1216de admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:48:33.474940 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 738/1496] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:48:33.483674 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6288a-095f-493b-968d-1e6229bad9de None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:48:33.493329 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6288a-095f-493b-968d-1e6229bad9de None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:48:33.558670 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:33.594039 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6188d2-e1f3-48e1-a934-098b45e7f709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:48:33.594659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6188d2-e1f3-48e1-a934-098b45e7f709 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:48:33.594942 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6188d2-e1f3-48e1-a934-098b45e7f709 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:48:33.595211 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6188d2-e1f3-48e1-a934-098b45e7f709 admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:48:33.595884 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6188d2-e1f3-48e1-a934-098b45e7f709 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:48:33.597669 dv-cinder-850574-1-smb devstack@keystone.service[86744]: WARNING py.warnings [None req-ef6188d2-e1f3-48e1-a934-098b45e7f709 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:48:33.597669 dv-cinder-850574-1-smb devstack@keystone.service[86744]: warnings.warn(msg) Jul 26 04:48:33.597669 dv-cinder-850574-1-smb devstack@keystone.service[86744]: Jul 26 04:48:33.598897 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6188d2-e1f3-48e1-a934-098b45e7f709 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:48:33.656614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 759/1497] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:48:33 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:48:33.661131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59f1dd-e8e7-4fe7-adb8-5d76fb1216de admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:48:33.662760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-5e59f1dd-e8e7-4fe7-adb8-5d76fb1216de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:48:33.697794 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59f1dd-e8e7-4fe7-adb8-5d76fb1216de admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:48:33.804388 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcfec8-fec4-4e45-b20c-f7bd513662a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:48:33.804880 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcfec8-fec4-4e45-b20c-f7bd513662a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:48:33.805153 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcfec8-fec4-4e45-b20c-f7bd513662a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:48:33.805420 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcfec8-fec4-4e45-b20c-f7bd513662a5 admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:48:33.806115 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bcfec8-fec4-4e45-b20c-f7bd513662a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:48:33.807151 dv-cinder-850574-1-smb devstack@keystone.service[86745]: WARNING py.warnings [None req-61bcfec8-fec4-4e45-b20c-f7bd513662a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:48:33.807151 dv-cinder-850574-1-smb devstack@keystone.service[86745]: warnings.warn(msg) Jul 26 04:48:33.807151 dv-cinder-850574-1-smb devstack@keystone.service[86745]: Jul 26 04:48:33.808349 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bcfec8-fec4-4e45-b20c-f7bd513662a5 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:48:33.851797 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 739/1498] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:48:33 2022] POST /identity/v3/users => generated 290 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:48:33.856286 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6188d2-e1f3-48e1-a934-098b45e7f709 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:48:33.857829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-ef6188d2-e1f3-48e1-a934-098b45e7f709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:48:33.923340 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6188d2-e1f3-48e1-a934-098b45e7f709 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:48:34.012147 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:34.024044 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74b72e-9516-4d45-958a-7f11e56d73cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:48:34.024677 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74b72e-9516-4d45-958a-7f11e56d73cc admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:48:34.024957 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74b72e-9516-4d45-958a-7f11e56d73cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:48:34.025226 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd74b72e-9516-4d45-958a-7f11e56d73cc admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:48:34.025918 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74b72e-9516-4d45-958a-7f11e56d73cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:48:34.026996 dv-cinder-850574-1-smb devstack@keystone.service[86744]: WARNING py.warnings [None req-fd74b72e-9516-4d45-958a-7f11e56d73cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:48:34.026996 dv-cinder-850574-1-smb devstack@keystone.service[86744]: warnings.warn(msg) Jul 26 04:48:34.026996 dv-cinder-850574-1-smb devstack@keystone.service[86744]: Jul 26 04:48:34.027902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd74b72e-9516-4d45-958a-7f11e56d73cc admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:48:34.041123 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 760/1499] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:48:34.045563 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcfec8-fec4-4e45-b20c-f7bd513662a5 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:48:34.047478 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-61bcfec8-fec4-4e45-b20c-f7bd513662a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:48:34.060614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bcfec8-fec4-4e45-b20c-f7bd513662a5 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:48:34.090042 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:34.167180 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c8581-8636-4e23-b332-4e4a8ac63892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:48:34.167815 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c8581-8636-4e23-b332-4e4a8ac63892 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:48:34.168092 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c8581-8636-4e23-b332-4e4a8ac63892 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:48:34.168363 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c8581-8636-4e23-b332-4e4a8ac63892 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:48:34.169063 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c8581-8636-4e23-b332-4e4a8ac63892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:48:34.170121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: WARNING py.warnings [None req-cf8c8581-8636-4e23-b332-4e4a8ac63892 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:48:34.170121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: warnings.warn(msg) Jul 26 04:48:34.170121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: Jul 26 04:48:34.171038 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c8581-8636-4e23-b332-4e4a8ac63892 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:48:34.184418 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 740/1500] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:48:34.189043 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74b72e-9516-4d45-958a-7f11e56d73cc admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:48:34.190620 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-fd74b72e-9516-4d45-958a-7f11e56d73cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:48:34.225644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd74b72e-9516-4d45-958a-7f11e56d73cc admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:48:34.328072 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545cd8f4-6d55-40ae-90c7-0fa8cd29767b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:48:34.328648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cd8f4-6d55-40ae-90c7-0fa8cd29767b admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:48:34.328921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cd8f4-6d55-40ae-90c7-0fa8cd29767b admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:48:34.329190 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545cd8f4-6d55-40ae-90c7-0fa8cd29767b admin admin] PATH_INFO: `/v3/projects/122a910689ce41ffaed30b0bc563e107/users/c9f9198d5e3747e9920cbf6ed553f904/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:48:34.354220 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545cd8f4-6d55-40ae-90c7-0fa8cd29767b admin admin] RBAC: Authorizing `identity:create_grant(project_id=122a910689ce41ffaed30b0bc563e107, user_id=c9f9198d5e3747e9920cbf6ed553f904, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:48:34.355296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: WARNING py.warnings [None req-545cd8f4-6d55-40ae-90c7-0fa8cd29767b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:48:34.355296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: warnings.warn(msg) Jul 26 04:48:34.355296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: Jul 26 04:48:34.357257 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545cd8f4-6d55-40ae-90c7-0fa8cd29767b admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:48:34.388034 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 761/1501] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:48:34 2022] PUT /identity/v3/projects/122a910689ce41ffaed30b0bc563e107/users/c9f9198d5e3747e9920cbf6ed553f904/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:48:34.401233 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957dd25-b00b-4238-ab37-4093664ff6ca None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:48:34.401528 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957dd25-b00b-4238-ab37-4093664ff6ca None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:48:34.401794 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957dd25-b00b-4238-ab37-4093664ff6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:48:34.461528 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-e957dd25-b00b-4238-ab37-4093664ff6ca None None] MFA Rules not processed for user `c9f9198d5e3747e9920cbf6ed553f904`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:48:34.462765 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-e957dd25-b00b-4238-ab37-4093664ff6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:48:34.544655 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 741/1502] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:48:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:48:34.558337 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13a258-a587-4de9-a239-ad1146f0d938 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:48:34.558623 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13a258-a587-4de9-a239-ad1146f0d938 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:48:34.558928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13a258-a587-4de9-a239-ad1146f0d938 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:48:34.560312 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 762/1503] 10.222.0.39 () {54 vars in 964 bytes} [Tue Jul 26 04:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:48:34.565247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0d52c-d78d-489d-a243-0bcc225ddf10 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:48:34.565541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0d52c-d78d-489d-a243-0bcc225ddf10 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:48:34.565835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0d52c-d78d-489d-a243-0bcc225ddf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:48:34.598313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:34.647239 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-6fb0d52c-d78d-489d-a243-0bcc225ddf10 None None] MFA Rules not processed for user `9bb16e4960af4c03bc274dea6bea2e1a`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:48:34.648486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-6fb0d52c-d78d-489d-a243-0bcc225ddf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:48:34.733126 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 742/1504] 10.222.0.39 () {58 vars in 1061 bytes} [Tue Jul 26 04:48:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:48:34.741335 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13a258-a587-4de9-a239-ad1146f0d938 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:48:34.742941 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-fa13a258-a587-4de9-a239-ad1146f0d938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:48:34.798715 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:34.867492 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13a258-a587-4de9-a239-ad1146f0d938 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:48:34.948824 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75150a-3c03-467c-9710-3da235e6c58e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:48:34.949468 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75150a-3c03-467c-9710-3da235e6c58e service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:48:34.949744 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75150a-3c03-467c-9710-3da235e6c58e service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:48:34.950027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75150a-3c03-467c-9710-3da235e6c58e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:48:34.951859 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-2a75150a-3c03-467c-9710-3da235e6c58e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:48:35.062514 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75150a-3c03-467c-9710-3da235e6c58e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:48:35.064000 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a75150a-3c03-467c-9710-3da235e6c58e service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:48:35.067597 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:35.083583 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 763/1505] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:48:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:48:35.133900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e632f43-48fe-4a7f-9421-092804d10ccc None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:48:35.134402 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e632f43-48fe-4a7f-9421-092804d10ccc None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:48:35.134502 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e632f43-48fe-4a7f-9421-092804d10ccc None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:48:35.135782 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 743/1506] 10.222.0.39 () {52 vars in 830 bytes} [Tue Jul 26 04:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:48:35.139679 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75150a-3c03-467c-9710-3da235e6c58e service cinder] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:48:35.140916 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-2a75150a-3c03-467c-9710-3da235e6c58e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:48:35.247627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75150a-3c03-467c-9710-3da235e6c58e service cinder] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:48:35.356370 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef17cf9-29f6-4a26-8982-daca2b4eb237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:48:35.357024 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef17cf9-29f6-4a26-8982-daca2b4eb237 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:48:35.357288 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef17cf9-29f6-4a26-8982-daca2b4eb237 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:48:35.357557 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef17cf9-29f6-4a26-8982-daca2b4eb237 admin admin] PATH_INFO: `/v3/users/c9f9198d5e3747e9920cbf6ed553f904` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:48:35.370359 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef17cf9-29f6-4a26-8982-daca2b4eb237 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9f9198d5e3747e9920cbf6ed553f904)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:48:35.371313 dv-cinder-850574-1-smb devstack@keystone.service[86744]: WARNING py.warnings [None req-1ef17cf9-29f6-4a26-8982-daca2b4eb237 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:48:35.371313 dv-cinder-850574-1-smb devstack@keystone.service[86744]: warnings.warn(msg) Jul 26 04:48:35.371313 dv-cinder-850574-1-smb devstack@keystone.service[86744]: Jul 26 04:48:35.372514 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef17cf9-29f6-4a26-8982-daca2b4eb237 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:48:35.382354 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:35.440893 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-1ef17cf9-29f6-4a26-8982-daca2b4eb237 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9f9198d5e3747e9920cbf6ed553f904'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:48:35.441527 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-1ef17cf9-29f6-4a26-8982-daca2b4eb237 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9f9198d5e3747e9920cbf6ed553f904'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:48:35.451845 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-1ef17cf9-29f6-4a26-8982-daca2b4eb237 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9f9198d5e3747e9920cbf6ed553f904'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:48:35.470386 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-1ef17cf9-29f6-4a26-8982-daca2b4eb237 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9f9198d5e3747e9920cbf6ed553f904'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:48:35.483273 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-1ef17cf9-29f6-4a26-8982-daca2b4eb237 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9f9198d5e3747e9920cbf6ed553f904'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:48:35.489099 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 764/1507] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:48:35 2022] DELETE /identity/v3/users/c9f9198d5e3747e9920cbf6ed553f904 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:48:35.493803 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe4583-823a-4083-b871-4c91c019589d None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:48:35.494131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe4583-823a-4083-b871-4c91c019589d None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:48:35.494409 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe4583-823a-4083-b871-4c91c019589d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:48:35.556135 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-27fe4583-823a-4083-b871-4c91c019589d None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:48:35.557386 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-27fe4583-823a-4083-b871-4c91c019589d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:48:35.644091 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:35.658802 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 744/1508] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:48:35.669192 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef17cf9-29f6-4a26-8982-daca2b4eb237 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:48:35.670509 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-1ef17cf9-29f6-4a26-8982-daca2b4eb237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:48:35.786416 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef17cf9-29f6-4a26-8982-daca2b4eb237 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:48:35.844098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:35.865787 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe7dbe-2e34-4e07-8d2e-616aaf51efe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:48:35.866443 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe7dbe-2e34-4e07-8d2e-616aaf51efe9 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:48:35.866718 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe7dbe-2e34-4e07-8d2e-616aaf51efe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:48:35.866983 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe7dbe-2e34-4e07-8d2e-616aaf51efe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:48:35.868692 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-d3fe7dbe-2e34-4e07-8d2e-616aaf51efe9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:48:35.980191 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe7dbe-2e34-4e07-8d2e-616aaf51efe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:48:35.981682 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe7dbe-2e34-4e07-8d2e-616aaf51efe9 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:48:36.000698 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 765/1509] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:48:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:48:36.368503 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe4583-823a-4083-b871-4c91c019589d None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:48:36.369756 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-27fe4583-823a-4083-b871-4c91c019589d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:48:36.381374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe4583-823a-4083-b871-4c91c019589d None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:48:36.482649 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2396527-a956-451e-8d34-586f869ba51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:48:36.483346 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2396527-a956-451e-8d34-586f869ba51d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:48:36.483622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2396527-a956-451e-8d34-586f869ba51d admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:48:36.483886 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2396527-a956-451e-8d34-586f869ba51d admin admin] PATH_INFO: `/v3/projects/122a910689ce41ffaed30b0bc563e107` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:48:36.494428 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2396527-a956-451e-8d34-586f869ba51d admin admin] RBAC: Authorizing `identity:delete_project(project_id=122a910689ce41ffaed30b0bc563e107)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:48:36.495424 dv-cinder-850574-1-smb devstack@keystone.service[86745]: WARNING py.warnings [None req-a2396527-a956-451e-8d34-586f869ba51d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:48:36.495424 dv-cinder-850574-1-smb devstack@keystone.service[86745]: warnings.warn(msg) Jul 26 04:48:36.495424 dv-cinder-850574-1-smb devstack@keystone.service[86745]: Jul 26 04:48:36.496624 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2396527-a956-451e-8d34-586f869ba51d admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:48:36.557629 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-a2396527-a956-451e-8d34-586f869ba51d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '122a910689ce41ffaed30b0bc563e107', 'request_id': 'req-a2396527-a956-451e-8d34-586f869ba51d'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:48:36.567724 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-a2396527-a956-451e-8d34-586f869ba51d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '122a910689ce41ffaed30b0bc563e107', 'request_id': 'req-a2396527-a956-451e-8d34-586f869ba51d'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:48:36.573955 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-a2396527-a956-451e-8d34-586f869ba51d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '122a910689ce41ffaed30b0bc563e107', 'request_id': 'req-a2396527-a956-451e-8d34-586f869ba51d'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:48:36.607390 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-a2396527-a956-451e-8d34-586f869ba51d admin admin] The token cache is being invalidate because project 122a910689ce41ffaed30b0bc563e107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:48:36.607676 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-a2396527-a956-451e-8d34-586f869ba51d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:48:36.608098 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-a2396527-a956-451e-8d34-586f869ba51d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:48:36.609562 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 745/1510] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:48:36 2022] DELETE /identity/v3/projects/122a910689ce41ffaed30b0bc563e107 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:48:45.998343 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=62 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:48:46.605275 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:50:23.219975 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd66ea0-b607-424e-bdf5-59deb1ccbb0c None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:50:23.220669 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd66ea0-b607-424e-bdf5-59deb1ccbb0c None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:50:23.220669 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd66ea0-b607-424e-bdf5-59deb1ccbb0c None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:50:23.222528 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 766/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 04:50:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:50:23.228682 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2ab18-90fa-42c9-91b9-cf48344399da None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:50:23.229215 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2ab18-90fa-42c9-91b9-cf48344399da None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:50:23.229215 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2ab18-90fa-42c9-91b9-cf48344399da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:50:23.339056 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-b3b2ab18-90fa-42c9-91b9-cf48344399da None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:50:23.340430 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-b3b2ab18-90fa-42c9-91b9-cf48344399da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:50:23.465645 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 746/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 04:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:50:23.637764 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd66ea0-b607-424e-bdf5-59deb1ccbb0c None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:50:23.640238 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-3dd66ea0-b607-424e-bdf5-59deb1ccbb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:50:23.809033 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd66ea0-b607-424e-bdf5-59deb1ccbb0c None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:50:23.817101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e0fbd-f357-4747-96e5-ec608dad2e51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:50:23.817752 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e0fbd-f357-4747-96e5-ec608dad2e51 service nova] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:50:23.818035 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e0fbd-f357-4747-96e5-ec608dad2e51 service nova] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:50:23.818329 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e0fbd-f357-4747-96e5-ec608dad2e51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:50:23.827731 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e0fbd-f357-4747-96e5-ec608dad2e51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:50:23.829366 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e0fbd-f357-4747-96e5-ec608dad2e51 service nova] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:50:23.840325 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 767/1513] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:50:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:50:24.753175 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa36678-248f-4afa-b3a0-fd48f0d79f0f None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:50:24.754060 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa36678-248f-4afa-b3a0-fd48f0d79f0f None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:50:24.754060 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa36678-248f-4afa-b3a0-fd48f0d79f0f None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:50:24.755606 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 747/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 04:50:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:50:24.765263 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea813053-96cc-469c-be50-05e0be2ab1ae None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:50:24.765839 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea813053-96cc-469c-be50-05e0be2ab1ae None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:50:24.765839 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea813053-96cc-469c-be50-05e0be2ab1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:50:24.776781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df7d1b-159e-44a1-8f47-93766088ac68 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:50:24.777066 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df7d1b-159e-44a1-8f47-93766088ac68 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:50:24.777339 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26df7d1b-159e-44a1-8f47-93766088ac68 None None] PATH_INFO: `/v3` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:50:24.778727 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 748/1515] 10.222.0.47 () {54 vars in 925 bytes} [Tue Jul 26 04:50:24 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:50:24.786709 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002052c6-f294-47b3-8fad-7cd145cb1577 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:50:24.786999 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002052c6-f294-47b3-8fad-7cd145cb1577 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:50:24.787535 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002052c6-f294-47b3-8fad-7cd145cb1577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:50:24.788894 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-ea813053-96cc-469c-be50-05e0be2ab1ae None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:50:24.790750 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-ea813053-96cc-469c-be50-05e0be2ab1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:50:24.803993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 768/1516] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 04:50:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:50:24.872837 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-002052c6-f294-47b3-8fad-7cd145cb1577 None None] MFA Rules not processed for user `21dfe7b4d6524ec2885224d77395b00b`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:50:24.874117 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-002052c6-f294-47b3-8fad-7cd145cb1577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:50:24.912249 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:50:24.965198 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 749/1517] 10.222.0.47 () {58 vars in 1015 bytes} [Tue Jul 26 04:50:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:50:24.975629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea813053-96cc-469c-be50-05e0be2ab1ae None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:50:24.995639 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea813053-96cc-469c-be50-05e0be2ab1ae None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:50:25.002968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd123d53-3a85-4f78-89ee-be6e21463112 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:50:25.003853 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd123d53-3a85-4f78-89ee-be6e21463112 service nova] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:50:25.004136 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd123d53-3a85-4f78-89ee-be6e21463112 service nova] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:50:25.004355 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd123d53-3a85-4f78-89ee-be6e21463112 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:50:25.015688 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd123d53-3a85-4f78-89ee-be6e21463112 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:50:25.017687 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd123d53-3a85-4f78-89ee-be6e21463112 service nova] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:50:25.032371 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 769/1518] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:50:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:50:34.087605 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395a351-0692-4095-8dd9-f708793f5582 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:50:34.088139 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395a351-0692-4095-8dd9-f708793f5582 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:50:34.088438 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395a351-0692-4095-8dd9-f708793f5582 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:50:34.090578 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 750/1519] 10.222.0.39 () {54 vars in 961 bytes} [Tue Jul 26 04:50:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:50:34.096401 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb1647-a809-4a78-8b8e-a290367ad75f None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:50:34.096979 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb1647-a809-4a78-8b8e-a290367ad75f None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:50:34.096979 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb1647-a809-4a78-8b8e-a290367ad75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:50:34.120566 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-3ecb1647-a809-4a78-8b8e-a290367ad75f None None] MFA Rules not processed for user `21dfe7b4d6524ec2885224d77395b00b`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:50:34.121996 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-3ecb1647-a809-4a78-8b8e-a290367ad75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:50:34.132028 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 770/1520] 10.222.0.39 () {58 vars in 1058 bytes} [Tue Jul 26 04:50:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:50:34.140641 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395a351-0692-4095-8dd9-f708793f5582 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:50:34.156839 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395a351-0692-4095-8dd9-f708793f5582 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:50:34.163407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c0b1e-e1ce-4ba4-bac3-cc39b09350f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21dfe7b4d6524ec2885224d77395b00b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:50:34.164048 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c0b1e-e1ce-4ba4-bac3-cc39b09350f9 service placement] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:50:34.164328 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c0b1e-e1ce-4ba4-bac3-cc39b09350f9 service placement] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:50:34.164604 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c0b1e-e1ce-4ba4-bac3-cc39b09350f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:50:34.174207 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c0b1e-e1ce-4ba4-bac3-cc39b09350f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:50:34.175839 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c0b1e-e1ce-4ba4-bac3-cc39b09350f9 service placement] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:50:34.186730 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 751/1521] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:50:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:50:36.321855 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886d92d-5e96-46f8-b2e9-c993559cdf6e None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:50:36.322504 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886d92d-5e96-46f8-b2e9-c993559cdf6e None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:50:36.322504 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886d92d-5e96-46f8-b2e9-c993559cdf6e None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:50:36.323816 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 771/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 04:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:50:36.328825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c673b7d-da4b-4dcf-b558-0ab312630833 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:50:36.329292 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c673b7d-da4b-4dcf-b558-0ab312630833 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:50:36.329399 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c673b7d-da4b-4dcf-b558-0ab312630833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:50:36.349607 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-6c673b7d-da4b-4dcf-b558-0ab312630833 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:50:36.350848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-6c673b7d-da4b-4dcf-b558-0ab312630833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:50:36.358925 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 752/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 04:50:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:50:36.513694 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886d92d-5e96-46f8-b2e9-c993559cdf6e None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:50:36.532661 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886d92d-5e96-46f8-b2e9-c993559cdf6e None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:50:36.538694 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0eacf5-0c10-470c-be42-29c58a6d9fa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:50:36.539253 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0eacf5-0c10-470c-be42-29c58a6d9fa4 service nova] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:50:36.539538 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0eacf5-0c10-470c-be42-29c58a6d9fa4 service nova] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:50:36.539805 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0eacf5-0c10-470c-be42-29c58a6d9fa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:50:36.549747 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0eacf5-0c10-470c-be42-29c58a6d9fa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:50:36.551419 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0eacf5-0c10-470c-be42-29c58a6d9fa4 service nova] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:50:36.561663 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 772/1524] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:50:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:50:37.389767 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add5116-da95-4c16-8643-52ec34469a3c None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:50:37.390395 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add5116-da95-4c16-8643-52ec34469a3c None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:50:37.390395 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add5116-da95-4c16-8643-52ec34469a3c None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:50:37.391702 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 753/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 26 04:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:50:37.397088 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bed789-d61a-4582-bd4d-ee074af323f1 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:50:37.397605 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bed789-d61a-4582-bd4d-ee074af323f1 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:50:37.397605 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bed789-d61a-4582-bd4d-ee074af323f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:50:37.420417 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-c6bed789-d61a-4582-bd4d-ee074af323f1 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:50:37.421845 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-c6bed789-d61a-4582-bd4d-ee074af323f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:50:37.431908 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 773/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 26 04:50:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:50:37.588743 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add5116-da95-4c16-8643-52ec34469a3c None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:50:37.606743 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add5116-da95-4c16-8643-52ec34469a3c None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:50:37.615301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d913b75b-639b-40c6-8bca-af6e0dd7b72d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:50:37.616148 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913b75b-639b-40c6-8bca-af6e0dd7b72d service nova] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:50:37.616421 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913b75b-639b-40c6-8bca-af6e0dd7b72d service nova] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:50:37.616760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913b75b-639b-40c6-8bca-af6e0dd7b72d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:50:37.626145 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d913b75b-639b-40c6-8bca-af6e0dd7b72d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:50:37.627735 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d913b75b-639b-40c6-8bca-af6e0dd7b72d service nova] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:50:37.638337 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 754/1527] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:50:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:50:41.484375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea6184-eb27-472b-87c2-39b4ca8af7b7 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:50:41.485004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea6184-eb27-472b-87c2-39b4ca8af7b7 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:50:41.485004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea6184-eb27-472b-87c2-39b4ca8af7b7 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:50:41.486372 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 774/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 04:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:50:41.492696 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9239ac1-7035-41a5-b9e8-34c6d68cc07f None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:50:41.493213 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9239ac1-7035-41a5-b9e8-34c6d68cc07f None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:50:41.493213 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9239ac1-7035-41a5-b9e8-34c6d68cc07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:50:41.515645 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-d9239ac1-7035-41a5-b9e8-34c6d68cc07f None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:50:41.516876 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-d9239ac1-7035-41a5-b9e8-34c6d68cc07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:50:41.525142 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 755/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 04:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:50:41.606593 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea6184-eb27-472b-87c2-39b4ca8af7b7 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:50:41.608465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-e6ea6184-eb27-472b-87c2-39b4ca8af7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:50:41.684781 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:50:41.700598 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea6184-eb27-472b-87c2-39b4ca8af7b7 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:50:41.704438 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fd295-0533-45fb-801d-c4189b54da84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:50:41.705083 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fd295-0533-45fb-801d-c4189b54da84 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:50:41.705361 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fd295-0533-45fb-801d-c4189b54da84 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:50:41.705630 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fd295-0533-45fb-801d-c4189b54da84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:50:41.715616 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34fd295-0533-45fb-801d-c4189b54da84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:50:41.717098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34fd295-0533-45fb-801d-c4189b54da84 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:50:41.727596 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 775/1530] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:50:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:50:43.747329 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf6a35-79a4-495a-877b-5ca72ee7c455 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:50:43.747944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf6a35-79a4-495a-877b-5ca72ee7c455 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:50:43.747944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf6a35-79a4-495a-877b-5ca72ee7c455 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:50:43.749310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 756/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 04:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:50:43.754844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad0855-a9a2-4a53-94d0-5043789c3041 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:50:43.755348 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad0855-a9a2-4a53-94d0-5043789c3041 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:50:43.755348 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad0855-a9a2-4a53-94d0-5043789c3041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:50:43.777047 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-80ad0855-a9a2-4a53-94d0-5043789c3041 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:50:43.778319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-80ad0855-a9a2-4a53-94d0-5043789c3041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:50:43.787406 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 776/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 04:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:50:43.822906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf6a35-79a4-495a-877b-5ca72ee7c455 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:50:43.834607 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf6a35-79a4-495a-877b-5ca72ee7c455 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:50:43.838515 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f626a4f-782f-4a60-8baa-6507ae48b003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:50:43.839146 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f626a4f-782f-4a60-8baa-6507ae48b003 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:50:43.839423 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f626a4f-782f-4a60-8baa-6507ae48b003 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:50:43.839693 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f626a4f-782f-4a60-8baa-6507ae48b003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:50:43.850295 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f626a4f-782f-4a60-8baa-6507ae48b003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:50:43.851761 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f626a4f-782f-4a60-8baa-6507ae48b003 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:50:43.862488 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 757/1533] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:50:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:50:47.363313 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525bbb0-91e4-45a8-aca0-537bfd4769d3 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:50:47.363774 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525bbb0-91e4-45a8-aca0-537bfd4769d3 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:50:47.363882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525bbb0-91e4-45a8-aca0-537bfd4769d3 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:50:47.365655 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 777/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 04:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:50:47.371972 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6307e51-3204-4f12-9fcb-70562f90827e None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:50:47.372426 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6307e51-3204-4f12-9fcb-70562f90827e None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:50:47.372542 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6307e51-3204-4f12-9fcb-70562f90827e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:50:47.401912 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-c6307e51-3204-4f12-9fcb-70562f90827e None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:50:47.403659 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-c6307e51-3204-4f12-9fcb-70562f90827e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:50:47.415903 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 758/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 04:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:50:47.725118 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525bbb0-91e4-45a8-aca0-537bfd4769d3 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:50:47.726984 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-d525bbb0-91e4-45a8-aca0-537bfd4769d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:50:47.817489 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d525bbb0-91e4-45a8-aca0-537bfd4769d3 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:50:47.821407 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912a4ff-7a0a-41bc-be5f-5745fa9d5c27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:50:47.822037 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912a4ff-7a0a-41bc-be5f-5745fa9d5c27 service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:50:47.822348 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912a4ff-7a0a-41bc-be5f-5745fa9d5c27 service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:50:47.822615 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912a4ff-7a0a-41bc-be5f-5745fa9d5c27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:50:47.833529 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912a4ff-7a0a-41bc-be5f-5745fa9d5c27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:50:47.835085 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912a4ff-7a0a-41bc-be5f-5745fa9d5c27 service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:50:47.845681 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 778/1536] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:50:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:50:49.959599 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60a2ca-7d09-471b-9e95-1f54bd0ed283 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:50:49.960172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60a2ca-7d09-471b-9e95-1f54bd0ed283 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:50:49.960172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60a2ca-7d09-471b-9e95-1f54bd0ed283 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:50:49.961543 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 759/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 26 04:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:50:49.967403 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa67e3-105d-4686-885f-7211916d215e None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:50:49.967909 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa67e3-105d-4686-885f-7211916d215e None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:50:49.967909 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aa67e3-105d-4686-885f-7211916d215e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:50:49.989287 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-81aa67e3-105d-4686-885f-7211916d215e None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:50:49.991114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-81aa67e3-105d-4686-885f-7211916d215e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:50:50.000138 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 779/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 26 04:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:50:50.306357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60a2ca-7d09-471b-9e95-1f54bd0ed283 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:50:50.308098 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-5e60a2ca-7d09-471b-9e95-1f54bd0ed283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:50:50.321905 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e60a2ca-7d09-471b-9e95-1f54bd0ed283 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:50:50.325495 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfecec0c-991f-407d-8e2b-5fbdc3672886 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:50:50.326165 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecec0c-991f-407d-8e2b-5fbdc3672886 service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:50:50.326442 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecec0c-991f-407d-8e2b-5fbdc3672886 service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:50:50.326742 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecec0c-991f-407d-8e2b-5fbdc3672886 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:50:50.335964 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfecec0c-991f-407d-8e2b-5fbdc3672886 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:50:50.337402 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfecec0c-991f-407d-8e2b-5fbdc3672886 service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:50:50.347307 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 760/1539] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:50:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:50:59.983625 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=50 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:51:00.342806 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=50 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:23.784368 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41d1c6-9b35-441f-907a-fc5e48dc7afb None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:23.785723 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41d1c6-9b35-441f-907a-fc5e48dc7afb None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:23.786409 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41d1c6-9b35-441f-907a-fc5e48dc7afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:23.821721 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-1f41d1c6-9b35-441f-907a-fc5e48dc7afb None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:23.823232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-1f41d1c6-9b35-441f-907a-fc5e48dc7afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:23.844999 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 780/1540] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:52:23.855262 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00ac83-a73b-40c7-ab45-9c9340a1c9e4 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:23.856063 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5ceba-a598-4823-9893-72701e1d5b94 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:23.856562 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5ceba-a598-4823-9893-72701e1d5b94 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:23.856762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00ac83-a73b-40c7-ab45-9c9340a1c9e4 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:23.856933 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5ceba-a598-4823-9893-72701e1d5b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:23.857410 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00ac83-a73b-40c7-ab45-9c9340a1c9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:23.885423 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-7d00ac83-a73b-40c7-ab45-9c9340a1c9e4 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:23.892212 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-7d00ac83-a73b-40c7-ab45-9c9340a1c9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:23.904920 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 761/1541] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:23.907222 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-9bb5ceba-a598-4823-9893-72701e1d5b94 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:23.908667 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-9bb5ceba-a598-4823-9893-72701e1d5b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:23.910070 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00ac83-a73b-40c7-ab45-9c9340a1c9e4 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:23.926746 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00ac83-a73b-40c7-ab45-9c9340a1c9e4 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:23.927853 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 781/1542] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:23.932897 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8aef0-48f2-4dc1-8fe3-a3bf6bcb3b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:23.933959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8aef0-48f2-4dc1-8fe3-a3bf6bcb3b72 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:23.934492 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8aef0-48f2-4dc1-8fe3-a3bf6bcb3b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:23.934988 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8aef0-48f2-4dc1-8fe3-a3bf6bcb3b72 admin admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:23.936021 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8aef0-48f2-4dc1-8fe3-a3bf6bcb3b72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:52:23.936571 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8aef0-48f2-4dc1-8fe3-a3bf6bcb3b72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:23.937112 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0284ce-45b5-4b8e-9566-0d8fa21c22cf None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:23.937402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0284ce-45b5-4b8e-9566-0d8fa21c22cf None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:23.937676 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0284ce-45b5-4b8e-9566-0d8fa21c22cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:23.940196 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8aef0-48f2-4dc1-8fe3-a3bf6bcb3b72 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:23.956303 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 762/1543] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:52:23.970059 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8aef0-48f2-4dc1-8fe3-a3bf6bcb3b72 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:23.988824 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8aef0-48f2-4dc1-8fe3-a3bf6bcb3b72 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:23.993305 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-cb0284ce-45b5-4b8e-9566-0d8fa21c22cf None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:23.996343 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-cb0284ce-45b5-4b8e-9566-0d8fa21c22cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:24.001294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471eaa8-3f20-4ca7-bea5-56edfc28f8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:24.007573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471eaa8-3f20-4ca7-bea5-56edfc28f8af admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:24.008721 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471eaa8-3f20-4ca7-bea5-56edfc28f8af admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:24.009731 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471eaa8-3f20-4ca7-bea5-56edfc28f8af admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:24.011199 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471eaa8-3f20-4ca7-bea5-56edfc28f8af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:24.013474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: WARNING py.warnings [None req-0471eaa8-3f20-4ca7-bea5-56edfc28f8af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:52:24.013474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: warnings.warn(msg) Jul 26 04:52:24.013474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: Jul 26 04:52:24.016423 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471eaa8-3f20-4ca7-bea5-56edfc28f8af admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:24.020074 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 782/1544] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:24.025564 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0284ce-45b5-4b8e-9566-0d8fa21c22cf None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:24.043951 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0284ce-45b5-4b8e-9566-0d8fa21c22cf None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:24.049138 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50094663-14da-481c-95a9-5450b8b194c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:24.050108 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50094663-14da-481c-95a9-5450b8b194c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:24.050654 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50094663-14da-481c-95a9-5450b8b194c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:24.051178 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50094663-14da-481c-95a9-5450b8b194c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:24.052177 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50094663-14da-481c-95a9-5450b8b194c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:52:24.052699 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50094663-14da-481c-95a9-5450b8b194c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:24.058122 dv-cinder-850574-1-smb devstack@keystone.service[86744]: WARNING py.warnings [None req-50094663-14da-481c-95a9-5450b8b194c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:52:24.058122 dv-cinder-850574-1-smb devstack@keystone.service[86744]: warnings.warn(msg) Jul 26 04:52:24.058122 dv-cinder-850574-1-smb devstack@keystone.service[86744]: Jul 26 04:52:24.059586 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50094663-14da-481c-95a9-5450b8b194c2 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:24.084098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 783/1545] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:52:24.090751 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 763/1546] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:52:23 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:52:24.095276 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50094663-14da-481c-95a9-5450b8b194c2 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:24.096534 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471eaa8-3f20-4ca7-bea5-56edfc28f8af admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:24.111968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50094663-14da-481c-95a9-5450b8b194c2 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:24.208373 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471eaa8-3f20-4ca7-bea5-56edfc28f8af admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:24.221887 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235f611-13d4-4e8c-95af-d101b6067816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:24.222503 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235f611-13d4-4e8c-95af-d101b6067816 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:24.222780 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235f611-13d4-4e8c-95af-d101b6067816 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:24.223057 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235f611-13d4-4e8c-95af-d101b6067816 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:24.225370 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9235f611-13d4-4e8c-95af-d101b6067816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:24.225992 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9235f611-13d4-4e8c-95af-d101b6067816 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:24.248118 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab249a7e-6455-457c-a62e-12eafd1de5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:24.249296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab249a7e-6455-457c-a62e-12eafd1de5c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:24.249815 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab249a7e-6455-457c-a62e-12eafd1de5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:24.250332 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab249a7e-6455-457c-a62e-12eafd1de5c9 admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:24.251234 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab249a7e-6455-457c-a62e-12eafd1de5c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:24.258009 dv-cinder-850574-1-smb devstack@keystone.service[86744]: WARNING py.warnings [None req-ab249a7e-6455-457c-a62e-12eafd1de5c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:52:24.258009 dv-cinder-850574-1-smb devstack@keystone.service[86744]: warnings.warn(msg) Jul 26 04:52:24.258009 dv-cinder-850574-1-smb devstack@keystone.service[86744]: Jul 26 04:52:24.260753 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab249a7e-6455-457c-a62e-12eafd1de5c9 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:24.290733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 764/1547] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:52:24 2022] POST /identity/v3/projects => generated 363 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:52:24.290733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6f588-e5db-44b2-86a7-89670041d497 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:24.290733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6f588-e5db-44b2-86a7-89670041d497 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:24.290733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6f588-e5db-44b2-86a7-89670041d497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:24.331749 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 784/1548] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:52:24 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:52:24.332627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab249a7e-6455-457c-a62e-12eafd1de5c9 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:24.340293 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-dea6f588-e5db-44b2-86a7-89670041d497 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:24.341547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-dea6f588-e5db-44b2-86a7-89670041d497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:24.349759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab249a7e-6455-457c-a62e-12eafd1de5c9 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:24.430131 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a062558-81db-44d0-bfbd-8065e99c241d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:24.431081 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a062558-81db-44d0-bfbd-8065e99c241d admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:24.431363 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a062558-81db-44d0-bfbd-8065e99c241d admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:24.431631 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a062558-81db-44d0-bfbd-8065e99c241d admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:24.432318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a062558-81db-44d0-bfbd-8065e99c241d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:24.434538 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a062558-81db-44d0-bfbd-8065e99c241d admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:24.441284 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 765/1549] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:24.443246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dc609-c17a-4411-b95f-f2a39e44f512 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:24.443721 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dc609-c17a-4411-b95f-f2a39e44f512 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:24.446299 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dc609-c17a-4411-b95f-f2a39e44f512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:24.466666 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 785/1550] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:52:24 2022] POST /identity/v3/users => generated 282 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:52:24.470191 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e9377-acfd-442e-8b0a-f7f340f7fa5f None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:24.470191 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e9377-acfd-442e-8b0a-f7f340f7fa5f None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:24.470191 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e9377-acfd-442e-8b0a-f7f340f7fa5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:24.473842 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-ea3dc609-c17a-4411-b95f-f2a39e44f512 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:24.475064 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-ea3dc609-c17a-4411-b95f-f2a39e44f512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:24.483564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 766/1551] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:24.484404 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3dc609-c17a-4411-b95f-f2a39e44f512 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:24.493007 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-e65e9377-acfd-442e-8b0a-f7f340f7fa5f None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:24.494319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-e65e9377-acfd-442e-8b0a-f7f340f7fa5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:24.498447 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3dc609-c17a-4411-b95f-f2a39e44f512 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:24.503713 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 786/1552] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:24.504746 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9caa8-69dd-46da-8bf7-18bf09be32b5 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:24.505013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9caa8-69dd-46da-8bf7-18bf09be32b5 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:24.505283 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9caa8-69dd-46da-8bf7-18bf09be32b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:24.506847 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6784d0-d34e-4e08-8595-f58b2fe704ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:24.507726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6784d0-d34e-4e08-8595-f58b2fe704ef admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:24.508042 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6784d0-d34e-4e08-8595-f58b2fe704ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:24.508308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6784d0-d34e-4e08-8595-f58b2fe704ef admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:24.509130 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6784d0-d34e-4e08-8595-f58b2fe704ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:24.511064 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6784d0-d34e-4e08-8595-f58b2fe704ef admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:24.522623 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 767/1553] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:24.523852 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3cad6-d0a3-42b8-bbf9-c6a85e7cf744 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:24.524142 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3cad6-d0a3-42b8-bbf9-c6a85e7cf744 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:24.524420 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3cad6-d0a3-42b8-bbf9-c6a85e7cf744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:24.529904 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-7ae9caa8-69dd-46da-8bf7-18bf09be32b5 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:24.531205 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-7ae9caa8-69dd-46da-8bf7-18bf09be32b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:24.539441 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 787/1554] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:24.540705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93b86d-2dc7-4d17-b771-0d7c9686c828 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:24.540987 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93b86d-2dc7-4d17-b771-0d7c9686c828 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:24.541260 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93b86d-2dc7-4d17-b771-0d7c9686c828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:24.546943 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-f3b3cad6-d0a3-42b8-bbf9-c6a85e7cf744 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:24.548189 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-f3b3cad6-d0a3-42b8-bbf9-c6a85e7cf744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:24.556976 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 768/1555] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:24.558285 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a19ca5-7380-428d-b68f-eb92435ff23f None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:24.558593 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a19ca5-7380-428d-b68f-eb92435ff23f None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:24.558846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a19ca5-7380-428d-b68f-eb92435ff23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:24.571278 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-8c93b86d-2dc7-4d17-b771-0d7c9686c828 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:24.572504 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-8c93b86d-2dc7-4d17-b771-0d7c9686c828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:24.579616 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-27a19ca5-7380-428d-b68f-eb92435ff23f None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:24.580832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-27a19ca5-7380-428d-b68f-eb92435ff23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:24.581519 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 788/1556] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:24.582892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93b86d-2dc7-4d17-b771-0d7c9686c828 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:24.589413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 769/1557] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:24.591536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e1dbe-c8cd-4cdd-bd5b-8a46c0db397f None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:24.591848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e1dbe-c8cd-4cdd-bd5b-8a46c0db397f None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:24.592101 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e1dbe-c8cd-4cdd-bd5b-8a46c0db397f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:24.599644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93b86d-2dc7-4d17-b771-0d7c9686c828 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:24.601198 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:24.607414 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0ddea-0e32-43df-9b47-888e9d22ab86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:24.608537 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0ddea-0e32-43df-9b47-888e9d22ab86 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:24.609004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0ddea-0e32-43df-9b47-888e9d22ab86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:24.609369 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0ddea-0e32-43df-9b47-888e9d22ab86 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:24.610177 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0ddea-0e32-43df-9b47-888e9d22ab86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:24.612014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0ddea-0e32-43df-9b47-888e9d22ab86 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:24.613999 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-029e1dbe-c8cd-4cdd-bd5b-8a46c0db397f None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:24.618068 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-029e1dbe-c8cd-4cdd-bd5b-8a46c0db397f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:24.627458 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 789/1558] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:24.627458 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b605b4f-bb0e-4bbf-9c12-69ae97ba5a5f None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:24.627458 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b605b4f-bb0e-4bbf-9c12-69ae97ba5a5f None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:24.627458 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b605b4f-bb0e-4bbf-9c12-69ae97ba5a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:24.628035 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 770/1559] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:24.632325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e1dbe-c8cd-4cdd-bd5b-8a46c0db397f None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:24.642249 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e1dbe-c8cd-4cdd-bd5b-8a46c0db397f None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:24.646868 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bdf133-f4f6-4e3f-bd28-05eb540adba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:24.647579 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bdf133-f4f6-4e3f-bd28-05eb540adba3 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:24.647912 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bdf133-f4f6-4e3f-bd28-05eb540adba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:24.648115 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bdf133-f4f6-4e3f-bd28-05eb540adba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:24.648218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-7b605b4f-bb0e-4bbf-9c12-69ae97ba5a5f None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:24.648818 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bdf133-f4f6-4e3f-bd28-05eb540adba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:24.649424 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-7b605b4f-bb0e-4bbf-9c12-69ae97ba5a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:24.650483 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bdf133-f4f6-4e3f-bd28-05eb540adba3 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:24.661017 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 771/1560] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:24.661479 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 790/1561] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:24.662327 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7257c52-0b68-4598-9394-292dbf523170 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:24.662614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7257c52-0b68-4598-9394-292dbf523170 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:24.662947 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05114e-9b15-4135-b1c3-e9a9697f1806 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:24.663052 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7257c52-0b68-4598-9394-292dbf523170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:24.663231 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05114e-9b15-4135-b1c3-e9a9697f1806 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:24.663508 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05114e-9b15-4135-b1c3-e9a9697f1806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:24.683258 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-b7257c52-0b68-4598-9394-292dbf523170 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:24.683722 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-3d05114e-9b15-4135-b1c3-e9a9697f1806 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:24.684492 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-b7257c52-0b68-4598-9394-292dbf523170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:24.684879 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-3d05114e-9b15-4135-b1c3-e9a9697f1806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:24.693046 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 772/1562] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:24.697622 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 791/1563] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:24.697814 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ad604-d3b2-42b6-8ba5-5b5395837db0 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:24.697814 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ad604-d3b2-42b6-8ba5-5b5395837db0 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:24.697814 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ad604-d3b2-42b6-8ba5-5b5395837db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:24.698151 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05114e-9b15-4135-b1c3-e9a9697f1806 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:24.701657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:24.707567 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05114e-9b15-4135-b1c3-e9a9697f1806 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:24.714225 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc831267-c103-4b16-8c1c-172f29c8c927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:24.714852 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc831267-c103-4b16-8c1c-172f29c8c927 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:24.715125 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc831267-c103-4b16-8c1c-172f29c8c927 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:24.715394 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc831267-c103-4b16-8c1c-172f29c8c927 admin admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:24.716185 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc831267-c103-4b16-8c1c-172f29c8c927 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:52:24.716486 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc831267-c103-4b16-8c1c-172f29c8c927 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:24.716636 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-fa9ad604-d3b2-42b6-8ba5-5b5395837db0 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:24.717854 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-fa9ad604-d3b2-42b6-8ba5-5b5395837db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:24.718199 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc831267-c103-4b16-8c1c-172f29c8c927 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:24.726213 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 773/1564] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:24.726949 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ad604-d3b2-42b6-8ba5-5b5395837db0 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:24.742529 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 792/1565] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:52:24.742529 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc831267-c103-4b16-8c1c-172f29c8c927 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:24.742866 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ad604-d3b2-42b6-8ba5-5b5395837db0 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:24.744983 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769b14e-c569-4197-81d1-9656406f2370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:24.745656 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769b14e-c569-4197-81d1-9656406f2370 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:24.745937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769b14e-c569-4197-81d1-9656406f2370 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:24.746253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769b14e-c569-4197-81d1-9656406f2370 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:24.746962 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769b14e-c569-4197-81d1-9656406f2370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:24.748404 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc831267-c103-4b16-8c1c-172f29c8c927 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:24.748730 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769b14e-c569-4197-81d1-9656406f2370 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:24.753321 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c09e3b-4bcb-494a-afa4-61db21f059af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:24.753963 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c09e3b-4bcb-494a-afa4-61db21f059af admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:24.754280 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c09e3b-4bcb-494a-afa4-61db21f059af admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:24.754546 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c09e3b-4bcb-494a-afa4-61db21f059af admin admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:24.755255 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c09e3b-4bcb-494a-afa4-61db21f059af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:52:24.755551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c09e3b-4bcb-494a-afa4-61db21f059af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:24.757259 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c09e3b-4bcb-494a-afa4-61db21f059af admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:24.760253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 774/1566] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:24.763279 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769b14e-c569-4197-81d1-9656406f2370 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:24.770520 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 793/1567] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:52:24.771356 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c09e3b-4bcb-494a-afa4-61db21f059af admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:24.776304 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769b14e-c569-4197-81d1-9656406f2370 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:24.781789 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c09e3b-4bcb-494a-afa4-61db21f059af admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:24.783450 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f895baf-bc19-4ffb-bb69-a22a73d09192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:24.784075 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f895baf-bc19-4ffb-bb69-a22a73d09192 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:24.784336 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f895baf-bc19-4ffb-bb69-a22a73d09192 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:24.784609 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f895baf-bc19-4ffb-bb69-a22a73d09192 admin admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:24.785324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f895baf-bc19-4ffb-bb69-a22a73d09192 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:52:24.785633 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f895baf-bc19-4ffb-bb69-a22a73d09192 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:24.786792 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7649d1-8dcb-4b77-b332-7bfec86e4365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:24.787300 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f895baf-bc19-4ffb-bb69-a22a73d09192 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:24.787452 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7649d1-8dcb-4b77-b332-7bfec86e4365 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:24.787717 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7649d1-8dcb-4b77-b332-7bfec86e4365 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:24.788063 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7649d1-8dcb-4b77-b332-7bfec86e4365 admin admin] PATH_INFO: `/v3/projects/4f326b7087404003a78eb6cd91822e5f/users/c3274391c65b4eeab0fcf22ca4f8b791/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:24.800293 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 775/1568] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:52:24.800997 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f895baf-bc19-4ffb-bb69-a22a73d09192 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:24.803690 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7649d1-8dcb-4b77-b332-7bfec86e4365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f326b7087404003a78eb6cd91822e5f, user_id=c3274391c65b4eeab0fcf22ca4f8b791, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:24.806537 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7649d1-8dcb-4b77-b332-7bfec86e4365 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:24.813282 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f895baf-bc19-4ffb-bb69-a22a73d09192 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:24.818191 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1750a-c770-4622-92af-3f3377fc839d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:24.818824 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1750a-c770-4622-92af-3f3377fc839d admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:24.819169 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1750a-c770-4622-92af-3f3377fc839d admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:24.819433 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1750a-c770-4622-92af-3f3377fc839d admin admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:24.820147 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1750a-c770-4622-92af-3f3377fc839d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:52:24.820450 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1750a-c770-4622-92af-3f3377fc839d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:24.821676 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 794/1569] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:52:24 2022] PUT /identity/v3/projects/4f326b7087404003a78eb6cd91822e5f/users/c3274391c65b4eeab0fcf22ca4f8b791/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:24.825802 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1750a-c770-4622-92af-3f3377fc839d admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:24.826024 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7649d1-8dcb-4b77-b332-7bfec86e4365 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:24.835377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 776/1570] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:52:24.836314 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1750a-c770-4622-92af-3f3377fc839d admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:24.846783 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1750a-c770-4622-92af-3f3377fc839d admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:24.891573 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7649d1-8dcb-4b77-b332-7bfec86e4365 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:24.896572 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d69f9-9b6b-4153-9cdc-30b6516a056a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:24.897274 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d69f9-9b6b-4153-9cdc-30b6516a056a admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:24.897555 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d69f9-9b6b-4153-9cdc-30b6516a056a admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:24.897826 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d69f9-9b6b-4153-9cdc-30b6516a056a admin admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:24.898574 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d69f9-9b6b-4153-9cdc-30b6516a056a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:52:24.898881 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d69f9-9b6b-4153-9cdc-30b6516a056a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:24.900528 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d69f9-9b6b-4153-9cdc-30b6516a056a admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:24.909957 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27635e4d-9fdc-4924-bac6-40a4f2798059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:24.910807 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27635e4d-9fdc-4924-bac6-40a4f2798059 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:24.910993 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27635e4d-9fdc-4924-bac6-40a4f2798059 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:24.911170 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27635e4d-9fdc-4924-bac6-40a4f2798059 admin admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:24.911867 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27635e4d-9fdc-4924-bac6-40a4f2798059 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:52:24.912171 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27635e4d-9fdc-4924-bac6-40a4f2798059 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:24.913923 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27635e4d-9fdc-4924-bac6-40a4f2798059 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:24.915512 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 795/1571] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:52:24.916347 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d69f9-9b6b-4153-9cdc-30b6516a056a admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:24.928769 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d69f9-9b6b-4153-9cdc-30b6516a056a admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:24.938801 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 777/1572] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:52:24.938801 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27635e4d-9fdc-4924-bac6-40a4f2798059 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:24.939096 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6f69a-c170-4aa2-9c70-c5369af0611b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:24.939096 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6f69a-c170-4aa2-9c70-c5369af0611b admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:24.939096 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6f69a-c170-4aa2-9c70-c5369af0611b admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:24.939096 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6f69a-c170-4aa2-9c70-c5369af0611b admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:24.939514 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe6f69a-c170-4aa2-9c70-c5369af0611b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:24.939514 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe6f69a-c170-4aa2-9c70-c5369af0611b admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:24.947326 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27635e4d-9fdc-4924-bac6-40a4f2798059 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:24.952544 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14a4d2-45ec-4e90-a25d-8f651d21ccf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:24.953367 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14a4d2-45ec-4e90-a25d-8f651d21ccf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:24.953736 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14a4d2-45ec-4e90-a25d-8f651d21ccf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:24.954178 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14a4d2-45ec-4e90-a25d-8f651d21ccf8 admin admin] PATH_INFO: `/v3/projects/21d4466182cc431eae80a789d966178b/users/6958f2c24b3a4bc3922ab7cd7f5bce50/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:24.973156 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14a4d2-45ec-4e90-a25d-8f651d21ccf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21d4466182cc431eae80a789d966178b, user_id=6958f2c24b3a4bc3922ab7cd7f5bce50, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:24.974413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: WARNING py.warnings [None req-6b14a4d2-45ec-4e90-a25d-8f651d21ccf8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:52:24.974413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: warnings.warn(msg) Jul 26 04:52:24.974413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: Jul 26 04:52:24.975588 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 796/1573] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:52:24 2022] POST /identity/v3/projects => generated 391 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:52:24.976435 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6f69a-c170-4aa2-9c70-c5369af0611b admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:24.977873 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b14a4d2-45ec-4e90-a25d-8f651d21ccf8 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:24.997305 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 778/1574] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:52:24 2022] PUT /identity/v3/projects/21d4466182cc431eae80a789d966178b/users/6958f2c24b3a4bc3922ab7cd7f5bce50/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:24.998799 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14a4d2-45ec-4e90-a25d-8f651d21ccf8 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:25.063904 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6f69a-c170-4aa2-9c70-c5369af0611b admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:25.079028 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14a4d2-45ec-4e90-a25d-8f651d21ccf8 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:25.086675 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa6f21-274a-44a3-bfa6-1c518204ba8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:25.087569 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa6f21-274a-44a3-bfa6-1c518204ba8f admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:25.088032 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa6f21-274a-44a3-bfa6-1c518204ba8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:25.088503 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa6f21-274a-44a3-bfa6-1c518204ba8f admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:25.089606 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa6f21-274a-44a3-bfa6-1c518204ba8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:25.092714 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa6f21-274a-44a3-bfa6-1c518204ba8f admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:25.109887 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:25.110219 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:25.132647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 779/1575] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:52:24 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:52:25.133846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0049258-8162-4c40-880e-e4318d1a03e2 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:25.134233 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0049258-8162-4c40-880e-e4318d1a03e2 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:25.134402 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0049258-8162-4c40-880e-e4318d1a03e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:25.145829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae36ac-cb2e-4e83-8c62-bd464f1dddbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:25.146633 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae36ac-cb2e-4e83-8c62-bd464f1dddbe admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:25.147112 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae36ac-cb2e-4e83-8c62-bd464f1dddbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:25.147668 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae36ac-cb2e-4e83-8c62-bd464f1dddbe admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:25.148525 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae36ac-cb2e-4e83-8c62-bd464f1dddbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:25.150830 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae36ac-cb2e-4e83-8c62-bd464f1dddbe admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:25.155938 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-a0049258-8162-4c40-880e-e4318d1a03e2 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:25.157465 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-a0049258-8162-4c40-880e-e4318d1a03e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:25.183327 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 797/1576] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:52:24 2022] POST /identity/v3/projects => generated 389 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:52:25.184411 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae36ac-cb2e-4e83-8c62-bd464f1dddbe admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:25.230273 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 780/1577] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:25.231033 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0049258-8162-4c40-880e-e4318d1a03e2 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:25.242272 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0049258-8162-4c40-880e-e4318d1a03e2 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:25.268348 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae36ac-cb2e-4e83-8c62-bd464f1dddbe admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:25.273993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702e38d-b310-44f3-a456-50b7a9e70204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:25.274536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702e38d-b310-44f3-a456-50b7a9e70204 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:25.274788 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702e38d-b310-44f3-a456-50b7a9e70204 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:25.275059 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702e38d-b310-44f3-a456-50b7a9e70204 admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:25.275908 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702e38d-b310-44f3-a456-50b7a9e70204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:25.277735 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702e38d-b310-44f3-a456-50b7a9e70204 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:25.308597 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287194c5-41e7-4948-89c2-5058d3869ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:25.309181 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287194c5-41e7-4948-89c2-5058d3869ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:25.309181 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287194c5-41e7-4948-89c2-5058d3869ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:25.309602 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287194c5-41e7-4948-89c2-5058d3869ac8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:25.310208 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287194c5-41e7-4948-89c2-5058d3869ac8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:25.312090 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287194c5-41e7-4948-89c2-5058d3869ac8 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:25.314644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 798/1578] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:52:25 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:52:25.316219 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702e38d-b310-44f3-a456-50b7a9e70204 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:25.349301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 781/1579] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:52:25 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:52:25.353677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287194c5-41e7-4948-89c2-5058d3869ac8 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:25.390413 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702e38d-b310-44f3-a456-50b7a9e70204 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:25.444339 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287194c5-41e7-4948-89c2-5058d3869ac8 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:25.449737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643984f-0e8e-41d0-85b0-05dd0623a77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:25.450537 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643984f-0e8e-41d0-85b0-05dd0623a77c admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:25.450967 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643984f-0e8e-41d0-85b0-05dd0623a77c admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:25.451420 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643984f-0e8e-41d0-85b0-05dd0623a77c admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:25.452226 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643984f-0e8e-41d0-85b0-05dd0623a77c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:25.454356 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:25.454993 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643984f-0e8e-41d0-85b0-05dd0623a77c admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:25.473029 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48a187-23a1-4782-8897-39628aa8962e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:25.473504 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48a187-23a1-4782-8897-39628aa8962e admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:25.474104 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48a187-23a1-4782-8897-39628aa8962e admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:25.474425 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e48a187-23a1-4782-8897-39628aa8962e admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:25.475205 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48a187-23a1-4782-8897-39628aa8962e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:25.477250 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e48a187-23a1-4782-8897-39628aa8962e admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:25.503939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 782/1580] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:52:25 2022] POST /identity/v3/users => generated 296 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:52:25.503939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8efccf-b4c4-4911-9afd-a73e10f626f7 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:25.503939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8efccf-b4c4-4911-9afd-a73e10f626f7 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:25.503939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8efccf-b4c4-4911-9afd-a73e10f626f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:25.514050 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 799/1581] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:52:25 2022] POST /identity/v3/projects => generated 401 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:52:25.516437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48a187-23a1-4782-8897-39628aa8962e admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:25.522817 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:25.549203 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-ea8efccf-b4c4-4911-9afd-a73e10f626f7 None None] MFA Rules not processed for user `6958f2c24b3a4bc3922ab7cd7f5bce50`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:25.551378 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-ea8efccf-b4c4-4911-9afd-a73e10f626f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:25.626956 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e48a187-23a1-4782-8897-39628aa8962e admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:25.635592 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fce08-8ae3-4483-84ed-1dfa9236ae63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:25.636621 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fce08-8ae3-4483-84ed-1dfa9236ae63 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:25.637129 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fce08-8ae3-4483-84ed-1dfa9236ae63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:25.637573 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fce08-8ae3-4483-84ed-1dfa9236ae63 admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:25.638935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fce08-8ae3-4483-84ed-1dfa9236ae63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:25.642580 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fce08-8ae3-4483-84ed-1dfa9236ae63 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:25.655575 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 783/1582] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:25 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:25.656451 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8efccf-b4c4-4911-9afd-a73e10f626f7 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:25.671655 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8efccf-b4c4-4911-9afd-a73e10f626f7 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:25.678124 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 800/1583] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:52:25 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:52:25.678461 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d53ee-8653-47f7-a60b-5d5e46a72924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:25.678976 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fce08-8ae3-4483-84ed-1dfa9236ae63 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:25.679353 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d53ee-8653-47f7-a60b-5d5e46a72924 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:25.679732 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d53ee-8653-47f7-a60b-5d5e46a72924 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:25.680417 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d53ee-8653-47f7-a60b-5d5e46a72924 admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:25.680905 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-bc4fce08-8ae3-4483-84ed-1dfa9236ae63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:25.681328 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d53ee-8653-47f7-a60b-5d5e46a72924 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:25.683845 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d53ee-8653-47f7-a60b-5d5e46a72924 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:25.713730 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 784/1584] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:52:25 2022] POST /identity/v3/users => generated 295 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:52:25.713730 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d53ee-8653-47f7-a60b-5d5e46a72924 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:25.726239 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d53ee-8653-47f7-a60b-5d5e46a72924 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:25.731856 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a249332-be96-444b-91c1-1829c249f96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:25.732781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a249332-be96-444b-91c1-1829c249f96a admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:25.733101 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a249332-be96-444b-91c1-1829c249f96a admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:25.733420 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a249332-be96-444b-91c1-1829c249f96a admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:25.734656 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a249332-be96-444b-91c1-1829c249f96a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:25.736721 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a249332-be96-444b-91c1-1829c249f96a admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:25.748099 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fce08-8ae3-4483-84ed-1dfa9236ae63 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:25.753361 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ac258-6b5a-410c-a5db-90f64f690c28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:25.754504 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ac258-6b5a-410c-a5db-90f64f690c28 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:25.754808 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ac258-6b5a-410c-a5db-90f64f690c28 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:25.755128 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ac258-6b5a-410c-a5db-90f64f690c28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:25.768576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 785/1585] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:52:25 2022] POST /identity/v3/users => generated 286 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:52:25.768852 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ac258-6b5a-410c-a5db-90f64f690c28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:25.774350 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a249332-be96-444b-91c1-1829c249f96a admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:25.774673 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ac258-6b5a-410c-a5db-90f64f690c28 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:25.784521 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 801/1586] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:52:25.785261 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ac258-6b5a-410c-a5db-90f64f690c28 service neutron] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:25.797194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ac258-6b5a-410c-a5db-90f64f690c28 service neutron] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:25.800039 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a249332-be96-444b-91c1-1829c249f96a admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:25.804111 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4bb737-cd17-4634-bedb-9b9e55dd4159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:25.804936 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4bb737-cd17-4634-bedb-9b9e55dd4159 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:25.805342 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4bb737-cd17-4634-bedb-9b9e55dd4159 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:25.805803 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4bb737-cd17-4634-bedb-9b9e55dd4159 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:25.807132 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688d54b-206f-42de-9a3e-3f1e2b090a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:25.807435 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4bb737-cd17-4634-bedb-9b9e55dd4159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:25.808241 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688d54b-206f-42de-9a3e-3f1e2b090a8f admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:25.808725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688d54b-206f-42de-9a3e-3f1e2b090a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:25.809208 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f688d54b-206f-42de-9a3e-3f1e2b090a8f admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:25.809583 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4bb737-cd17-4634-bedb-9b9e55dd4159 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:25.810111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688d54b-206f-42de-9a3e-3f1e2b090a8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:25.812246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f688d54b-206f-42de-9a3e-3f1e2b090a8f admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:25.827991 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 802/1587] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:25.829562 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4bb737-cd17-4634-bedb-9b9e55dd4159 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:25.846429 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4bb737-cd17-4634-bedb-9b9e55dd4159 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:25.850061 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 786/1588] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:52:25 2022] POST /identity/v3/users => generated 288 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:52:25.850821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688d54b-206f-42de-9a3e-3f1e2b090a8f admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:25.853762 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e69b4-f8ea-4e00-8df0-e70df7a7321b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:25.854989 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e69b4-f8ea-4e00-8df0-e70df7a7321b admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:25.855499 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e69b4-f8ea-4e00-8df0-e70df7a7321b admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:25.855999 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e69b4-f8ea-4e00-8df0-e70df7a7321b admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:25.857342 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e69b4-f8ea-4e00-8df0-e70df7a7321b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:25.860506 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e69b4-f8ea-4e00-8df0-e70df7a7321b admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:25.862244 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f688d54b-206f-42de-9a3e-3f1e2b090a8f admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:25.867750 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcea4e0-f8f7-4267-b2ae-77c103f55b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:25.868556 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcea4e0-f8f7-4267-b2ae-77c103f55b01 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:25.868992 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcea4e0-f8f7-4267-b2ae-77c103f55b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:25.869268 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcea4e0-f8f7-4267-b2ae-77c103f55b01 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:25.869951 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcea4e0-f8f7-4267-b2ae-77c103f55b01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:25.872172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcea4e0-f8f7-4267-b2ae-77c103f55b01 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:25.891230 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 803/1589] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:52:25 2022] POST /identity/v3/users => generated 301 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:52:25.892647 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e69b4-f8ea-4e00-8df0-e70df7a7321b admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:25.906023 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e69b4-f8ea-4e00-8df0-e70df7a7321b admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:25.912454 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0894f10-a269-4eb4-ba13-3bb610954646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:25.913469 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0894f10-a269-4eb4-ba13-3bb610954646 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:25.913760 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0894f10-a269-4eb4-ba13-3bb610954646 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:25.914071 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0894f10-a269-4eb4-ba13-3bb610954646 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:25.914870 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0894f10-a269-4eb4-ba13-3bb610954646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:25.916578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0894f10-a269-4eb4-ba13-3bb610954646 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:25.918933 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 787/1590] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:52:25 2022] POST /identity/v3/projects => generated 365 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:52:25.919842 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcea4e0-f8f7-4267-b2ae-77c103f55b01 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:25.939710 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 804/1591] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:25.939710 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0894f10-a269-4eb4-ba13-3bb610954646 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:25.952993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0894f10-a269-4eb4-ba13-3bb610954646 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:25.981322 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:26.032653 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcea4e0-f8f7-4267-b2ae-77c103f55b01 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:26.040251 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324ac44-b4a2-4b57-9a9c-72cf739c4c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:26.041147 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324ac44-b4a2-4b57-9a9c-72cf739c4c9c admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:26.041326 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324ac44-b4a2-4b57-9a9c-72cf739c4c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:26.041669 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324ac44-b4a2-4b57-9a9c-72cf739c4c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:26.043526 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324ac44-b4a2-4b57-9a9c-72cf739c4c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:26.045028 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324ac44-b4a2-4b57-9a9c-72cf739c4c9c admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:26.047975 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eeabac-c5d4-494e-87c2-e642e842c1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:26.049157 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eeabac-c5d4-494e-87c2-e642e842c1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:26.049954 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eeabac-c5d4-494e-87c2-e642e842c1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:26.050319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eeabac-c5d4-494e-87c2-e642e842c1e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:26.051572 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eeabac-c5d4-494e-87c2-e642e842c1e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:26.060574 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eeabac-c5d4-494e-87c2-e642e842c1e7 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:26.067664 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 788/1592] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:26.071863 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324ac44-b4a2-4b57-9a9c-72cf739c4c9c admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:26.076989 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 805/1593] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:26.078630 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eeabac-c5d4-494e-87c2-e642e842c1e7 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:26.091270 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324ac44-b4a2-4b57-9a9c-72cf739c4c9c admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:26.096771 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d1f95-f9e4-4367-be40-935caf04976e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:26.097516 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d1f95-f9e4-4367-be40-935caf04976e admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:26.097829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d1f95-f9e4-4367-be40-935caf04976e admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:26.098141 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d1f95-f9e4-4367-be40-935caf04976e admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:26.098539 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eeabac-c5d4-494e-87c2-e642e842c1e7 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:26.098869 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d1f95-f9e4-4367-be40-935caf04976e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:26.100495 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d1f95-f9e4-4367-be40-935caf04976e admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:26.106835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47790e7-e6fd-43f9-96b8-c183292a4dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:26.108808 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47790e7-e6fd-43f9-96b8-c183292a4dab admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:26.108808 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47790e7-e6fd-43f9-96b8-c183292a4dab admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:26.109173 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47790e7-e6fd-43f9-96b8-c183292a4dab admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:26.110437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47790e7-e6fd-43f9-96b8-c183292a4dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:26.113616 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47790e7-e6fd-43f9-96b8-c183292a4dab admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:26.117309 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 789/1594] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:26.121257 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d1f95-f9e4-4367-be40-935caf04976e admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:26.132612 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d1f95-f9e4-4367-be40-935caf04976e admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:26.139032 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 806/1595] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:26.139032 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47790e7-e6fd-43f9-96b8-c183292a4dab admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:26.143300 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a9516-eff2-4e32-8162-27e8313c21d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:26.144050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a9516-eff2-4e32-8162-27e8313c21d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:26.144432 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a9516-eff2-4e32-8162-27e8313c21d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:26.144960 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054a9516-eff2-4e32-8162-27e8313c21d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:26.145520 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a9516-eff2-4e32-8162-27e8313c21d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:26.147601 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054a9516-eff2-4e32-8162-27e8313c21d9 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:26.149530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:26.157447 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47790e7-e6fd-43f9-96b8-c183292a4dab admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:26.165153 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 790/1596] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:26.166049 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a9516-eff2-4e32-8162-27e8313c21d9 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:26.166786 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ccc7b-ddf2-4a24-9c11-0d5695f00ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:26.167906 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ccc7b-ddf2-4a24-9c11-0d5695f00ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:26.168377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ccc7b-ddf2-4a24-9c11-0d5695f00ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:26.168843 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ccc7b-ddf2-4a24-9c11-0d5695f00ad0 admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:26.170010 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ccc7b-ddf2-4a24-9c11-0d5695f00ad0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:26.176227 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ccc7b-ddf2-4a24-9c11-0d5695f00ad0 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:26.179866 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054a9516-eff2-4e32-8162-27e8313c21d9 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:26.185004 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440516e-f764-4d20-81ca-0c40f6b9aa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:26.185648 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440516e-f764-4d20-81ca-0c40f6b9aa29 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:26.185931 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440516e-f764-4d20-81ca-0c40f6b9aa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:26.186240 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440516e-f764-4d20-81ca-0c40f6b9aa29 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:26.186948 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440516e-f764-4d20-81ca-0c40f6b9aa29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:26.188614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440516e-f764-4d20-81ca-0c40f6b9aa29 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:26.204140 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 791/1597] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:26.204140 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440516e-f764-4d20-81ca-0c40f6b9aa29 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:26.215007 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440516e-f764-4d20-81ca-0c40f6b9aa29 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:26.219861 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12df09-7070-45cc-b5f9-6f3021601f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:26.220503 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12df09-7070-45cc-b5f9-6f3021601f73 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:26.220785 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12df09-7070-45cc-b5f9-6f3021601f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:26.221060 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12df09-7070-45cc-b5f9-6f3021601f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:26.221765 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12df09-7070-45cc-b5f9-6f3021601f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:26.222338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 807/1598] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:52:26 2022] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:52:26.223604 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ccc7b-ddf2-4a24-9c11-0d5695f00ad0 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:26.223714 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12df09-7070-45cc-b5f9-6f3021601f73 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:26.239142 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 792/1599] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:26.239142 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12df09-7070-45cc-b5f9-6f3021601f73 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:26.244902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ccc7b-ddf2-4a24-9c11-0d5695f00ad0 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:26.251860 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12df09-7070-45cc-b5f9-6f3021601f73 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:26.253640 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d415dd-27d6-45fc-95fd-da5bf99209a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:26.254997 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d415dd-27d6-45fc-95fd-da5bf99209a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:26.255616 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d415dd-27d6-45fc-95fd-da5bf99209a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:26.256175 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d415dd-27d6-45fc-95fd-da5bf99209a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:26.257438 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad7da1-c2dd-479d-99ca-884f3ef34ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:26.257848 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d415dd-27d6-45fc-95fd-da5bf99209a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:26.258302 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad7da1-c2dd-479d-99ca-884f3ef34ce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:26.258655 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad7da1-c2dd-479d-99ca-884f3ef34ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:26.259038 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad7da1-c2dd-479d-99ca-884f3ef34ce7 admin admin] PATH_INFO: `/v3/projects/67113d9f19aa44fda88cc66b6012b9cd/users/8b912bfd686648fa9aae1dca24c78697/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:26.261157 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d415dd-27d6-45fc-95fd-da5bf99209a3 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:26.285027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 808/1600] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:26.285027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d415dd-27d6-45fc-95fd-da5bf99209a3 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:26.288852 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ad7da1-c2dd-479d-99ca-884f3ef34ce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67113d9f19aa44fda88cc66b6012b9cd, user_id=8b912bfd686648fa9aae1dca24c78697, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:26.293645 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ad7da1-c2dd-479d-99ca-884f3ef34ce7 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:26.306529 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d415dd-27d6-45fc-95fd-da5bf99209a3 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:26.313695 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 793/1601] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:52:26 2022] PUT /identity/v3/projects/67113d9f19aa44fda88cc66b6012b9cd/users/8b912bfd686648fa9aae1dca24c78697/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:26.314882 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad7da1-c2dd-479d-99ca-884f3ef34ce7 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:26.399559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85b975-6a90-4dea-9b18-ce5a92e310bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:26.400858 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85b975-6a90-4dea-9b18-ce5a92e310bc admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:26.401420 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85b975-6a90-4dea-9b18-ce5a92e310bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:26.401706 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85b975-6a90-4dea-9b18-ce5a92e310bc admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:26.402526 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85b975-6a90-4dea-9b18-ce5a92e310bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:26.405463 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85b975-6a90-4dea-9b18-ce5a92e310bc admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:26.419207 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad7da1-c2dd-479d-99ca-884f3ef34ce7 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:26.420682 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 809/1602] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:26.421848 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85b975-6a90-4dea-9b18-ce5a92e310bc admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:26.429309 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07dd09-b62c-40d3-80f7-937de76f5a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:26.431013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07dd09-b62c-40d3-80f7-937de76f5a57 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:26.432288 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07dd09-b62c-40d3-80f7-937de76f5a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:26.433448 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07dd09-b62c-40d3-80f7-937de76f5a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:26.437172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07dd09-b62c-40d3-80f7-937de76f5a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:26.441262 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07dd09-b62c-40d3-80f7-937de76f5a57 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:26.442360 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85b975-6a90-4dea-9b18-ce5a92e310bc admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:26.448085 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4349b-e5c9-4cf7-86a9-1a62074bc933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:26.448754 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4349b-e5c9-4cf7-86a9-1a62074bc933 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:26.449036 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4349b-e5c9-4cf7-86a9-1a62074bc933 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:26.449314 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4349b-e5c9-4cf7-86a9-1a62074bc933 admin admin] PATH_INFO: `/v3/projects/3dc8fb1619e243d4b25822821a8c3497/users/1395843934af46cc90694bb1c0fc8a3c/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:26.455728 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 794/1603] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:26.456530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07dd09-b62c-40d3-80f7-937de76f5a57 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:26.468219 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07dd09-b62c-40d3-80f7-937de76f5a57 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:26.473353 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4349b-e5c9-4cf7-86a9-1a62074bc933 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dc8fb1619e243d4b25822821a8c3497, user_id=1395843934af46cc90694bb1c0fc8a3c, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:26.474087 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22e14f-4ec1-4e92-b699-a1f55ac0c2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:26.474863 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22e14f-4ec1-4e92-b699-a1f55ac0c2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:26.475341 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22e14f-4ec1-4e92-b699-a1f55ac0c2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:26.475711 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22e14f-4ec1-4e92-b699-a1f55ac0c2a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:26.476498 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22e14f-4ec1-4e92-b699-a1f55ac0c2a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:26.476712 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4349b-e5c9-4cf7-86a9-1a62074bc933 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:26.478333 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22e14f-4ec1-4e92-b699-a1f55ac0c2a4 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:26.497325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 795/1604] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:26.497325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22e14f-4ec1-4e92-b699-a1f55ac0c2a4 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:26.508430 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 810/1605] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:52:26 2022] PUT /identity/v3/projects/3dc8fb1619e243d4b25822821a8c3497/users/1395843934af46cc90694bb1c0fc8a3c/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:26.510078 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22e14f-4ec1-4e92-b699-a1f55ac0c2a4 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:26.510348 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4349b-e5c9-4cf7-86a9-1a62074bc933 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:26.610975 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:26.611916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e815c88-5dad-48e2-b441-3b2b46ad6ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:26.613247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e815c88-5dad-48e2-b441-3b2b46ad6ec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:26.614151 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e815c88-5dad-48e2-b441-3b2b46ad6ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:26.614965 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e815c88-5dad-48e2-b441-3b2b46ad6ec9 admin admin] PATH_INFO: `/v3/projects/f23e54f4300640899c1ff1cdbbd9203c/users/c01c17a9cf7e485da50e80b139cf19eb/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:26.618632 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4349b-e5c9-4cf7-86a9-1a62074bc933 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:26.629545 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90146928-57c1-40b8-97a3-613b3671f9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:26.630968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90146928-57c1-40b8-97a3-613b3671f9f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:26.631610 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90146928-57c1-40b8-97a3-613b3671f9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:26.632111 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90146928-57c1-40b8-97a3-613b3671f9f5 admin admin] PATH_INFO: `/v3/projects/29b4d2eba89247e7a2c23c4f652de15a/users/3af1ef0042a549838d12e154f6c4e486/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:26.639023 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e815c88-5dad-48e2-b441-3b2b46ad6ec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f23e54f4300640899c1ff1cdbbd9203c, user_id=c01c17a9cf7e485da50e80b139cf19eb, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:26.641771 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e815c88-5dad-48e2-b441-3b2b46ad6ec9 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:26.660445 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 796/1606] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:52:26 2022] PUT /identity/v3/projects/f23e54f4300640899c1ff1cdbbd9203c/users/c01c17a9cf7e485da50e80b139cf19eb/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:26.661388 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90146928-57c1-40b8-97a3-613b3671f9f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29b4d2eba89247e7a2c23c4f652de15a, user_id=3af1ef0042a549838d12e154f6c4e486, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:26.663921 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba762b6-9606-4c31-a39b-6479cfa470eb None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:26.664675 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba762b6-9606-4c31-a39b-6479cfa470eb None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:26.665634 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba762b6-9606-4c31-a39b-6479cfa470eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:26.667360 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90146928-57c1-40b8-97a3-613b3671f9f5 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:26.698781 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 811/1607] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:52:26 2022] PUT /identity/v3/projects/29b4d2eba89247e7a2c23c4f652de15a/users/3af1ef0042a549838d12e154f6c4e486/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:26.700730 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90146928-57c1-40b8-97a3-613b3671f9f5 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:26.704099 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-eba762b6-9606-4c31-a39b-6479cfa470eb None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:26.706177 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-eba762b6-9606-4c31-a39b-6479cfa470eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:26.724152 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:26.814383 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 797/1608] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:26.815375 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba762b6-9606-4c31-a39b-6479cfa470eb None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:26.830302 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90146928-57c1-40b8-97a3-613b3671f9f5 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:26.835207 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba762b6-9606-4c31-a39b-6479cfa470eb None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:26.838069 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ac8db-f841-4eb8-9ec3-30cd5cf576e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:26.839279 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ac8db-f841-4eb8-9ec3-30cd5cf576e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:26.839934 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ac8db-f841-4eb8-9ec3-30cd5cf576e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:26.840424 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ac8db-f841-4eb8-9ec3-30cd5cf576e5 admin admin] PATH_INFO: `/v3/projects/c4ba838e0b174dcda55c682f656a35df/users/bc75a3d22654405990651c3f5d8f01e9/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:26.842544 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cb805-3388-4189-91c8-880ea9bcec38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:26.843586 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cb805-3388-4189-91c8-880ea9bcec38 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:26.844022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cb805-3388-4189-91c8-880ea9bcec38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:26.846081 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cb805-3388-4189-91c8-880ea9bcec38 admin admin] PATH_INFO: `/v3/projects/ed53fe542f8142cbb3d77588e7a75ff1/users/a8d6c277fff9401e9f7bb24fef4df8d6/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:26.869050 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ac8db-f841-4eb8-9ec3-30cd5cf576e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4ba838e0b174dcda55c682f656a35df, user_id=bc75a3d22654405990651c3f5d8f01e9, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:26.874973 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ac8db-f841-4eb8-9ec3-30cd5cf576e5 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:26.879274 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697cb805-3388-4189-91c8-880ea9bcec38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed53fe542f8142cbb3d77588e7a75ff1, user_id=a8d6c277fff9401e9f7bb24fef4df8d6, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:26.886175 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697cb805-3388-4189-91c8-880ea9bcec38 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:26.903097 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 812/1609] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:52:26 2022] PUT /identity/v3/projects/c4ba838e0b174dcda55c682f656a35df/users/bc75a3d22654405990651c3f5d8f01e9/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:26.903097 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ac8db-f841-4eb8-9ec3-30cd5cf576e5 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:26.923621 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 798/1610] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:52:26 2022] PUT /identity/v3/projects/ed53fe542f8142cbb3d77588e7a75ff1/users/a8d6c277fff9401e9f7bb24fef4df8d6/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:26.926153 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb6aba-9910-4ad7-93b5-c8962c953ab6 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:26.926801 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb6aba-9910-4ad7-93b5-c8962c953ab6 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:26.927398 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb6aba-9910-4ad7-93b5-c8962c953ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:26.952423 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-01fb6aba-9910-4ad7-93b5-c8962c953ab6 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:26.954206 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-01fb6aba-9910-4ad7-93b5-c8962c953ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:27.040439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 799/1611] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:27.042023 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575199dd-3534-439a-92c1-d0139aca2e51 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:27.042494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575199dd-3534-439a-92c1-d0139aca2e51 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:27.042775 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575199dd-3534-439a-92c1-d0139aca2e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:27.070911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-575199dd-3534-439a-92c1-d0139aca2e51 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:27.072568 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-575199dd-3534-439a-92c1-d0139aca2e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:27.078376 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ac8db-f841-4eb8-9ec3-30cd5cf576e5 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:27.085527 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 800/1612] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:27.089963 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7e64e-553c-4e53-b79a-bc93363a280b None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:27.091807 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7e64e-553c-4e53-b79a-bc93363a280b None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:27.092424 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7e64e-553c-4e53-b79a-bc93363a280b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:27.104078 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cad6c-a06e-4368-a3d9-aa96be7d4fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:27.105266 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cad6c-a06e-4368-a3d9-aa96be7d4fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:27.105770 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cad6c-a06e-4368-a3d9-aa96be7d4fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:27.107255 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414cad6c-a06e-4368-a3d9-aa96be7d4fa4 admin admin] PATH_INFO: `/v3/projects/e6c67e4921334c30839adafcbafbf9e4/users/ec92337c5aa04990830d47ea92395ebf/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:27.146640 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414cad6c-a06e-4368-a3d9-aa96be7d4fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6c67e4921334c30839adafcbafbf9e4, user_id=ec92337c5aa04990830d47ea92395ebf, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:27.149174 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-14f7e64e-553c-4e53-b79a-bc93363a280b None None] MFA Rules not processed for user `3af1ef0042a549838d12e154f6c4e486`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:27.149756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414cad6c-a06e-4368-a3d9-aa96be7d4fa4 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:27.151731 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-14f7e64e-553c-4e53-b79a-bc93363a280b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:27.179489 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 813/1613] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:52:26 2022] PUT /identity/v3/projects/e6c67e4921334c30839adafcbafbf9e4/users/ec92337c5aa04990830d47ea92395ebf/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:27.181557 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cad6c-a06e-4368-a3d9-aa96be7d4fa4 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:27.267053 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:27.297320 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 801/1614] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:27.299582 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501fc5f-ab44-4273-83a5-63cc86cb3ebc None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:27.300187 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501fc5f-ab44-4273-83a5-63cc86cb3ebc None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:27.300187 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501fc5f-ab44-4273-83a5-63cc86cb3ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:27.303804 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414cad6c-a06e-4368-a3d9-aa96be7d4fa4 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:27.309021 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b904a-d686-4064-b769-2a2cf2ab48c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:27.309940 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b904a-d686-4064-b769-2a2cf2ab48c5 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:27.310644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b904a-d686-4064-b769-2a2cf2ab48c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:27.311307 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b904a-d686-4064-b769-2a2cf2ab48c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:27.334988 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-6501fc5f-ab44-4273-83a5-63cc86cb3ebc None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:27.337670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-6501fc5f-ab44-4273-83a5-63cc86cb3ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:27.362671 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:27.423819 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b904a-d686-4064-b769-2a2cf2ab48c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:27.427914 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010b904a-d686-4064-b769-2a2cf2ab48c5 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:27.442698 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 814/1615] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:52:27.444285 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a14ee-fa4f-4774-812d-942641a7103e None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:27.445539 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a14ee-fa4f-4774-812d-942641a7103e None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:27.445539 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97a14ee-fa4f-4774-812d-942641a7103e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:27.462756 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 802/1616] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:27.463821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501fc5f-ab44-4273-83a5-63cc86cb3ebc None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:27.480339 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501fc5f-ab44-4273-83a5-63cc86cb3ebc None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:27.493646 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e2ab8-43b0-41e6-bf05-0543a1bf2727 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:27.494521 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-a97a14ee-fa4f-4774-812d-942641a7103e None None] MFA Rules not processed for user `a8d6c277fff9401e9f7bb24fef4df8d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:27.494785 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e2ab8-43b0-41e6-bf05-0543a1bf2727 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:27.494785 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e2ab8-43b0-41e6-bf05-0543a1bf2727 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:27.494994 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e2ab8-43b0-41e6-bf05-0543a1bf2727 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:27.498087 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-a97a14ee-fa4f-4774-812d-942641a7103e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:27.518425 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e2ab8-43b0-41e6-bf05-0543a1bf2727 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:27.523808 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e2ab8-43b0-41e6-bf05-0543a1bf2727 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:27.549074 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 803/1617] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:52:27.550074 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e2ab8-43b0-41e6-bf05-0543a1bf2727 service neutron] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:27.564396 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e2ab8-43b0-41e6-bf05-0543a1bf2727 service neutron] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:27.568725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50feee1d-1087-4611-a581-3b60d12139be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:27.569430 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50feee1d-1087-4611-a581-3b60d12139be service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:27.569713 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50feee1d-1087-4611-a581-3b60d12139be service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:27.570062 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50feee1d-1087-4611-a581-3b60d12139be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:27.581576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50feee1d-1087-4611-a581-3b60d12139be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:27.583081 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50feee1d-1087-4611-a581-3b60d12139be service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:27.596345 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 804/1618] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:52:27.597333 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50feee1d-1087-4611-a581-3b60d12139be service neutron] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:27.607921 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50feee1d-1087-4611-a581-3b60d12139be service neutron] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:27.621852 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8206bb-f049-4373-9e46-79eb0e02fea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:27.622536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8206bb-f049-4373-9e46-79eb0e02fea0 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:27.622819 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8206bb-f049-4373-9e46-79eb0e02fea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:27.623097 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8206bb-f049-4373-9e46-79eb0e02fea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:27.623823 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8206bb-f049-4373-9e46-79eb0e02fea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:27.627327 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8206bb-f049-4373-9e46-79eb0e02fea0 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:27.643444 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 815/1619] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:27.645620 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b353d1-9ddd-49a7-b053-5186d952d5ad None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:27.646096 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b353d1-9ddd-49a7-b053-5186d952d5ad None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:27.646478 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b353d1-9ddd-49a7-b053-5186d952d5ad None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:27.648615 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 816/1620] 10.222.0.39 () {54 vars in 962 bytes} [Tue Jul 26 04:52:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:52:27.649665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b353d1-9ddd-49a7-b053-5186d952d5ad None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:27.660660 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 805/1621] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:27.660660 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8206bb-f049-4373-9e46-79eb0e02fea0 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:27.666971 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b353d1-9ddd-49a7-b053-5186d952d5ad None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:27.675519 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf091b08-7c65-4875-8b76-577ac0122b0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:27.676583 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf091b08-7c65-4875-8b76-577ac0122b0e service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:27.676971 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf091b08-7c65-4875-8b76-577ac0122b0e service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:27.677387 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf091b08-7c65-4875-8b76-577ac0122b0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:27.693542 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8206bb-f049-4373-9e46-79eb0e02fea0 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:27.697207 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf091b08-7c65-4875-8b76-577ac0122b0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:27.699465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf091b08-7c65-4875-8b76-577ac0122b0e service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:27.704044 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9830f-01c8-4454-bfe4-3f5345596bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:27.705149 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9830f-01c8-4454-bfe4-3f5345596bf3 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:27.705433 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9830f-01c8-4454-bfe4-3f5345596bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:27.705935 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9830f-01c8-4454-bfe4-3f5345596bf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:27.707328 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9830f-01c8-4454-bfe4-3f5345596bf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:27.712555 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9830f-01c8-4454-bfe4-3f5345596bf3 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:27.726239 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 817/1622] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:52:27.728130 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09811b67-f5f8-42af-b233-93fbb7f174c5 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:27.729547 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09811b67-f5f8-42af-b233-93fbb7f174c5 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:27.729547 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09811b67-f5f8-42af-b233-93fbb7f174c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:27.800387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 806/1623] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:52:27 2022] POST /identity/v3/projects => generated 401 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:52:27.801080 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9830f-01c8-4454-bfe4-3f5345596bf3 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:27.843821 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-09811b67-f5f8-42af-b233-93fbb7f174c5 None None] MFA Rules not processed for user `ae8593e125da4b208dd100608aa2b462`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:27.845971 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-09811b67-f5f8-42af-b233-93fbb7f174c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:27.971818 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9830f-01c8-4454-bfe4-3f5345596bf3 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:27.979553 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6ee58-a7dc-49e6-9b60-618a9b84cee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:27.980803 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6ee58-a7dc-49e6-9b60-618a9b84cee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:27.981165 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6ee58-a7dc-49e6-9b60-618a9b84cee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:27.981672 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6ee58-a7dc-49e6-9b60-618a9b84cee8 admin admin] PATH_INFO: `/v3/projects/e6c67e4921334c30839adafcbafbf9e4/users/ec92337c5aa04990830d47ea92395ebf/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:27.984598 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6ee58-a7dc-49e6-9b60-618a9b84cee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6c67e4921334c30839adafcbafbf9e4, user_id=ec92337c5aa04990830d47ea92395ebf, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:27.987929 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6ee58-a7dc-49e6-9b60-618a9b84cee8 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:27.991122 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:28.014241 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 807/1624] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:52:27 2022] PUT /identity/v3/projects/e6c67e4921334c30839adafcbafbf9e4/users/ec92337c5aa04990830d47ea92395ebf/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:28.014241 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6ee58-a7dc-49e6-9b60-618a9b84cee8 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:28.029458 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 818/1625] 10.222.0.39 () {58 vars in 1059 bytes} [Tue Jul 26 04:52:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:28.030930 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6db0e-f55a-4d30-9ab0-137b7c337048 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:28.031224 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6db0e-f55a-4d30-9ab0-137b7c337048 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:28.031589 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6db0e-f55a-4d30-9ab0-137b7c337048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:28.100306 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-2fe6db0e-f55a-4d30-9ab0-137b7c337048 None None] MFA Rules not processed for user `ec92337c5aa04990830d47ea92395ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:28.101539 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-2fe6db0e-f55a-4d30-9ab0-137b7c337048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:28.123693 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:28.137900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6ee58-a7dc-49e6-9b60-618a9b84cee8 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:28.144626 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1496a93-4cf0-4e76-9ea0-3eb283a752b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:28.145744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1496a93-4cf0-4e76-9ea0-3eb283a752b6 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:28.146273 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1496a93-4cf0-4e76-9ea0-3eb283a752b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:28.146732 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1496a93-4cf0-4e76-9ea0-3eb283a752b6 admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:28.147761 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1496a93-4cf0-4e76-9ea0-3eb283a752b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:28.150305 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1496a93-4cf0-4e76-9ea0-3eb283a752b6 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:28.187902 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 808/1626] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:52:28 2022] POST /identity/v3/users => generated 307 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:52:28.189389 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1496a93-4cf0-4e76-9ea0-3eb283a752b6 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:28.317901 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1496a93-4cf0-4e76-9ea0-3eb283a752b6 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:28.332420 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f642c6-1e6e-4148-b2a1-ffa453df162c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:28.333431 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f642c6-1e6e-4148-b2a1-ffa453df162c service nova] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:28.333811 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f642c6-1e6e-4148-b2a1-ffa453df162c service nova] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:28.334254 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f642c6-1e6e-4148-b2a1-ffa453df162c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:28.368154 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 819/1627] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:28 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:28.368154 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6db0e-f55a-4d30-9ab0-137b7c337048 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:28.393361 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6db0e-f55a-4d30-9ab0-137b7c337048 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:28.415289 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf990963-74ee-4440-89c6-b51dad578d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:28.416382 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf990963-74ee-4440-89c6-b51dad578d22 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:28.416879 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf990963-74ee-4440-89c6-b51dad578d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:28.417379 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf990963-74ee-4440-89c6-b51dad578d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:28.418709 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f642c6-1e6e-4148-b2a1-ffa453df162c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:28.418839 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf990963-74ee-4440-89c6-b51dad578d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:28.421104 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f642c6-1e6e-4148-b2a1-ffa453df162c service nova] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:28.428086 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf990963-74ee-4440-89c6-b51dad578d22 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:28.441685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 809/1628] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:52:28.443803 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f642c6-1e6e-4148-b2a1-ffa453df162c service nova] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:28.478271 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 820/1629] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:28.482393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf990963-74ee-4440-89c6-b51dad578d22 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:28.515105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf990963-74ee-4440-89c6-b51dad578d22 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:28.529447 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f123f-917b-48af-84c3-37d8a8370815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:28.530581 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f123f-917b-48af-84c3-37d8a8370815 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:28.532248 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f123f-917b-48af-84c3-37d8a8370815 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:28.533757 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f123f-917b-48af-84c3-37d8a8370815 admin admin] PATH_INFO: `/v3/projects/08d20061f9a14109a14648db61d6850f/users/badde2aa7e314cb093fb3953b12cf499/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:28.659092 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f123f-917b-48af-84c3-37d8a8370815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08d20061f9a14109a14648db61d6850f, user_id=badde2aa7e314cb093fb3953b12cf499, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:28.659092 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f123f-917b-48af-84c3-37d8a8370815 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:28.673525 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f642c6-1e6e-4148-b2a1-ffa453df162c service nova] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:28.673525 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c1eaf-5d7c-46a3-8339-37cf42a1937b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:28.673525 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c1eaf-5d7c-46a3-8339-37cf42a1937b service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:28.673525 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c1eaf-5d7c-46a3-8339-37cf42a1937b service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:28.674771 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c1eaf-5d7c-46a3-8339-37cf42a1937b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:28.674771 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c1eaf-5d7c-46a3-8339-37cf42a1937b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:28.674771 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c1eaf-5d7c-46a3-8339-37cf42a1937b service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:28.674771 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 810/1630] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:28 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:52:28.684022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 821/1631] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:52:28 2022] PUT /identity/v3/projects/08d20061f9a14109a14648db61d6850f/users/badde2aa7e314cb093fb3953b12cf499/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:28.689583 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c1eaf-5d7c-46a3-8339-37cf42a1937b service cinder] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:28.721525 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c1eaf-5d7c-46a3-8339-37cf42a1937b service cinder] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:28.790195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:28.958529 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289996e6-c9fc-4298-8abc-0de183c49d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:28.959862 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289996e6-c9fc-4298-8abc-0de183c49d2d admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:28.960497 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289996e6-c9fc-4298-8abc-0de183c49d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:28.961129 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289996e6-c9fc-4298-8abc-0de183c49d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:28.962657 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289996e6-c9fc-4298-8abc-0de183c49d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:28.971480 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289996e6-c9fc-4298-8abc-0de183c49d2d admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:29.022341 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 811/1632] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:29.023986 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f123f-917b-48af-84c3-37d8a8370815 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:29.052625 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f123f-917b-48af-84c3-37d8a8370815 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:29.072025 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de2f46-1d07-4258-b3a1-77a5d7bbbf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:29.075362 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de2f46-1d07-4258-b3a1-77a5d7bbbf35 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:29.075941 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de2f46-1d07-4258-b3a1-77a5d7bbbf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:29.076527 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de2f46-1d07-4258-b3a1-77a5d7bbbf35 admin admin] PATH_INFO: `/v3/projects/08d20061f9a14109a14648db61d6850f/users/badde2aa7e314cb093fb3953b12cf499/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:29.086875 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de2f46-1d07-4258-b3a1-77a5d7bbbf35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08d20061f9a14109a14648db61d6850f, user_id=badde2aa7e314cb093fb3953b12cf499, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:29.093549 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de2f46-1d07-4258-b3a1-77a5d7bbbf35 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:29.098841 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e2ae3-f08f-44ae-a0ce-496cc5455e13 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:29.100223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e2ae3-f08f-44ae-a0ce-496cc5455e13 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:29.100875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e2ae3-f08f-44ae-a0ce-496cc5455e13 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:29.103963 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 812/1633] 10.222.0.39 () {54 vars in 912 bytes} [Tue Jul 26 04:52:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:52:29.112102 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572ca40-b175-4850-9a46-9942f042ccb6 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:29.112102 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572ca40-b175-4850-9a46-9942f042ccb6 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:29.112102 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572ca40-b175-4850-9a46-9942f042ccb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:29.115277 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 822/1634] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:52:29 2022] PUT /identity/v3/projects/08d20061f9a14109a14648db61d6850f/users/badde2aa7e314cb093fb3953b12cf499/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:29.136230 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-7572ca40-b175-4850-9a46-9942f042ccb6 None None] MFA Rules not processed for user `ae8593e125da4b208dd100608aa2b462`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:29.136716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c3184-319c-4714-bb95-899c4252e972 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:29.137225 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c3184-319c-4714-bb95-899c4252e972 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:29.137738 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-7572ca40-b175-4850-9a46-9942f042ccb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:29.138283 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c3184-319c-4714-bb95-899c4252e972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:29.183381 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-461c3184-319c-4714-bb95-899c4252e972 None None] MFA Rules not processed for user `badde2aa7e314cb093fb3953b12cf499`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:29.186158 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-461c3184-319c-4714-bb95-899c4252e972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:29.313016 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 823/1635] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:29 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:29.345300 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c3184-319c-4714-bb95-899c4252e972 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:29.353195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 813/1636] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Jul 26 04:52:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:29.409546 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:29.430995 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572ca40-b175-4850-9a46-9942f042ccb6 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:29.535678 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c3184-319c-4714-bb95-899c4252e972 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:29.549848 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1bfda-817e-4519-81af-fd97d714f4d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:29.550168 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1bfda-817e-4519-81af-fd97d714f4d9 service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:29.550355 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1bfda-817e-4519-81af-fd97d714f4d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:29.550716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d1bfda-817e-4519-81af-fd97d714f4d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:29.562264 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572ca40-b175-4850-9a46-9942f042ccb6 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:29.571851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eecdc9-4fc2-4404-a980-34a6e60c3b16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:29.572518 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eecdc9-4fc2-4404-a980-34a6e60c3b16 service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:29.572796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eecdc9-4fc2-4404-a980-34a6e60c3b16 service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:29.573093 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eecdc9-4fc2-4404-a980-34a6e60c3b16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:29.583097 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1bfda-817e-4519-81af-fd97d714f4d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:29.585925 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d1bfda-817e-4519-81af-fd97d714f4d9 service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:29.606648 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eecdc9-4fc2-4404-a980-34a6e60c3b16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:29.609016 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eecdc9-4fc2-4404-a980-34a6e60c3b16 service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:29.611519 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 824/1637] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:29 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:52:29.639973 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 814/1638] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:52:29.953367 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1bfda-817e-4519-81af-fd97d714f4d9 service cinder] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:29.966662 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d1bfda-817e-4519-81af-fd97d714f4d9 service cinder] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:29.979970 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcaff44-3b82-4f1b-9938-2580ca43a8e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:29.979970 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcaff44-3b82-4f1b-9938-2580ca43a8e5 service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:29.979970 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcaff44-3b82-4f1b-9938-2580ca43a8e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:29.979970 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcaff44-3b82-4f1b-9938-2580ca43a8e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:30.098726 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcaff44-3b82-4f1b-9938-2580ca43a8e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:30.102276 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcaff44-3b82-4f1b-9938-2580ca43a8e5 service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:30.127994 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 825/1639] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:29 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:52:31.467401 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eecdc9-4fc2-4404-a980-34a6e60c3b16 service cinder] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:31.750629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6e798-52b5-4b13-bb53-b884abcf595c None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:31.751603 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6e798-52b5-4b13-bb53-b884abcf595c None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:31.751603 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6e798-52b5-4b13-bb53-b884abcf595c None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:31.753372 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 826/1640] 10.222.0.39 () {54 vars in 962 bytes} [Tue Jul 26 04:52:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:52:31.764478 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee10fa-fb5f-4b74-a9ad-2dcd0fac9e19 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:31.765697 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee10fa-fb5f-4b74-a9ad-2dcd0fac9e19 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:31.768750 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee10fa-fb5f-4b74-a9ad-2dcd0fac9e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:31.835488 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:31.850237 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-23ee10fa-fb5f-4b74-a9ad-2dcd0fac9e19 None None] MFA Rules not processed for user `ae8593e125da4b208dd100608aa2b462`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:31.851938 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-23ee10fa-fb5f-4b74-a9ad-2dcd0fac9e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:31.896274 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eecdc9-4fc2-4404-a980-34a6e60c3b16 service cinder] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:31.910118 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 827/1641] 10.222.0.39 () {58 vars in 1059 bytes} [Tue Jul 26 04:52:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:31.912772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c26b31-be6f-426b-9a53-44d2b7b43738 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:31.917582 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787250c-a26f-4fc1-a387-8cba0d9f7345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:31.918999 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787250c-a26f-4fc1-a387-8cba0d9f7345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:31.919206 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787250c-a26f-4fc1-a387-8cba0d9f7345 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:31.919401 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787250c-a26f-4fc1-a387-8cba0d9f7345 admin admin] PATH_INFO: `/v3/users/6958f2c24b3a4bc3922ab7cd7f5bce50` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:31.921776 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787250c-a26f-4fc1-a387-8cba0d9f7345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6958f2c24b3a4bc3922ab7cd7f5bce50)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:31.923067 dv-cinder-850574-1-smb devstack@keystone.service[86745]: WARNING py.warnings [None req-5787250c-a26f-4fc1-a387-8cba0d9f7345 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:52:31.923067 dv-cinder-850574-1-smb devstack@keystone.service[86745]: warnings.warn(msg) Jul 26 04:52:31.923067 dv-cinder-850574-1-smb devstack@keystone.service[86745]: Jul 26 04:52:31.924512 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787250c-a26f-4fc1-a387-8cba0d9f7345 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:31.926692 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c26b31-be6f-426b-9a53-44d2b7b43738 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:31.927205 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c26b31-be6f-426b-9a53-44d2b7b43738 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:31.930038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 828/1642] 10.222.0.39 () {54 vars in 912 bytes} [Tue Jul 26 04:52:31 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:52:31.942182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a7e78-831f-449d-8af0-10d9ea86e57d None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:31.943177 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a7e78-831f-449d-8af0-10d9ea86e57d None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:31.943964 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3a7e78-831f-449d-8af0-10d9ea86e57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:32.002805 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-df3a7e78-831f-449d-8af0-10d9ea86e57d None None] MFA Rules not processed for user `ae8593e125da4b208dd100608aa2b462`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:32.008037 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-df3a7e78-831f-449d-8af0-10d9ea86e57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:32.042380 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 829/1643] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Jul 26 04:52:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:32.050779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a7e78-831f-449d-8af0-10d9ea86e57d None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:32.070858 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3a7e78-831f-449d-8af0-10d9ea86e57d None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:32.084445 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80899f64-5def-4eeb-b577-be9feaa6a65c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:32.091366 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80899f64-5def-4eeb-b577-be9feaa6a65c service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:32.091660 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80899f64-5def-4eeb-b577-be9feaa6a65c service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:32.091950 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80899f64-5def-4eeb-b577-be9feaa6a65c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:32.100064 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-5787250c-a26f-4fc1-a387-8cba0d9f7345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6958f2c24b3a4bc3922ab7cd7f5bce50'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:32.130925 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-5787250c-a26f-4fc1-a387-8cba0d9f7345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6958f2c24b3a4bc3922ab7cd7f5bce50'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:32.145436 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80899f64-5def-4eeb-b577-be9feaa6a65c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:32.146957 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80899f64-5def-4eeb-b577-be9feaa6a65c service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:32.187650 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 830/1644] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:52:32.194835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-5787250c-a26f-4fc1-a387-8cba0d9f7345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6958f2c24b3a4bc3922ab7cd7f5bce50'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:32.225057 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-5787250c-a26f-4fc1-a387-8cba0d9f7345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6958f2c24b3a4bc3922ab7cd7f5bce50'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:32.226791 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-5787250c-a26f-4fc1-a387-8cba0d9f7345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6958f2c24b3a4bc3922ab7cd7f5bce50'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:32.241811 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 815/1645] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:52:31 2022] DELETE /identity/v3/users/6958f2c24b3a4bc3922ab7cd7f5bce50 => generated 0 bytes in 775 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:52:32.249809 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a1979-493f-423f-8dc0-c2e38a83f060 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:32.250289 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a1979-493f-423f-8dc0-c2e38a83f060 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:32.250878 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a1979-493f-423f-8dc0-c2e38a83f060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:32.318304 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-c03a1979-493f-423f-8dc0-c2e38a83f060 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:32.320858 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-c03a1979-493f-423f-8dc0-c2e38a83f060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:32.560439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 831/1646] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:32.594493 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787250c-a26f-4fc1-a387-8cba0d9f7345 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:32.597088 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-5787250c-a26f-4fc1-a387-8cba0d9f7345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:32.931340 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787250c-a26f-4fc1-a387-8cba0d9f7345 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:32.951556 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdfbd8e-e0a8-4ceb-af39-4be701e0bf4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:32.951972 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdfbd8e-e0a8-4ceb-af39-4be701e0bf4b service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:32.953206 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdfbd8e-e0a8-4ceb-af39-4be701e0bf4b service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:32.954537 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdfbd8e-e0a8-4ceb-af39-4be701e0bf4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:32.980936 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdfbd8e-e0a8-4ceb-af39-4be701e0bf4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:32.986084 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdfbd8e-e0a8-4ceb-af39-4be701e0bf4b service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:33.025214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 816/1647] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:52:33.921390 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a1979-493f-423f-8dc0-c2e38a83f060 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:33.923969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-c03a1979-493f-423f-8dc0-c2e38a83f060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:33.954597 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a1979-493f-423f-8dc0-c2e38a83f060 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:33.967144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e04a3-f532-4e07-8a25-9efd66683614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:33.968260 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e04a3-f532-4e07-8a25-9efd66683614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:33.968796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e04a3-f532-4e07-8a25-9efd66683614 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:33.969323 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e04a3-f532-4e07-8a25-9efd66683614 admin admin] PATH_INFO: `/v3/users/3af1ef0042a549838d12e154f6c4e486` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:33.971982 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e04a3-f532-4e07-8a25-9efd66683614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3af1ef0042a549838d12e154f6c4e486)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:33.980357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e04a3-f532-4e07-8a25-9efd66683614 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:34.047819 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:34.126342 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-4a8e04a3-f532-4e07-8a25-9efd66683614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3af1ef0042a549838d12e154f6c4e486'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:34.127196 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-4a8e04a3-f532-4e07-8a25-9efd66683614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3af1ef0042a549838d12e154f6c4e486'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:34.144610 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-4a8e04a3-f532-4e07-8a25-9efd66683614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3af1ef0042a549838d12e154f6c4e486'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:34.175318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-4a8e04a3-f532-4e07-8a25-9efd66683614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3af1ef0042a549838d12e154f6c4e486'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:34.193476 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-4a8e04a3-f532-4e07-8a25-9efd66683614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3af1ef0042a549838d12e154f6c4e486'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:34.206561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 832/1648] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:52:33 2022] DELETE /identity/v3/users/3af1ef0042a549838d12e154f6c4e486 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:34.208439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3d09c-783d-42c0-b312-98801877e929 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:34.208966 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3d09c-783d-42c0-b312-98801877e929 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:34.208966 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3d09c-783d-42c0-b312-98801877e929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:34.246319 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-8aa3d09c-783d-42c0-b312-98801877e929 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:34.248794 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-8aa3d09c-783d-42c0-b312-98801877e929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:34.428933 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 817/1649] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:34.451918 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e04a3-f532-4e07-8a25-9efd66683614 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:34.453019 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-4a8e04a3-f532-4e07-8a25-9efd66683614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:34.582251 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e04a3-f532-4e07-8a25-9efd66683614 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:34.596299 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4e1ca-5133-4d02-98d4-e200d87d3583 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:34.597473 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4e1ca-5133-4d02-98d4-e200d87d3583 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:34.597874 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4e1ca-5133-4d02-98d4-e200d87d3583 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:34.598329 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4e1ca-5133-4d02-98d4-e200d87d3583 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:34.645159 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c4e1ca-5133-4d02-98d4-e200d87d3583 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:34.647506 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c4e1ca-5133-4d02-98d4-e200d87d3583 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:34.671040 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 833/1650] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:52:34.805106 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3d09c-783d-42c0-b312-98801877e929 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:34.808718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-8aa3d09c-783d-42c0-b312-98801877e929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:34.865933 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3d09c-783d-42c0-b312-98801877e929 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:34.893743 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2dec1b-9451-43f3-ba6b-bb9c7def1a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:34.896336 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dec1b-9451-43f3-ba6b-bb9c7def1a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:34.898401 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dec1b-9451-43f3-ba6b-bb9c7def1a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:34.898994 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dec1b-9451-43f3-ba6b-bb9c7def1a99 admin admin] PATH_INFO: `/v3/projects/21d4466182cc431eae80a789d966178b` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:34.904493 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2dec1b-9451-43f3-ba6b-bb9c7def1a99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21d4466182cc431eae80a789d966178b)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:34.915341 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2dec1b-9451-43f3-ba6b-bb9c7def1a99 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:34.955401 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:35.056725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8e2dec1b-9451-43f3-ba6b-bb9c7def1a99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21d4466182cc431eae80a789d966178b', 'request_id': 'req-8e2dec1b-9451-43f3-ba6b-bb9c7def1a99'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:35.080677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8e2dec1b-9451-43f3-ba6b-bb9c7def1a99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21d4466182cc431eae80a789d966178b', 'request_id': 'req-8e2dec1b-9451-43f3-ba6b-bb9c7def1a99'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:35.096764 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8e2dec1b-9451-43f3-ba6b-bb9c7def1a99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21d4466182cc431eae80a789d966178b', 'request_id': 'req-8e2dec1b-9451-43f3-ba6b-bb9c7def1a99'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:35.123944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8e2dec1b-9451-43f3-ba6b-bb9c7def1a99 admin admin] The token cache is being invalidate because project 21d4466182cc431eae80a789d966178b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:52:35.124521 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8e2dec1b-9451-43f3-ba6b-bb9c7def1a99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:35.125752 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8e2dec1b-9451-43f3-ba6b-bb9c7def1a99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:35.129718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 818/1651] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:52:34 2022] DELETE /identity/v3/projects/21d4466182cc431eae80a789d966178b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:35.146018 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4e1ca-5133-4d02-98d4-e200d87d3583 service neutron] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:35.154639 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4e1ca-5133-4d02-98d4-e200d87d3583 service neutron] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:35.338568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8bfce-6cf3-4eec-9dda-4b23854c0287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:35.341490 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8bfce-6cf3-4eec-9dda-4b23854c0287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:35.341906 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8bfce-6cf3-4eec-9dda-4b23854c0287 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:35.342321 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8bfce-6cf3-4eec-9dda-4b23854c0287 admin admin] PATH_INFO: `/v3/users/ec92337c5aa04990830d47ea92395ebf` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:35.344077 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8bfce-6cf3-4eec-9dda-4b23854c0287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec92337c5aa04990830d47ea92395ebf)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:35.348990 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8bfce-6cf3-4eec-9dda-4b23854c0287 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:35.428789 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:35.436849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-4de8bfce-6cf3-4eec-9dda-4b23854c0287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec92337c5aa04990830d47ea92395ebf'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:35.438382 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-4de8bfce-6cf3-4eec-9dda-4b23854c0287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec92337c5aa04990830d47ea92395ebf'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:35.457309 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-4de8bfce-6cf3-4eec-9dda-4b23854c0287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec92337c5aa04990830d47ea92395ebf'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:35.495185 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-4de8bfce-6cf3-4eec-9dda-4b23854c0287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec92337c5aa04990830d47ea92395ebf'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:35.503921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-4de8bfce-6cf3-4eec-9dda-4b23854c0287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec92337c5aa04990830d47ea92395ebf'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:35.517292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 834/1652] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:52:35 2022] DELETE /identity/v3/users/ec92337c5aa04990830d47ea92395ebf => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:36.357193 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2dec1b-9451-43f3-ba6b-bb9c7def1a99 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:36.359539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-8e2dec1b-9451-43f3-ba6b-bb9c7def1a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:36.389744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2dec1b-9451-43f3-ba6b-bb9c7def1a99 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:36.543197 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d87b4-7e5d-4e3c-9ab3-b1bbf062842b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:36.543862 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d87b4-7e5d-4e3c-9ab3-b1bbf062842b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:36.544146 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d87b4-7e5d-4e3c-9ab3-b1bbf062842b admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:36.544419 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d87b4-7e5d-4e3c-9ab3-b1bbf062842b admin admin] PATH_INFO: `/v3/projects/29b4d2eba89247e7a2c23c4f652de15a` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:36.546378 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d87b4-7e5d-4e3c-9ab3-b1bbf062842b admin admin] RBAC: Authorizing `identity:delete_project(project_id=29b4d2eba89247e7a2c23c4f652de15a)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:36.548460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d87b4-7e5d-4e3c-9ab3-b1bbf062842b admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:36.679252 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f29d87b4-7e5d-4e3c-9ab3-b1bbf062842b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29b4d2eba89247e7a2c23c4f652de15a', 'request_id': 'req-f29d87b4-7e5d-4e3c-9ab3-b1bbf062842b'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:36.697669 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f29d87b4-7e5d-4e3c-9ab3-b1bbf062842b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29b4d2eba89247e7a2c23c4f652de15a', 'request_id': 'req-f29d87b4-7e5d-4e3c-9ab3-b1bbf062842b'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:36.714743 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f29d87b4-7e5d-4e3c-9ab3-b1bbf062842b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29b4d2eba89247e7a2c23c4f652de15a', 'request_id': 'req-f29d87b4-7e5d-4e3c-9ab3-b1bbf062842b'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:36.746295 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f29d87b4-7e5d-4e3c-9ab3-b1bbf062842b admin admin] The token cache is being invalidate because project 29b4d2eba89247e7a2c23c4f652de15a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:52:36.746420 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f29d87b4-7e5d-4e3c-9ab3-b1bbf062842b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:36.747098 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f29d87b4-7e5d-4e3c-9ab3-b1bbf062842b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:36.752550 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 819/1653] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:52:36 2022] DELETE /identity/v3/projects/29b4d2eba89247e7a2c23c4f652de15a => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:36.754158 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49490a8-7cc9-499a-b3d0-876b9f76b35e None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:36.755056 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49490a8-7cc9-499a-b3d0-876b9f76b35e None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:36.755539 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49490a8-7cc9-499a-b3d0-876b9f76b35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:36.803761 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-e49490a8-7cc9-499a-b3d0-876b9f76b35e None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:36.808911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-e49490a8-7cc9-499a-b3d0-876b9f76b35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:36.845432 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99278532-a138-4d0f-b85a-e0fbbfe1dc42 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:36.845432 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99278532-a138-4d0f-b85a-e0fbbfe1dc42 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:36.845432 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99278532-a138-4d0f-b85a-e0fbbfe1dc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:36.938530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-99278532-a138-4d0f-b85a-e0fbbfe1dc42 None None] MFA Rules not processed for user `c3274391c65b4eeab0fcf22ca4f8b791`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:36.940032 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-99278532-a138-4d0f-b85a-e0fbbfe1dc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:36.976790 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:37.005830 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 835/1654] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:52:37.014235 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2a111-5438-4dd7-8d8f-c706e1916406 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:37.014883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2a111-5438-4dd7-8d8f-c706e1916406 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:37.015314 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2a111-5438-4dd7-8d8f-c706e1916406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:37.071414 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-43e2a111-5438-4dd7-8d8f-c706e1916406 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:37.074636 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-43e2a111-5438-4dd7-8d8f-c706e1916406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:37.098032 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 820/1655] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:37.104685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99278532-a138-4d0f-b85a-e0fbbfe1dc42 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:37.107414 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-99278532-a138-4d0f-b85a-e0fbbfe1dc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:37.111187 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 836/1656] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:37.115837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2a111-5438-4dd7-8d8f-c706e1916406 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:37.127250 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-43e2a111-5438-4dd7-8d8f-c706e1916406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:37.164106 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99278532-a138-4d0f-b85a-e0fbbfe1dc42 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:37.170417 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5572aab-300e-459d-8672-cbbc8928dd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:37.171113 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5572aab-300e-459d-8672-cbbc8928dd0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:37.171471 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5572aab-300e-459d-8672-cbbc8928dd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:37.171832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5572aab-300e-459d-8672-cbbc8928dd0d admin admin] PATH_INFO: `/v3/users/a8d6c277fff9401e9f7bb24fef4df8d6` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:37.173321 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5572aab-300e-459d-8672-cbbc8928dd0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8d6c277fff9401e9f7bb24fef4df8d6)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:37.175678 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5572aab-300e-459d-8672-cbbc8928dd0d admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:37.371164 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2a111-5438-4dd7-8d8f-c706e1916406 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:37.378208 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-c5572aab-300e-459d-8672-cbbc8928dd0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8d6c277fff9401e9f7bb24fef4df8d6'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:37.387517 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a6b1b-76ce-47fa-baf7-36adc9764547 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:37.391824 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a6b1b-76ce-47fa-baf7-36adc9764547 service nova] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:37.393794 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a6b1b-76ce-47fa-baf7-36adc9764547 service nova] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:37.394311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a6b1b-76ce-47fa-baf7-36adc9764547 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:37.401742 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-c5572aab-300e-459d-8672-cbbc8928dd0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8d6c277fff9401e9f7bb24fef4df8d6'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:37.428547 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a6b1b-76ce-47fa-baf7-36adc9764547 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:37.437374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a6b1b-76ce-47fa-baf7-36adc9764547 service nova] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:37.457624 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-c5572aab-300e-459d-8672-cbbc8928dd0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8d6c277fff9401e9f7bb24fef4df8d6'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:37.470633 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 837/1657] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:52:37.472284 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a6b1b-76ce-47fa-baf7-36adc9764547 service nova] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:37.519854 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a6b1b-76ce-47fa-baf7-36adc9764547 service nova] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:37.529006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a59de8-6d99-42eb-9740-528ad734555d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:37.530749 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a59de8-6d99-42eb-9740-528ad734555d admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:37.533549 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-c5572aab-300e-459d-8672-cbbc8928dd0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8d6c277fff9401e9f7bb24fef4df8d6'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:37.541014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a59de8-6d99-42eb-9740-528ad734555d admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:37.541861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a59de8-6d99-42eb-9740-528ad734555d admin admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:37.542721 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-c5572aab-300e-459d-8672-cbbc8928dd0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8d6c277fff9401e9f7bb24fef4df8d6'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:37.543851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a59de8-6d99-42eb-9740-528ad734555d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:52:37.544858 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a59de8-6d99-42eb-9740-528ad734555d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:37.548668 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a59de8-6d99-42eb-9740-528ad734555d admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:37.574703 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 838/1658] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:52:37.579325 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a59de8-6d99-42eb-9740-528ad734555d admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:37.583015 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 821/1659] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:52:37 2022] DELETE /identity/v3/users/a8d6c277fff9401e9f7bb24fef4df8d6 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:37.585273 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fa141-bb27-45c2-aaf3-e852bf8ff612 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:37.585561 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fa141-bb27-45c2-aaf3-e852bf8ff612 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:37.585824 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fa141-bb27-45c2-aaf3-e852bf8ff612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:37.586875 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-55a59de8-6d99-42eb-9740-528ad734555d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:37.605780 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a59de8-6d99-42eb-9740-528ad734555d admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:37.652671 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-9d3fa141-bb27-45c2-aaf3-e852bf8ff612 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:37.654216 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-9d3fa141-bb27-45c2-aaf3-e852bf8ff612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:37.748707 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:37.802497 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 822/1660] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:37.847803 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fa141-bb27-45c2-aaf3-e852bf8ff612 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:37.849753 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-9d3fa141-bb27-45c2-aaf3-e852bf8ff612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:37.888119 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d7e36-dc3a-4edb-8593-042c45bbbfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:37.889305 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d7e36-dc3a-4edb-8593-042c45bbbfe7 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:37.889738 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d7e36-dc3a-4edb-8593-042c45bbbfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:37.890202 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d7e36-dc3a-4edb-8593-042c45bbbfe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:37.891070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d7e36-dc3a-4edb-8593-042c45bbbfe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:37.893532 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d7e36-dc3a-4edb-8593-042c45bbbfe7 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:37.953897 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 839/1661] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:52:37 2022] POST /identity/v3/projects => generated 403 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:52:37.955536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:37.957253 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d7e36-dc3a-4edb-8593-042c45bbbfe7 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:38.034692 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fa141-bb27-45c2-aaf3-e852bf8ff612 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:38.169334 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fda8cf-b2a5-429c-9811-d2a5877d2dea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:38.170019 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fda8cf-b2a5-429c-9811-d2a5877d2dea service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:38.170310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fda8cf-b2a5-429c-9811-d2a5877d2dea service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:38.170588 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fda8cf-b2a5-429c-9811-d2a5877d2dea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:38.197714 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fda8cf-b2a5-429c-9811-d2a5877d2dea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:38.199675 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fda8cf-b2a5-429c-9811-d2a5877d2dea service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:38.211877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d7e36-dc3a-4edb-8593-042c45bbbfe7 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:38.226166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 823/1662] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:52:38.228289 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140bb911-28c1-4c65-ba8f-77dd801b9aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:38.230297 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bb911-28c1-4c65-ba8f-77dd801b9aab admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:38.230843 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bb911-28c1-4c65-ba8f-77dd801b9aab admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:38.233199 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bb911-28c1-4c65-ba8f-77dd801b9aab admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:38.234681 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140bb911-28c1-4c65-ba8f-77dd801b9aab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:38.238528 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140bb911-28c1-4c65-ba8f-77dd801b9aab admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:38.326290 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 840/1663] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:52:37 2022] POST /identity/v3/users => generated 302 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:52:38.330276 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fda8cf-b2a5-429c-9811-d2a5877d2dea service neutron] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:38.346480 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fda8cf-b2a5-429c-9811-d2a5877d2dea service neutron] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:38.352469 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7749c-dc8e-4ba6-88cb-22dc067235e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:38.353614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7749c-dc8e-4ba6-88cb-22dc067235e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:38.353898 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7749c-dc8e-4ba6-88cb-22dc067235e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:38.354220 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7749c-dc8e-4ba6-88cb-22dc067235e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:38.355566 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d7749c-dc8e-4ba6-88cb-22dc067235e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:38.357486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d7749c-dc8e-4ba6-88cb-22dc067235e6 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:38.371787 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 824/1664] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:52:38.377072 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140bb911-28c1-4c65-ba8f-77dd801b9aab admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:38.391296 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7749c-dc8e-4ba6-88cb-22dc067235e6 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:38.398117 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-f1d7749c-dc8e-4ba6-88cb-22dc067235e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:38.429741 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140bb911-28c1-4c65-ba8f-77dd801b9aab admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:38.441104 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705e132-caed-4602-b887-f0332d7c44ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:38.441895 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705e132-caed-4602-b887-f0332d7c44ab admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:38.442144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705e132-caed-4602-b887-f0332d7c44ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:38.442471 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705e132-caed-4602-b887-f0332d7c44ab admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:38.444734 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705e132-caed-4602-b887-f0332d7c44ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:38.447261 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705e132-caed-4602-b887-f0332d7c44ab admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:38.462593 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7749c-dc8e-4ba6-88cb-22dc067235e6 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:38.468252 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 841/1665] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:38.472500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705e132-caed-4602-b887-f0332d7c44ab admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:38.481698 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f5ff4-6e49-4d8b-81c1-2db0d01530a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:38.483841 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f5ff4-6e49-4d8b-81c1-2db0d01530a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:38.484341 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f5ff4-6e49-4d8b-81c1-2db0d01530a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:38.484936 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f5ff4-6e49-4d8b-81c1-2db0d01530a0 admin admin] PATH_INFO: `/v3/projects/e6c67e4921334c30839adafcbafbf9e4` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:38.487962 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f5ff4-6e49-4d8b-81c1-2db0d01530a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6c67e4921334c30839adafcbafbf9e4)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:38.491126 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f5ff4-6e49-4d8b-81c1-2db0d01530a0 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:38.492593 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705e132-caed-4602-b887-f0332d7c44ab admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:38.501741 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b78af-f0a9-422a-83d2-2509fca73286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:38.502940 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b78af-f0a9-422a-83d2-2509fca73286 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:38.503380 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b78af-f0a9-422a-83d2-2509fca73286 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:38.504255 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b78af-f0a9-422a-83d2-2509fca73286 admin admin] PATH_INFO: `/v3/projects/565895c180164f90b84cf2bf98569c5b/users/3d222376c8fe4b45ab0f4a089d409671/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:38.541170 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b78af-f0a9-422a-83d2-2509fca73286 admin admin] RBAC: Authorizing `identity:create_grant(project_id=565895c180164f90b84cf2bf98569c5b, user_id=3d222376c8fe4b45ab0f4a089d409671, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:38.545894 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b78af-f0a9-422a-83d2-2509fca73286 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:38.584287 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 842/1666] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:52:38 2022] PUT /identity/v3/projects/565895c180164f90b84cf2bf98569c5b/users/3d222376c8fe4b45ab0f4a089d409671/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:38.589366 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69516440-b367-40f3-8662-76a256d64f29 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:38.592294 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69516440-b367-40f3-8662-76a256d64f29 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:38.593721 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69516440-b367-40f3-8662-76a256d64f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:38.601019 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2a3f5ff4-6e49-4d8b-81c1-2db0d01530a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6c67e4921334c30839adafcbafbf9e4', 'request_id': 'req-2a3f5ff4-6e49-4d8b-81c1-2db0d01530a0'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:38.618932 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2a3f5ff4-6e49-4d8b-81c1-2db0d01530a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6c67e4921334c30839adafcbafbf9e4', 'request_id': 'req-2a3f5ff4-6e49-4d8b-81c1-2db0d01530a0'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:38.631818 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2a3f5ff4-6e49-4d8b-81c1-2db0d01530a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6c67e4921334c30839adafcbafbf9e4', 'request_id': 'req-2a3f5ff4-6e49-4d8b-81c1-2db0d01530a0'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:38.647864 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-69516440-b367-40f3-8662-76a256d64f29 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:38.651870 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-69516440-b367-40f3-8662-76a256d64f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:38.663158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2a3f5ff4-6e49-4d8b-81c1-2db0d01530a0 admin admin] The token cache is being invalidate because project e6c67e4921334c30839adafcbafbf9e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:52:38.664903 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2a3f5ff4-6e49-4d8b-81c1-2db0d01530a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:38.674652 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2a3f5ff4-6e49-4d8b-81c1-2db0d01530a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:38.683616 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 825/1667] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:52:38 2022] DELETE /identity/v3/projects/e6c67e4921334c30839adafcbafbf9e4 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:38.685430 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8df924-3602-4a38-b7e5-fd532752757b None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:38.685935 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8df924-3602-4a38-b7e5-fd532752757b None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:38.686424 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8df924-3602-4a38-b7e5-fd532752757b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:38.712140 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-0c8df924-3602-4a38-b7e5-fd532752757b None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:38.713773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-0c8df924-3602-4a38-b7e5-fd532752757b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:38.883028 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 843/1668] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:38.933860 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 826/1669] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:38.938039 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500b6e9-400f-48c3-a765-7f842de52fa6 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:38.938344 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500b6e9-400f-48c3-a765-7f842de52fa6 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:38.938619 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500b6e9-400f-48c3-a765-7f842de52fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:38.939095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69516440-b367-40f3-8662-76a256d64f29 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:38.941612 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-69516440-b367-40f3-8662-76a256d64f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:38.952500 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:38.981077 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-2500b6e9-400f-48c3-a765-7f842de52fa6 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:38.982456 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-2500b6e9-400f-48c3-a765-7f842de52fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:39.001542 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:39.002188 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 827/1670] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:39.006746 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500b6e9-400f-48c3-a765-7f842de52fa6 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:39.032768 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500b6e9-400f-48c3-a765-7f842de52fa6 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:39.050508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85785ff-7592-4fa4-a7bb-4dd57575e099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:39.051172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85785ff-7592-4fa4-a7bb-4dd57575e099 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:39.051443 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85785ff-7592-4fa4-a7bb-4dd57575e099 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:39.051715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85785ff-7592-4fa4-a7bb-4dd57575e099 admin admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:39.052431 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85785ff-7592-4fa4-a7bb-4dd57575e099 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:52:39.052735 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85785ff-7592-4fa4-a7bb-4dd57575e099 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:39.054500 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85785ff-7592-4fa4-a7bb-4dd57575e099 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:39.097331 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 828/1671] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:52:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:52:39.099047 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85785ff-7592-4fa4-a7bb-4dd57575e099 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:39.118195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85785ff-7592-4fa4-a7bb-4dd57575e099 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:39.134183 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720304f-c8cc-4973-b735-24cfe02b0d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:39.134845 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720304f-c8cc-4973-b735-24cfe02b0d96 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:39.135119 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720304f-c8cc-4973-b735-24cfe02b0d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:39.135384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720304f-c8cc-4973-b735-24cfe02b0d96 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:39.139018 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720304f-c8cc-4973-b735-24cfe02b0d96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:39.139018 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720304f-c8cc-4973-b735-24cfe02b0d96 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:39.218966 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69516440-b367-40f3-8662-76a256d64f29 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:39.223806 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 829/1672] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:52:39 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:52:39.226059 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720304f-c8cc-4973-b735-24cfe02b0d96 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:39.409000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720304f-c8cc-4973-b735-24cfe02b0d96 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:39.423116 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e2078-b962-4e8f-94a9-d5c716f69a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:39.424375 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e2078-b962-4e8f-94a9-d5c716f69a43 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:39.424375 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e2078-b962-4e8f-94a9-d5c716f69a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:39.424375 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e2078-b962-4e8f-94a9-d5c716f69a43 admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:39.425002 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e2078-b962-4e8f-94a9-d5c716f69a43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:39.427550 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e2078-b962-4e8f-94a9-d5c716f69a43 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:39.450064 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd19612-1779-4c8f-9939-d6fa66f494e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:39.453476 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd19612-1779-4c8f-9939-d6fa66f494e2 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:39.453944 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd19612-1779-4c8f-9939-d6fa66f494e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:39.454464 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd19612-1779-4c8f-9939-d6fa66f494e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:39.474886 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 830/1673] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:52:39 2022] POST /identity/v3/users => generated 294 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:52:39.482376 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e2078-b962-4e8f-94a9-d5c716f69a43 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:39.492781 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd19612-1779-4c8f-9939-d6fa66f494e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:39.493001 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-c25e2078-b962-4e8f-94a9-d5c716f69a43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:39.494654 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd19612-1779-4c8f-9939-d6fa66f494e2 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:39.510082 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 844/1674] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:52:39.510082 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd19612-1779-4c8f-9939-d6fa66f494e2 service neutron] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:39.526187 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd19612-1779-4c8f-9939-d6fa66f494e2 service neutron] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:39.531819 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485989a0-c154-49e3-b6ed-8477542d4b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:39.532618 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485989a0-c154-49e3-b6ed-8477542d4b66 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:39.533323 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485989a0-c154-49e3-b6ed-8477542d4b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:39.533931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485989a0-c154-49e3-b6ed-8477542d4b66 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:39.534881 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485989a0-c154-49e3-b6ed-8477542d4b66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:39.537094 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485989a0-c154-49e3-b6ed-8477542d4b66 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:39.543661 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e2078-b962-4e8f-94a9-d5c716f69a43 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:39.554926 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebc796-a951-41e9-ae49-d3bbe31b243f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:39.555625 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebc796-a951-41e9-ae49-d3bbe31b243f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:39.556173 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebc796-a951-41e9-ae49-d3bbe31b243f admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:39.556173 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebc796-a951-41e9-ae49-d3bbe31b243f admin admin] PATH_INFO: `/v3/projects/ed53fe542f8142cbb3d77588e7a75ff1` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:39.557507 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ebc796-a951-41e9-ae49-d3bbe31b243f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed53fe542f8142cbb3d77588e7a75ff1)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:39.559671 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ebc796-a951-41e9-ae49-d3bbe31b243f admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:39.566685 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 845/1675] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:39.567895 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485989a0-c154-49e3-b6ed-8477542d4b66 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:39.581932 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485989a0-c154-49e3-b6ed-8477542d4b66 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:39.625211 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce73d04-824e-4ff3-9748-cdbc4435e384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:39.625950 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce73d04-824e-4ff3-9748-cdbc4435e384 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:39.626361 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce73d04-824e-4ff3-9748-cdbc4435e384 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:39.626541 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce73d04-824e-4ff3-9748-cdbc4435e384 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:39.627933 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce73d04-824e-4ff3-9748-cdbc4435e384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:39.629882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce73d04-824e-4ff3-9748-cdbc4435e384 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:39.651988 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 846/1676] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:39.652983 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce73d04-824e-4ff3-9748-cdbc4435e384 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:39.678699 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce73d04-824e-4ff3-9748-cdbc4435e384 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:39.739780 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f5ebc796-a951-41e9-ae49-d3bbe31b243f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed53fe542f8142cbb3d77588e7a75ff1', 'request_id': 'req-f5ebc796-a951-41e9-ae49-d3bbe31b243f'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:39.765580 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f5ebc796-a951-41e9-ae49-d3bbe31b243f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed53fe542f8142cbb3d77588e7a75ff1', 'request_id': 'req-f5ebc796-a951-41e9-ae49-d3bbe31b243f'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:39.786883 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f5ebc796-a951-41e9-ae49-d3bbe31b243f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed53fe542f8142cbb3d77588e7a75ff1', 'request_id': 'req-f5ebc796-a951-41e9-ae49-d3bbe31b243f'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:39.836808 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f5ebc796-a951-41e9-ae49-d3bbe31b243f admin admin] The token cache is being invalidate because project ed53fe542f8142cbb3d77588e7a75ff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:52:39.837096 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f5ebc796-a951-41e9-ae49-d3bbe31b243f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:39.837833 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f5ebc796-a951-41e9-ae49-d3bbe31b243f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:39.842932 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 831/1677] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:52:39 2022] DELETE /identity/v3/projects/ed53fe542f8142cbb3d77588e7a75ff1 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:39.850409 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebc796-a951-41e9-ae49-d3bbe31b243f admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:39.868339 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-f5ebc796-a951-41e9-ae49-d3bbe31b243f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:39.905292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9e814-7450-4337-864a-0d31df46b850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:39.906316 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9e814-7450-4337-864a-0d31df46b850 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:39.906610 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9e814-7450-4337-864a-0d31df46b850 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:39.906889 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9e814-7450-4337-864a-0d31df46b850 admin admin] PATH_INFO: `/v3/projects/c3bf00fb4a084d33a599604ac0b54693/users/bdcfb9ccbf5d4293a2eb5ae565acd4e9/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:39.956633 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9e814-7450-4337-864a-0d31df46b850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3bf00fb4a084d33a599604ac0b54693, user_id=bdcfb9ccbf5d4293a2eb5ae565acd4e9, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:39.962803 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9e814-7450-4337-864a-0d31df46b850 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:39.982762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:40.016592 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 847/1678] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:52:39 2022] PUT /identity/v3/projects/c3bf00fb4a084d33a599604ac0b54693/users/bdcfb9ccbf5d4293a2eb5ae565acd4e9/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:40.028626 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d57fc-6b49-4c2d-9879-2b0843687a74 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:40.028922 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d57fc-6b49-4c2d-9879-2b0843687a74 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:40.031415 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d57fc-6b49-4c2d-9879-2b0843687a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:40.073421 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebc796-a951-41e9-ae49-d3bbe31b243f admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:40.107171 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-b68d57fc-6b49-4c2d-9879-2b0843687a74 None None] MFA Rules not processed for user `bdcfb9ccbf5d4293a2eb5ae565acd4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:40.108863 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-b68d57fc-6b49-4c2d-9879-2b0843687a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:40.161455 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:40.244723 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782826e-3ccb-4ae3-802b-ea296f854325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:40.248450 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782826e-3ccb-4ae3-802b-ea296f854325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:40.248783 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782826e-3ccb-4ae3-802b-ea296f854325 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:40.249066 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782826e-3ccb-4ae3-802b-ea296f854325 admin admin] PATH_INFO: `/v3/users/badde2aa7e314cb093fb3953b12cf499` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:40.255411 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9782826e-3ccb-4ae3-802b-ea296f854325 admin admin] RBAC: Authorizing `identity:delete_user(user_id=badde2aa7e314cb093fb3953b12cf499)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:40.261294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9782826e-3ccb-4ae3-802b-ea296f854325 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:40.291610 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 848/1679] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:40.299947 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d57fc-6b49-4c2d-9879-2b0843687a74 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:40.301634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-b68d57fc-6b49-4c2d-9879-2b0843687a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:40.328201 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d57fc-6b49-4c2d-9879-2b0843687a74 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:40.335532 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a9c61-c78f-49b4-a4a2-83c4e77923d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:40.350081 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a9c61-c78f-49b4-a4a2-83c4e77923d1 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:40.351023 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a9c61-c78f-49b4-a4a2-83c4e77923d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:40.351743 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a9c61-c78f-49b4-a4a2-83c4e77923d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:40.352998 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a9c61-c78f-49b4-a4a2-83c4e77923d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:40.358451 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a9c61-c78f-49b4-a4a2-83c4e77923d1 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:40.377443 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-9782826e-3ccb-4ae3-802b-ea296f854325 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'badde2aa7e314cb093fb3953b12cf499'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:40.393576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-9782826e-3ccb-4ae3-802b-ea296f854325 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'badde2aa7e314cb093fb3953b12cf499'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:40.413856 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 849/1680] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:52:40 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:52:40.418973 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a9c61-c78f-49b4-a4a2-83c4e77923d1 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:40.428203 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-9782826e-3ccb-4ae3-802b-ea296f854325 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'badde2aa7e314cb093fb3953b12cf499'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:40.456702 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-9782826e-3ccb-4ae3-802b-ea296f854325 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'badde2aa7e314cb093fb3953b12cf499'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:40.459536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-9782826e-3ccb-4ae3-802b-ea296f854325 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'badde2aa7e314cb093fb3953b12cf499'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:40.476177 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 832/1681] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:52:39 2022] DELETE /identity/v3/users/badde2aa7e314cb093fb3953b12cf499 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:40.581489 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a9c61-c78f-49b4-a4a2-83c4e77923d1 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:40.751139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec99ebe-5f35-43e5-aca7-075952e771e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:40.751139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec99ebe-5f35-43e5-aca7-075952e771e0 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:40.751139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec99ebe-5f35-43e5-aca7-075952e771e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:40.751139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec99ebe-5f35-43e5-aca7-075952e771e0 admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:40.751547 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec99ebe-5f35-43e5-aca7-075952e771e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:40.751547 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec99ebe-5f35-43e5-aca7-075952e771e0 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:40.814709 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 850/1682] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:52:40 2022] POST /identity/v3/users => generated 298 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:52:40.817724 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782826e-3ccb-4ae3-802b-ea296f854325 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:40.830593 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-9782826e-3ccb-4ae3-802b-ea296f854325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:40.886137 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782826e-3ccb-4ae3-802b-ea296f854325 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:40.905583 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441676ec-c744-421f-95e8-aa4f5109d984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:40.909544 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441676ec-c744-421f-95e8-aa4f5109d984 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:40.912061 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441676ec-c744-421f-95e8-aa4f5109d984 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:40.912824 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441676ec-c744-421f-95e8-aa4f5109d984 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:40.917517 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441676ec-c744-421f-95e8-aa4f5109d984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:40.924103 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441676ec-c744-421f-95e8-aa4f5109d984 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:40.969112 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 833/1683] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:40.970272 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec99ebe-5f35-43e5-aca7-075952e771e0 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:40.985897 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec99ebe-5f35-43e5-aca7-075952e771e0 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:40.997669 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1662b06-4f70-492c-b95e-3b4f709f4afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:41.001897 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1662b06-4f70-492c-b95e-3b4f709f4afb admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:41.002392 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1662b06-4f70-492c-b95e-3b4f709f4afb admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:41.002812 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1662b06-4f70-492c-b95e-3b4f709f4afb admin admin] PATH_INFO: `/v3/projects/8075bd3d9eb445b9bffa3bf222468781/users/76e7ab730f1544fdbc253a302f0d4bb9/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:41.023215 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1662b06-4f70-492c-b95e-3b4f709f4afb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8075bd3d9eb445b9bffa3bf222468781, user_id=76e7ab730f1544fdbc253a302f0d4bb9, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:41.026865 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1662b06-4f70-492c-b95e-3b4f709f4afb admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:41.049832 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 851/1684] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:52:40 2022] PUT /identity/v3/projects/8075bd3d9eb445b9bffa3bf222468781/users/76e7ab730f1544fdbc253a302f0d4bb9/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:41.055489 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441676ec-c744-421f-95e8-aa4f5109d984 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:41.085804 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441676ec-c744-421f-95e8-aa4f5109d984 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:41.204437 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:41.237712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64205ab-c733-441e-9254-7ad499b9a6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:41.238415 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64205ab-c733-441e-9254-7ad499b9a6c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:41.239485 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64205ab-c733-441e-9254-7ad499b9a6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:41.239485 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64205ab-c733-441e-9254-7ad499b9a6c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:41.240257 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64205ab-c733-441e-9254-7ad499b9a6c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:41.242228 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64205ab-c733-441e-9254-7ad499b9a6c5 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:41.274489 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 834/1685] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:41.274777 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1662b06-4f70-492c-b95e-3b4f709f4afb admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:41.289295 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1662b06-4f70-492c-b95e-3b4f709f4afb admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:41.302901 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a7cbb-fb89-4c7f-a156-5a044ea47fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:41.304387 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a7cbb-fb89-4c7f-a156-5a044ea47fb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:41.304387 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a7cbb-fb89-4c7f-a156-5a044ea47fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:41.304387 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a7cbb-fb89-4c7f-a156-5a044ea47fb5 admin admin] PATH_INFO: `/v3/projects/8075bd3d9eb445b9bffa3bf222468781/users/76e7ab730f1544fdbc253a302f0d4bb9/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:41.311177 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a7cbb-fb89-4c7f-a156-5a044ea47fb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8075bd3d9eb445b9bffa3bf222468781, user_id=76e7ab730f1544fdbc253a302f0d4bb9, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:41.314343 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a7cbb-fb89-4c7f-a156-5a044ea47fb5 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:41.317318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:41.344112 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 852/1686] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:52:41 2022] PUT /identity/v3/projects/8075bd3d9eb445b9bffa3bf222468781/users/76e7ab730f1544fdbc253a302f0d4bb9/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:41.358381 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a425e8-505e-4543-9896-0a541bb46477 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:41.358381 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a425e8-505e-4543-9896-0a541bb46477 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:41.358839 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a425e8-505e-4543-9896-0a541bb46477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:41.418980 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-68a425e8-505e-4543-9896-0a541bb46477 None None] MFA Rules not processed for user `76e7ab730f1544fdbc253a302f0d4bb9`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:41.420364 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-68a425e8-505e-4543-9896-0a541bb46477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:41.614365 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 835/1687] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:41.632243 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a7cbb-fb89-4c7f-a156-5a044ea47fb5 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:41.635977 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-509a7cbb-fb89-4c7f-a156-5a044ea47fb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:41.852538 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a7cbb-fb89-4c7f-a156-5a044ea47fb5 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:41.871032 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3a4aa-ecdf-46fa-b00c-eadf58036332 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:41.872070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3a4aa-ecdf-46fa-b00c-eadf58036332 service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:41.872732 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3a4aa-ecdf-46fa-b00c-eadf58036332 service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:41.873405 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3a4aa-ecdf-46fa-b00c-eadf58036332 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:41.915628 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3a4aa-ecdf-46fa-b00c-eadf58036332 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:41.918439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3a4aa-ecdf-46fa-b00c-eadf58036332 service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:41.983830 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 853/1688] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:52:41.985096 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a425e8-505e-4543-9896-0a541bb46477 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:41.989708 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-68a425e8-505e-4543-9896-0a541bb46477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:42.060013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3a4aa-ecdf-46fa-b00c-eadf58036332 service cinder] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:42.244450 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a425e8-505e-4543-9896-0a541bb46477 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:42.250764 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b210c83-b07e-4aab-88bc-a6c0b165428d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:42.251931 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b210c83-b07e-4aab-88bc-a6c0b165428d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:42.252804 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b210c83-b07e-4aab-88bc-a6c0b165428d admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:42.253376 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b210c83-b07e-4aab-88bc-a6c0b165428d admin admin] PATH_INFO: `/v3/projects/08d20061f9a14109a14648db61d6850f` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:42.255032 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b210c83-b07e-4aab-88bc-a6c0b165428d admin admin] RBAC: Authorizing `identity:delete_project(project_id=08d20061f9a14109a14648db61d6850f)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:42.259059 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b210c83-b07e-4aab-88bc-a6c0b165428d admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:42.311174 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3a4aa-ecdf-46fa-b00c-eadf58036332 service cinder] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:42.336354 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5a602-723e-43d4-94bd-0c80f650687b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:42.343134 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5a602-723e-43d4-94bd-0c80f650687b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:42.344363 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5a602-723e-43d4-94bd-0c80f650687b admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:42.344363 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5a602-723e-43d4-94bd-0c80f650687b admin admin] PATH_INFO: `/v3/users/bdcfb9ccbf5d4293a2eb5ae565acd4e9` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:42.347535 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a5a602-723e-43d4-94bd-0c80f650687b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdcfb9ccbf5d4293a2eb5ae565acd4e9)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:42.351392 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a5a602-723e-43d4-94bd-0c80f650687b admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:42.424590 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8b210c83-b07e-4aab-88bc-a6c0b165428d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08d20061f9a14109a14648db61d6850f', 'request_id': 'req-8b210c83-b07e-4aab-88bc-a6c0b165428d'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:42.454158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8b210c83-b07e-4aab-88bc-a6c0b165428d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08d20061f9a14109a14648db61d6850f', 'request_id': 'req-8b210c83-b07e-4aab-88bc-a6c0b165428d'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:42.485702 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8b210c83-b07e-4aab-88bc-a6c0b165428d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08d20061f9a14109a14648db61d6850f', 'request_id': 'req-8b210c83-b07e-4aab-88bc-a6c0b165428d'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:42.486176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-71a5a602-723e-43d4-94bd-0c80f650687b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdcfb9ccbf5d4293a2eb5ae565acd4e9'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:42.488426 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-71a5a602-723e-43d4-94bd-0c80f650687b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdcfb9ccbf5d4293a2eb5ae565acd4e9'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:42.510686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-71a5a602-723e-43d4-94bd-0c80f650687b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdcfb9ccbf5d4293a2eb5ae565acd4e9'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:42.527813 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:42.539641 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8b210c83-b07e-4aab-88bc-a6c0b165428d admin admin] The token cache is being invalidate because project 08d20061f9a14109a14648db61d6850f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:52:42.539977 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8b210c83-b07e-4aab-88bc-a6c0b165428d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:42.541076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8b210c83-b07e-4aab-88bc-a6c0b165428d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:42.542855 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 836/1689] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:52:41 2022] DELETE /identity/v3/projects/08d20061f9a14109a14648db61d6850f => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:42.550086 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6260f-4026-4c6e-923f-ca843b0c33fc None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:42.550459 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6260f-4026-4c6e-923f-ca843b0c33fc None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:42.551491 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-71a5a602-723e-43d4-94bd-0c80f650687b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdcfb9ccbf5d4293a2eb5ae565acd4e9'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:42.552492 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6260f-4026-4c6e-923f-ca843b0c33fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:42.580922 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-71a5a602-723e-43d4-94bd-0c80f650687b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdcfb9ccbf5d4293a2eb5ae565acd4e9'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:42.600086 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 854/1690] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:52:42 2022] DELETE /identity/v3/users/bdcfb9ccbf5d4293a2eb5ae565acd4e9 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:52:42.611794 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be53e1e-201f-4e45-b478-48550149cb59 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:42.612087 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be53e1e-201f-4e45-b478-48550149cb59 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:42.612372 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be53e1e-201f-4e45-b478-48550149cb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:42.624152 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-c2f6260f-4026-4c6e-923f-ca843b0c33fc None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:42.627107 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-c2f6260f-4026-4c6e-923f-ca843b0c33fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:42.659264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-9be53e1e-201f-4e45-b478-48550149cb59 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:42.667827 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-9be53e1e-201f-4e45-b478-48550149cb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:42.692322 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:42.819471 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 855/1691] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:42.840984 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be53e1e-201f-4e45-b478-48550149cb59 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:42.841767 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 837/1692] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:52:42.855495 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-9be53e1e-201f-4e45-b478-48550149cb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:42.856226 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fb989-db27-420d-a58f-7ad3b3583ea1 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:42.856820 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fb989-db27-420d-a58f-7ad3b3583ea1 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:42.857451 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fb989-db27-420d-a58f-7ad3b3583ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:42.951667 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-e07fb989-db27-420d-a58f-7ad3b3583ea1 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:42.958043 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-e07fb989-db27-420d-a58f-7ad3b3583ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:43.003728 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be53e1e-201f-4e45-b478-48550149cb59 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:43.005566 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 838/1693] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:52:43.012509 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fb989-db27-420d-a58f-7ad3b3583ea1 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:43.013702 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e1826-1757-4f1f-aed7-e6f2a286b618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:43.014398 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e1826-1757-4f1f-aed7-e6f2a286b618 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:43.014678 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e1826-1757-4f1f-aed7-e6f2a286b618 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:43.015013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e1826-1757-4f1f-aed7-e6f2a286b618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:43.035418 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e1826-1757-4f1f-aed7-e6f2a286b618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:43.039476 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e1826-1757-4f1f-aed7-e6f2a286b618 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:43.049670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fb989-db27-420d-a58f-7ad3b3583ea1 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:43.059946 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a927bcc-3fb6-4b72-85c0-28db19a015ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:43.061132 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a927bcc-3fb6-4b72-85c0-28db19a015ae admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:43.061628 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a927bcc-3fb6-4b72-85c0-28db19a015ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:43.062200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a927bcc-3fb6-4b72-85c0-28db19a015ae admin admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:43.063642 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a927bcc-3fb6-4b72-85c0-28db19a015ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:52:43.064191 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a927bcc-3fb6-4b72-85c0-28db19a015ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:43.067259 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a927bcc-3fb6-4b72-85c0-28db19a015ae admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:43.081341 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 856/1694] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:52:43.094790 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 839/1695] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:52:43.099680 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e1826-1757-4f1f-aed7-e6f2a286b618 service neutron] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:43.165128 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e1826-1757-4f1f-aed7-e6f2a286b618 service neutron] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:43.175869 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4579a15-1902-4489-8487-2dbbf3e0289d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:43.176546 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4579a15-1902-4489-8487-2dbbf3e0289d admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:43.176834 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4579a15-1902-4489-8487-2dbbf3e0289d admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:43.177114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4579a15-1902-4489-8487-2dbbf3e0289d admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:43.185286 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4579a15-1902-4489-8487-2dbbf3e0289d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:43.194120 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4579a15-1902-4489-8487-2dbbf3e0289d admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:43.271146 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 857/1696] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:52:43 2022] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:52:43.272273 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a927bcc-3fb6-4b72-85c0-28db19a015ae admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:43.294027 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a927bcc-3fb6-4b72-85c0-28db19a015ae admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:43.448957 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565317a4-849f-4f42-a586-193d0c41c0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:43.449805 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565317a4-849f-4f42-a586-193d0c41c0ad admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:43.450237 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565317a4-849f-4f42-a586-193d0c41c0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:43.450636 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565317a4-849f-4f42-a586-193d0c41c0ad admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:43.452596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565317a4-849f-4f42-a586-193d0c41c0ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:43.457218 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565317a4-849f-4f42-a586-193d0c41c0ad admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:43.494207 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 840/1697] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:52:43 2022] POST /identity/v3/users => generated 292 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:52:43.498727 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4579a15-1902-4489-8487-2dbbf3e0289d admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:43.521039 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4579a15-1902-4489-8487-2dbbf3e0289d admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:43.534910 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e093e0-9df2-498c-be66-1dc2030404bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:43.535592 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e093e0-9df2-498c-be66-1dc2030404bc admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:43.535877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e093e0-9df2-498c-be66-1dc2030404bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:43.536237 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e093e0-9df2-498c-be66-1dc2030404bc admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:43.536892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e093e0-9df2-498c-be66-1dc2030404bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:43.542253 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e093e0-9df2-498c-be66-1dc2030404bc admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:43.565915 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 858/1698] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:43.566993 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565317a4-849f-4f42-a586-193d0c41c0ad admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:43.592398 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565317a4-849f-4f42-a586-193d0c41c0ad admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:43.609600 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8dc1d2-db3d-4e91-a26f-c3749f2956c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:43.613777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8dc1d2-db3d-4e91-a26f-c3749f2956c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:43.617185 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8dc1d2-db3d-4e91-a26f-c3749f2956c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:43.618179 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8dc1d2-db3d-4e91-a26f-c3749f2956c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:43.621018 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8dc1d2-db3d-4e91-a26f-c3749f2956c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:43.623939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8dc1d2-db3d-4e91-a26f-c3749f2956c9 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:43.661971 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e093e0-9df2-498c-be66-1dc2030404bc admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:43.668121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 841/1699] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:52:43.679705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e093e0-9df2-498c-be66-1dc2030404bc admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:43.690807 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348809cc-e48b-47fb-b7d5-92469436c222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:43.691536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348809cc-e48b-47fb-b7d5-92469436c222 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:43.691819 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348809cc-e48b-47fb-b7d5-92469436c222 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:43.692098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348809cc-e48b-47fb-b7d5-92469436c222 admin admin] PATH_INFO: `/v3/projects/75c9ba270792497db17c1d8088080c8a/users/16199117d96f42f29c1245dedbf133c6/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:43.737453 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348809cc-e48b-47fb-b7d5-92469436c222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75c9ba270792497db17c1d8088080c8a, user_id=16199117d96f42f29c1245dedbf133c6, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:43.741559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348809cc-e48b-47fb-b7d5-92469436c222 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:43.768422 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 859/1700] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:52:43 2022] PUT /identity/v3/projects/75c9ba270792497db17c1d8088080c8a/users/16199117d96f42f29c1245dedbf133c6/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:52:43.779782 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe9ec8-e2d6-43d5-8759-817c149039c4 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:43.780154 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe9ec8-e2d6-43d5-8759-817c149039c4 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:43.780433 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe9ec8-e2d6-43d5-8759-817c149039c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:43.866619 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-8dfe9ec8-e2d6-43d5-8759-817c149039c4 None None] MFA Rules not processed for user `16199117d96f42f29c1245dedbf133c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:43.867959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-8dfe9ec8-e2d6-43d5-8759-817c149039c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:44.000552 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:44.044375 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 842/1701] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:44.059078 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348809cc-e48b-47fb-b7d5-92469436c222 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:44.060950 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-348809cc-e48b-47fb-b7d5-92469436c222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:44.144734 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd3379-5a3d-4bf8-8cc5-bc71fd170c0c None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:44.145076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd3379-5a3d-4bf8-8cc5-bc71fd170c0c None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:44.145292 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd3379-5a3d-4bf8-8cc5-bc71fd170c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:44.178552 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348809cc-e48b-47fb-b7d5-92469436c222 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:44.182842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a563db-b1c5-4a6d-981f-e16b174e5bbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:44.183799 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a563db-b1c5-4a6d-981f-e16b174e5bbb service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:44.184299 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a563db-b1c5-4a6d-981f-e16b174e5bbb service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:44.184766 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a563db-b1c5-4a6d-981f-e16b174e5bbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:44.204878 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a563db-b1c5-4a6d-981f-e16b174e5bbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:44.206670 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a563db-b1c5-4a6d-981f-e16b174e5bbb service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:44.223073 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-58cd3379-5a3d-4bf8-8cc5-bc71fd170c0c None None] MFA Rules not processed for user `3d222376c8fe4b45ab0f4a089d409671`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:44.226713 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-58cd3379-5a3d-4bf8-8cc5-bc71fd170c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:44.231108 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 860/1702] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:52:44.398641 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 843/1703] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:52:44.400301 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a563db-b1c5-4a6d-981f-e16b174e5bbb service cinder] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:44.401871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-b5a563db-b1c5-4a6d-981f-e16b174e5bbb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:44.420299 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:44.591245 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a563db-b1c5-4a6d-981f-e16b174e5bbb service cinder] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:44.602610 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fcac2-a748-408f-8ef3-cd593ad12485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:44.604043 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fcac2-a748-408f-8ef3-cd593ad12485 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:44.604880 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fcac2-a748-408f-8ef3-cd593ad12485 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:44.605792 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fcac2-a748-408f-8ef3-cd593ad12485 admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:44.607786 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835fcac2-a748-408f-8ef3-cd593ad12485 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:44.611180 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835fcac2-a748-408f-8ef3-cd593ad12485 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:44.685710 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 861/1704] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:52:44 2022] POST /identity/v3/projects => generated 405 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:52:44.691498 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd3379-5a3d-4bf8-8cc5-bc71fd170c0c None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:44.715670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd3379-5a3d-4bf8-8cc5-bc71fd170c0c None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:44.991713 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae9a85-0d77-447b-b936-68ad4cb4b481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:45.002089 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae9a85-0d77-447b-b936-68ad4cb4b481 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:45.002089 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae9a85-0d77-447b-b936-68ad4cb4b481 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:45.002089 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae9a85-0d77-447b-b936-68ad4cb4b481 admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:45.002089 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae9a85-0d77-447b-b936-68ad4cb4b481 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:45.002089 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae9a85-0d77-447b-b936-68ad4cb4b481 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:45.099261 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 844/1705] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:52:44 2022] POST /identity/v3/users => generated 309 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:52:45.103281 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fcac2-a748-408f-8ef3-cd593ad12485 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:45.142910 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fcac2-a748-408f-8ef3-cd593ad12485 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:45.160891 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed5807-d5fa-4d3c-a2d9-f772bae34195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:45.161611 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed5807-d5fa-4d3c-a2d9-f772bae34195 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:45.161891 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed5807-d5fa-4d3c-a2d9-f772bae34195 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:45.162266 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed5807-d5fa-4d3c-a2d9-f772bae34195 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:45.162989 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed5807-d5fa-4d3c-a2d9-f772bae34195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:45.164678 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed5807-d5fa-4d3c-a2d9-f772bae34195 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:45.195627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 862/1706] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:45.201513 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae9a85-0d77-447b-b936-68ad4cb4b481 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:45.271959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae9a85-0d77-447b-b936-68ad4cb4b481 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:45.293231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf3700-0a28-4151-8921-19cd14b94402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:45.294088 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf3700-0a28-4151-8921-19cd14b94402 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:45.294584 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf3700-0a28-4151-8921-19cd14b94402 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:45.295068 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf3700-0a28-4151-8921-19cd14b94402 admin admin] PATH_INFO: `/v3/projects/e61011cd987e40cea3c8790dc5460a15/users/bd9aa1669b254c849568e2ecfe0dbf1a/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:45.341485 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf3700-0a28-4151-8921-19cd14b94402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e61011cd987e40cea3c8790dc5460a15, user_id=bd9aa1669b254c849568e2ecfe0dbf1a, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:45.350816 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf3700-0a28-4151-8921-19cd14b94402 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:45.414985 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed5807-d5fa-4d3c-a2d9-f772bae34195 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:45.425066 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 845/1707] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:52:45 2022] PUT /identity/v3/projects/e61011cd987e40cea3c8790dc5460a15/users/bd9aa1669b254c849568e2ecfe0dbf1a/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:52:45.428353 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed5807-d5fa-4d3c-a2d9-f772bae34195 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:45.629556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57de21-ec74-4b85-b73c-f1fe5f68bcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:45.630759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57de21-ec74-4b85-b73c-f1fe5f68bcf3 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:45.631265 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57de21-ec74-4b85-b73c-f1fe5f68bcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:45.631749 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57de21-ec74-4b85-b73c-f1fe5f68bcf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:45.633359 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d57de21-ec74-4b85-b73c-f1fe5f68bcf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:45.637023 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d57de21-ec74-4b85-b73c-f1fe5f68bcf3 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:45.683943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 863/1708] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:45.685296 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf3700-0a28-4151-8921-19cd14b94402 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:45.705924 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf3700-0a28-4151-8921-19cd14b94402 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:45.718904 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61a007-3693-42ae-b52d-293f2d8015e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:45.719655 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61a007-3693-42ae-b52d-293f2d8015e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:45.719943 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61a007-3693-42ae-b52d-293f2d8015e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:45.720219 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61a007-3693-42ae-b52d-293f2d8015e5 admin admin] PATH_INFO: `/v3/projects/e61011cd987e40cea3c8790dc5460a15/users/bd9aa1669b254c849568e2ecfe0dbf1a/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:45.722731 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61a007-3693-42ae-b52d-293f2d8015e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e61011cd987e40cea3c8790dc5460a15, user_id=bd9aa1669b254c849568e2ecfe0dbf1a, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:45.725543 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61a007-3693-42ae-b52d-293f2d8015e5 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:45.750153 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 846/1709] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:52:45 2022] PUT /identity/v3/projects/e61011cd987e40cea3c8790dc5460a15/users/bd9aa1669b254c849568e2ecfe0dbf1a/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:45.836206 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57de21-ec74-4b85-b73c-f1fe5f68bcf3 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:45.838783 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-1d57de21-ec74-4b85-b73c-f1fe5f68bcf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:45.864946 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57de21-ec74-4b85-b73c-f1fe5f68bcf3 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:46.044120 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c73f42-5d61-4641-81ce-0e18c8d46e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:46.044871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c73f42-5d61-4641-81ce-0e18c8d46e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:46.045158 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c73f42-5d61-4641-81ce-0e18c8d46e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:46.045511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c73f42-5d61-4641-81ce-0e18c8d46e13 admin admin] PATH_INFO: `/v3/projects/c3bf00fb4a084d33a599604ac0b54693` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:46.048060 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c73f42-5d61-4641-81ce-0e18c8d46e13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3bf00fb4a084d33a599604ac0b54693)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:46.051082 dv-cinder-850574-1-smb devstack@keystone.service[86744]: WARNING py.warnings [None req-34c73f42-5d61-4641-81ce-0e18c8d46e13 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 26 04:52:46.051082 dv-cinder-850574-1-smb devstack@keystone.service[86744]: warnings.warn(msg) Jul 26 04:52:46.051082 dv-cinder-850574-1-smb devstack@keystone.service[86744]: Jul 26 04:52:46.055838 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c73f42-5d61-4641-81ce-0e18c8d46e13 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:46.110508 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:46.204509 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-34c73f42-5d61-4641-81ce-0e18c8d46e13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3bf00fb4a084d33a599604ac0b54693', 'request_id': 'req-34c73f42-5d61-4641-81ce-0e18c8d46e13'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:46.216975 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-34c73f42-5d61-4641-81ce-0e18c8d46e13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3bf00fb4a084d33a599604ac0b54693', 'request_id': 'req-34c73f42-5d61-4641-81ce-0e18c8d46e13'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:46.241827 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-34c73f42-5d61-4641-81ce-0e18c8d46e13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3bf00fb4a084d33a599604ac0b54693', 'request_id': 'req-34c73f42-5d61-4641-81ce-0e18c8d46e13'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:46.287723 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-34c73f42-5d61-4641-81ce-0e18c8d46e13 admin admin] The token cache is being invalidate because project c3bf00fb4a084d33a599604ac0b54693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:52:46.288150 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-34c73f42-5d61-4641-81ce-0e18c8d46e13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:46.289181 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-34c73f42-5d61-4641-81ce-0e18c8d46e13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:46.291546 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 864/1710] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:52:45 2022] DELETE /identity/v3/projects/c3bf00fb4a084d33a599604ac0b54693 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:46.295683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61a007-3693-42ae-b52d-293f2d8015e5 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:46.297868 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-9e61a007-3693-42ae-b52d-293f2d8015e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:46.324532 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61a007-3693-42ae-b52d-293f2d8015e5 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:46.398454 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:46.512815 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664c0d2-f91e-450a-9f77-57a4bc3a491f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:46.514438 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664c0d2-f91e-450a-9f77-57a4bc3a491f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:46.515168 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664c0d2-f91e-450a-9f77-57a4bc3a491f admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:46.516429 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664c0d2-f91e-450a-9f77-57a4bc3a491f admin admin] PATH_INFO: `/v3/users/76e7ab730f1544fdbc253a302f0d4bb9` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:46.521800 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664c0d2-f91e-450a-9f77-57a4bc3a491f admin admin] RBAC: Authorizing `identity:delete_user(user_id=76e7ab730f1544fdbc253a302f0d4bb9)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:46.526910 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664c0d2-f91e-450a-9f77-57a4bc3a491f admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:46.708087 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-1664c0d2-f91e-450a-9f77-57a4bc3a491f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76e7ab730f1544fdbc253a302f0d4bb9'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:46.729100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-1664c0d2-f91e-450a-9f77-57a4bc3a491f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76e7ab730f1544fdbc253a302f0d4bb9'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:46.750522 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-1664c0d2-f91e-450a-9f77-57a4bc3a491f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76e7ab730f1544fdbc253a302f0d4bb9'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:46.773727 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-1664c0d2-f91e-450a-9f77-57a4bc3a491f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76e7ab730f1544fdbc253a302f0d4bb9'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:46.775270 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-1664c0d2-f91e-450a-9f77-57a4bc3a491f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76e7ab730f1544fdbc253a302f0d4bb9'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:46.792016 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 847/1711] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:52:46 2022] DELETE /identity/v3/users/76e7ab730f1544fdbc253a302f0d4bb9 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:47.809603 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47af510-163c-46b5-a656-cda5031f2e9e None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:47.810556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47af510-163c-46b5-a656-cda5031f2e9e None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:47.811034 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47af510-163c-46b5-a656-cda5031f2e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:47.887285 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-a47af510-163c-46b5-a656-cda5031f2e9e None None] MFA Rules not processed for user `c01c17a9cf7e485da50e80b139cf19eb`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:47.888608 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-a47af510-163c-46b5-a656-cda5031f2e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:48.189430 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 865/1712] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:48.211395 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664c0d2-f91e-450a-9f77-57a4bc3a491f admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:48.215864 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-1664c0d2-f91e-450a-9f77-57a4bc3a491f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:48.796777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664c0d2-f91e-450a-9f77-57a4bc3a491f admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:48.826070 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e74f6-6aa0-4641-82ba-6af9b43c6aa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:48.830786 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e74f6-6aa0-4641-82ba-6af9b43c6aa6 service nova] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:48.830786 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e74f6-6aa0-4641-82ba-6af9b43c6aa6 service nova] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:48.830786 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e74f6-6aa0-4641-82ba-6af9b43c6aa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:48.899594 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e74f6-6aa0-4641-82ba-6af9b43c6aa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:48.906442 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e74f6-6aa0-4641-82ba-6af9b43c6aa6 service nova] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:48.966937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 848/1713] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 757 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:52:50.554598 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0234e3-50ec-4a07-803d-e91b61043d13 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:50.556484 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0234e3-50ec-4a07-803d-e91b61043d13 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:50.556631 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0234e3-50ec-4a07-803d-e91b61043d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:50.611542 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-3b0234e3-50ec-4a07-803d-e91b61043d13 None None] MFA Rules not processed for user `c3274391c65b4eeab0fcf22ca4f8b791`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:50.623697 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-3b0234e3-50ec-4a07-803d-e91b61043d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:50.776772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 866/1714] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:50.787674 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e74f6-6aa0-4641-82ba-6af9b43c6aa6 service nova] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:50.791475 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-ba1e74f6-6aa0-4641-82ba-6af9b43c6aa6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:50.948461 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:51.120287 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e74f6-6aa0-4641-82ba-6af9b43c6aa6 service nova] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:51.161271 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8422c23-1325-4504-bc9b-4d7d5f1927e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:51.167000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8422c23-1325-4504-bc9b-4d7d5f1927e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:51.167386 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8422c23-1325-4504-bc9b-4d7d5f1927e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:51.170051 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8422c23-1325-4504-bc9b-4d7d5f1927e5 admin admin] PATH_INFO: `/v3/projects/8075bd3d9eb445b9bffa3bf222468781` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:51.175126 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8422c23-1325-4504-bc9b-4d7d5f1927e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8075bd3d9eb445b9bffa3bf222468781)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:51.183300 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8422c23-1325-4504-bc9b-4d7d5f1927e5 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:51.320345 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-a8422c23-1325-4504-bc9b-4d7d5f1927e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8075bd3d9eb445b9bffa3bf222468781', 'request_id': 'req-a8422c23-1325-4504-bc9b-4d7d5f1927e5'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:51.334546 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-a8422c23-1325-4504-bc9b-4d7d5f1927e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8075bd3d9eb445b9bffa3bf222468781', 'request_id': 'req-a8422c23-1325-4504-bc9b-4d7d5f1927e5'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:51.335800 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea189e-8aa3-47cf-bb3b-f57a2a0596f7 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:51.337824 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea189e-8aa3-47cf-bb3b-f57a2a0596f7 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:51.338913 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea189e-8aa3-47cf-bb3b-f57a2a0596f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:51.374201 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-a8422c23-1325-4504-bc9b-4d7d5f1927e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8075bd3d9eb445b9bffa3bf222468781', 'request_id': 'req-a8422c23-1325-4504-bc9b-4d7d5f1927e5'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:51.397092 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-a8422c23-1325-4504-bc9b-4d7d5f1927e5 admin admin] The token cache is being invalidate because project 8075bd3d9eb445b9bffa3bf222468781 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:52:51.397252 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-a8422c23-1325-4504-bc9b-4d7d5f1927e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:51.397923 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-a8422c23-1325-4504-bc9b-4d7d5f1927e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:51.403315 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 849/1715] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:52:50 2022] DELETE /identity/v3/projects/8075bd3d9eb445b9bffa3bf222468781 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:52:51.404785 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47323f8d-d2a4-45e2-8459-8a711ccb4384 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:51.405145 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47323f8d-d2a4-45e2-8459-8a711ccb4384 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:51.405340 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47323f8d-d2a4-45e2-8459-8a711ccb4384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:51.407072 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-a1ea189e-8aa3-47cf-bb3b-f57a2a0596f7 None None] MFA Rules not processed for user `bc75a3d22654405990651c3f5d8f01e9`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:51.412579 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-a1ea189e-8aa3-47cf-bb3b-f57a2a0596f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:51.446969 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-47323f8d-d2a4-45e2-8459-8a711ccb4384 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:51.448743 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-47323f8d-d2a4-45e2-8459-8a711ccb4384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:51.508956 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:51.584750 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 850/1716] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:51.595243 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e82c7a-4574-47a4-8cba-e89323dfb867 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:51.595531 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e82c7a-4574-47a4-8cba-e89323dfb867 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:51.595801 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e82c7a-4574-47a4-8cba-e89323dfb867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:51.630730 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 867/1717] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:51.642543 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108bb3c-29fe-445a-9970-9e8a25c4edd6 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:51.643105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108bb3c-29fe-445a-9970-9e8a25c4edd6 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:51.643713 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108bb3c-29fe-445a-9970-9e8a25c4edd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:51.661445 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-a0e82c7a-4574-47a4-8cba-e89323dfb867 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:51.662812 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-a0e82c7a-4574-47a4-8cba-e89323dfb867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:51.691356 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-8108bb3c-29fe-445a-9970-9e8a25c4edd6 None None] MFA Rules not processed for user `bc75a3d22654405990651c3f5d8f01e9`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:51.692959 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-8108bb3c-29fe-445a-9970-9e8a25c4edd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:51.698548 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 851/1718] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:52:51.703032 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e82c7a-4574-47a4-8cba-e89323dfb867 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:51.714824 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 868/1719] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:51.725787 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e82c7a-4574-47a4-8cba-e89323dfb867 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:51.732846 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108bb3c-29fe-445a-9970-9e8a25c4edd6 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:51.735198 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-8108bb3c-29fe-445a-9970-9e8a25c4edd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:51.737554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1f663-fbf0-4015-97c4-851151432616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:51.739278 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1f663-fbf0-4015-97c4-851151432616 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:51.742806 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1f663-fbf0-4015-97c4-851151432616 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:51.743450 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1f663-fbf0-4015-97c4-851151432616 admin admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:51.745732 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb1f663-fbf0-4015-97c4-851151432616 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:52:51.746961 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb1f663-fbf0-4015-97c4-851151432616 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:51.751288 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb1f663-fbf0-4015-97c4-851151432616 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:51.813868 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 852/1720] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:52:51.820164 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1f663-fbf0-4015-97c4-851151432616 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:51.858707 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb1f663-fbf0-4015-97c4-851151432616 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:51.869337 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da345a75-6c70-4666-8f53-a8e1d4c0e3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:51.870990 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da345a75-6c70-4666-8f53-a8e1d4c0e3b7 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:51.871834 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da345a75-6c70-4666-8f53-a8e1d4c0e3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:51.872682 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da345a75-6c70-4666-8f53-a8e1d4c0e3b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:51.874359 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da345a75-6c70-4666-8f53-a8e1d4c0e3b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:51.879200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da345a75-6c70-4666-8f53-a8e1d4c0e3b7 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:51.944503 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108bb3c-29fe-445a-9970-9e8a25c4edd6 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:51.974808 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac4cea-4df5-4eb9-bd46-a0aa2e3d4027 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:51.975991 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac4cea-4df5-4eb9-bd46-a0aa2e3d4027 service nova] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:51.981395 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac4cea-4df5-4eb9-bd46-a0aa2e3d4027 service nova] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:51.981991 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac4cea-4df5-4eb9-bd46-a0aa2e3d4027 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:52.001312 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac4cea-4df5-4eb9-bd46-a0aa2e3d4027 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:52.004012 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac4cea-4df5-4eb9-bd46-a0aa2e3d4027 service nova] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:52.004878 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 853/1721] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:52:51 2022] POST /identity/v3/projects => generated 389 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:52:52.012932 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da345a75-6c70-4666-8f53-a8e1d4c0e3b7 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:52.024271 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 869/1722] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:52:52.187521 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:52.319898 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da345a75-6c70-4666-8f53-a8e1d4c0e3b7 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:52.343031 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b960a-7c51-4878-8ac6-03617a0b438f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:52.343998 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b960a-7c51-4878-8ac6-03617a0b438f admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:52.344439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b960a-7c51-4878-8ac6-03617a0b438f admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:52.344884 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7b960a-7c51-4878-8ac6-03617a0b438f admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:52.346636 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b960a-7c51-4878-8ac6-03617a0b438f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:52.350458 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7b960a-7c51-4878-8ac6-03617a0b438f admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:52.418566 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac4cea-4df5-4eb9-bd46-a0aa2e3d4027 service nova] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:52.420492 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-7aac4cea-4df5-4eb9-bd46-a0aa2e3d4027 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:52.436042 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 854/1723] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:52:52 2022] POST /identity/v3/users => generated 295 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:52:52.441113 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b960a-7c51-4878-8ac6-03617a0b438f admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:52.452023 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac4cea-4df5-4eb9-bd46-a0aa2e3d4027 service nova] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:52.460390 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161a139-e69e-4615-85a9-8f20605716a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:52.461252 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161a139-e69e-4615-85a9-8f20605716a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:52.466387 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161a139-e69e-4615-85a9-8f20605716a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:52.466872 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161a139-e69e-4615-85a9-8f20605716a3 admin admin] PATH_INFO: `/v3/users/16199117d96f42f29c1245dedbf133c6` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:52.468436 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161a139-e69e-4615-85a9-8f20605716a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16199117d96f42f29c1245dedbf133c6)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:52.471006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161a139-e69e-4615-85a9-8f20605716a3 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:52.481183 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7b960a-7c51-4878-8ac6-03617a0b438f admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:52.491456 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05f9f6-b7b1-4ac4-a2dc-d2cd4f62ccb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:52.495154 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05f9f6-b7b1-4ac4-a2dc-d2cd4f62ccb3 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:52.496015 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05f9f6-b7b1-4ac4-a2dc-d2cd4f62ccb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:52.496746 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05f9f6-b7b1-4ac4-a2dc-d2cd4f62ccb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:52.498649 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05f9f6-b7b1-4ac4-a2dc-d2cd4f62ccb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:52.502075 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05f9f6-b7b1-4ac4-a2dc-d2cd4f62ccb3 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:52.522126 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 855/1724] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:52.532137 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05f9f6-b7b1-4ac4-a2dc-d2cd4f62ccb3 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:52.556179 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05f9f6-b7b1-4ac4-a2dc-d2cd4f62ccb3 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:52.566979 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b6bda-96f9-45f8-afd4-53945a6c8bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:52.569048 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b6bda-96f9-45f8-afd4-53945a6c8bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:52.569908 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b6bda-96f9-45f8-afd4-53945a6c8bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:52.571008 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b6bda-96f9-45f8-afd4-53945a6c8bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:52.575307 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b6bda-96f9-45f8-afd4-53945a6c8bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:52.582212 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b6bda-96f9-45f8-afd4-53945a6c8bc2 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:52.611984 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-b161a139-e69e-4615-85a9-8f20605716a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16199117d96f42f29c1245dedbf133c6'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:52.613115 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-b161a139-e69e-4615-85a9-8f20605716a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16199117d96f42f29c1245dedbf133c6'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:52.632998 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-b161a139-e69e-4615-85a9-8f20605716a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16199117d96f42f29c1245dedbf133c6'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:52.637438 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 856/1725] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:52.641930 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b6bda-96f9-45f8-afd4-53945a6c8bc2 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:52.671951 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b6bda-96f9-45f8-afd4-53945a6c8bc2 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:52.673481 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-b161a139-e69e-4615-85a9-8f20605716a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16199117d96f42f29c1245dedbf133c6'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:52.695771 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-b161a139-e69e-4615-85a9-8f20605716a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16199117d96f42f29c1245dedbf133c6'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:52.697499 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7382f0a-4b52-4b81-bb11-980c54b9663d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:52.698435 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7382f0a-4b52-4b81-bb11-980c54b9663d admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:52.698862 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7382f0a-4b52-4b81-bb11-980c54b9663d admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:52.699234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7382f0a-4b52-4b81-bb11-980c54b9663d admin admin] PATH_INFO: `/v3/projects/9c74e3bf949d4f9ba577f23c18f43f15/users/17b92f8e011a47518793164f0791411e/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:52.721562 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 870/1726] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:52:52 2022] DELETE /identity/v3/users/16199117d96f42f29c1245dedbf133c6 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:52:52.721562 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e7d5f-8459-4414-814e-3b73825275a0 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:52.721562 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e7d5f-8459-4414-814e-3b73825275a0 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:52.721562 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e7d5f-8459-4414-814e-3b73825275a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:52.736378 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7382f0a-4b52-4b81-bb11-980c54b9663d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c74e3bf949d4f9ba577f23c18f43f15, user_id=17b92f8e011a47518793164f0791411e, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:52.743944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7382f0a-4b52-4b81-bb11-980c54b9663d admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:52.780353 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 857/1727] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:52:52 2022] PUT /identity/v3/projects/9c74e3bf949d4f9ba577f23c18f43f15/users/17b92f8e011a47518793164f0791411e/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:52.782187 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654420ad-fa0f-4d7b-82e5-9bca7b3c32b1 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:52.782587 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654420ad-fa0f-4d7b-82e5-9bca7b3c32b1 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:52.782952 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654420ad-fa0f-4d7b-82e5-9bca7b3c32b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:52.807406 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-3e1e7d5f-8459-4414-814e-3b73825275a0 None None] MFA Rules not processed for user `1395843934af46cc90694bb1c0fc8a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:52.808724 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-3e1e7d5f-8459-4414-814e-3b73825275a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:52.819409 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:52.826204 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-654420ad-fa0f-4d7b-82e5-9bca7b3c32b1 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:52.829613 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-654420ad-fa0f-4d7b-82e5-9bca7b3c32b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:52.952067 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 871/1728] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:52.957589 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45d99a-a5a3-4d70-9d0b-e68cc94896be None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:52.957880 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45d99a-a5a3-4d70-9d0b-e68cc94896be None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:52.958200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45d99a-a5a3-4d70-9d0b-e68cc94896be None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:52.975954 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 872/1729] 10.222.0.39 () {54 vars in 912 bytes} [Tue Jul 26 04:52:52 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:52:52.981760 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ce020-adc0-4b28-8382-c2e24cb037d9 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:52.984639 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ce020-adc0-4b28-8382-c2e24cb037d9 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:52.984943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ce020-adc0-4b28-8382-c2e24cb037d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:53.009104 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 858/1730] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:53.009104 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd0811-e4aa-4fdc-b828-feefd6ec3d21 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:53.009104 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd0811-e4aa-4fdc-b828-feefd6ec3d21 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:53.009104 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafd0811-e4aa-4fdc-b828-feefd6ec3d21 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:53.010401 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 859/1731] 10.222.0.39 () {54 vars in 912 bytes} [Tue Jul 26 04:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:52:53.011403 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0d124-a059-4543-b6ca-a138f611f732 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:53.011768 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0d124-a059-4543-b6ca-a138f611f732 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:53.012139 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0d124-a059-4543-b6ca-a138f611f732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:53.101679 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-579ce020-adc0-4b28-8382-c2e24cb037d9 None None] MFA Rules not processed for user `17b92f8e011a47518793164f0791411e`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:53.103519 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-579ce020-adc0-4b28-8382-c2e24cb037d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:53.111759 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-51e0d124-a059-4543-b6ca-a138f611f732 None None] MFA Rules not processed for user `74fee029d5214ce18b4b9ddc2df72a23`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:53.114017 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-51e0d124-a059-4543-b6ca-a138f611f732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:53.233574 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 860/1732] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Jul 26 04:52:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:53.235286 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da4231-aa6c-491d-a78e-0fcf35a6fa2e None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:53.235968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da4231-aa6c-491d-a78e-0fcf35a6fa2e None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:53.236452 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da4231-aa6c-491d-a78e-0fcf35a6fa2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:53.255216 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:53.288885 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 873/1733] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:53.288885 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca907890-55e8-456e-99f8-33aa94043da4 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:53.288885 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca907890-55e8-456e-99f8-33aa94043da4 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:53.288885 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca907890-55e8-456e-99f8-33aa94043da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:53.293529 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-78da4231-aa6c-491d-a78e-0fcf35a6fa2e None None] MFA Rules not processed for user `bd9aa1669b254c849568e2ecfe0dbf1a`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:53.295402 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-78da4231-aa6c-491d-a78e-0fcf35a6fa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:53.319367 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-ca907890-55e8-456e-99f8-33aa94043da4 None None] MFA Rules not processed for user `74fee029d5214ce18b4b9ddc2df72a23`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:53.324518 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-ca907890-55e8-456e-99f8-33aa94043da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:53.336233 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 874/1734] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Jul 26 04:52:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:53.337349 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca907890-55e8-456e-99f8-33aa94043da4 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:53.339821 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-ca907890-55e8-456e-99f8-33aa94043da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:53.359012 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca907890-55e8-456e-99f8-33aa94043da4 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:53.366779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25438303-8e4a-494a-84c6-374f219ae8d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:53.367539 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25438303-8e4a-494a-84c6-374f219ae8d2 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:53.367828 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25438303-8e4a-494a-84c6-374f219ae8d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:53.368123 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25438303-8e4a-494a-84c6-374f219ae8d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:53.384265 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25438303-8e4a-494a-84c6-374f219ae8d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:53.386506 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25438303-8e4a-494a-84c6-374f219ae8d2 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:53.412287 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 875/1735] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:52:53.413092 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25438303-8e4a-494a-84c6-374f219ae8d2 service neutron] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:53.413345 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 861/1736] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:53 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:53.414855 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da4231-aa6c-491d-a78e-0fcf35a6fa2e None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:53.417181 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-78da4231-aa6c-491d-a78e-0fcf35a6fa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:53.430768 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25438303-8e4a-494a-84c6-374f219ae8d2 service neutron] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:53.437626 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da4231-aa6c-491d-a78e-0fcf35a6fa2e None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:53.443551 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4bf79a-0430-4586-a9da-e5213eec9979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:53.444627 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bf79a-0430-4586-a9da-e5213eec9979 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:53.445006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bf79a-0430-4586-a9da-e5213eec9979 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:53.445398 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bf79a-0430-4586-a9da-e5213eec9979 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:53.445714 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b1069-bfad-425e-90b6-24ed20facba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:53.446342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4bf79a-0430-4586-a9da-e5213eec9979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:53.446943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b1069-bfad-425e-90b6-24ed20facba5 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:53.447407 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b1069-bfad-425e-90b6-24ed20facba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:53.448135 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b1069-bfad-425e-90b6-24ed20facba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:53.449343 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4bf79a-0430-4586-a9da-e5213eec9979 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:53.464487 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b1069-bfad-425e-90b6-24ed20facba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:53.468724 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b1069-bfad-425e-90b6-24ed20facba5 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:53.495162 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 876/1737] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:52:53.498256 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b1069-bfad-425e-90b6-24ed20facba5 service neutron] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:53.499886 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 862/1738] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:52:53 2022] POST /identity/v3/projects => generated 387 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:52:53.504234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4bf79a-0430-4586-a9da-e5213eec9979 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:53.517093 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b1069-bfad-425e-90b6-24ed20facba5 service neutron] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:53.594905 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb4715-005b-4a35-98b0-dc4892b8611d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:53.596641 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb4715-005b-4a35-98b0-dc4892b8611d service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:53.596954 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb4715-005b-4a35-98b0-dc4892b8611d service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:53.597511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb4715-005b-4a35-98b0-dc4892b8611d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:53.612683 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb4715-005b-4a35-98b0-dc4892b8611d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:53.615280 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb4715-005b-4a35-98b0-dc4892b8611d service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:53.637822 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 877/1739] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:52:53.647494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4bf79a-0430-4586-a9da-e5213eec9979 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:53.654887 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669a527-b06c-4ced-8418-b4bd0d08db16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:53.655271 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669a527-b06c-4ced-8418-b4bd0d08db16 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:53.655555 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669a527-b06c-4ced-8418-b4bd0d08db16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:53.655862 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669a527-b06c-4ced-8418-b4bd0d08db16 admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:53.656680 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669a527-b06c-4ced-8418-b4bd0d08db16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:53.659255 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d669a527-b06c-4ced-8418-b4bd0d08db16 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:53.698854 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 863/1740] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:52:53 2022] POST /identity/v3/users => generated 300 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:52:53.701217 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb4715-005b-4a35-98b0-dc4892b8611d service neutron] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:53.726240 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb4715-005b-4a35-98b0-dc4892b8611d service neutron] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:53.731425 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc65546-dbb9-47c1-8b7a-56b0cdd2c143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:53.732351 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc65546-dbb9-47c1-8b7a-56b0cdd2c143 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:53.732705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc65546-dbb9-47c1-8b7a-56b0cdd2c143 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:53.733057 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc65546-dbb9-47c1-8b7a-56b0cdd2c143 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:53.734555 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc65546-dbb9-47c1-8b7a-56b0cdd2c143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:53.737516 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc65546-dbb9-47c1-8b7a-56b0cdd2c143 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:53.741305 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:53.760168 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669a527-b06c-4ced-8418-b4bd0d08db16 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:53.762464 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 878/1741] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:52:53.789043 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669a527-b06c-4ced-8418-b4bd0d08db16 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:53.806666 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244b1f4-1b5e-4ad4-aea3-14aedaad6294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:53.808470 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244b1f4-1b5e-4ad4-aea3-14aedaad6294 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:53.809915 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244b1f4-1b5e-4ad4-aea3-14aedaad6294 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:53.810514 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244b1f4-1b5e-4ad4-aea3-14aedaad6294 admin admin] PATH_INFO: `/v3/projects/f7222969c79d4118884e7aad0d5c144d/users/50fd584266974eba9738abc453946edc/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:53.876671 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244b1f4-1b5e-4ad4-aea3-14aedaad6294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7222969c79d4118884e7aad0d5c144d, user_id=50fd584266974eba9738abc453946edc, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:53.881006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244b1f4-1b5e-4ad4-aea3-14aedaad6294 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:53.928765 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 864/1742] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:52:53 2022] PUT /identity/v3/projects/f7222969c79d4118884e7aad0d5c144d/users/50fd584266974eba9738abc453946edc/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:53.930331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc65546-dbb9-47c1-8b7a-56b0cdd2c143 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:53.945844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc65546-dbb9-47c1-8b7a-56b0cdd2c143 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:54.155796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f75bc-76c2-4027-875e-3b59db2418c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:54.157651 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f75bc-76c2-4027-875e-3b59db2418c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:54.158084 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f75bc-76c2-4027-875e-3b59db2418c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:54.158566 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f75bc-76c2-4027-875e-3b59db2418c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:54.159477 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f75bc-76c2-4027-875e-3b59db2418c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:54.162030 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f75bc-76c2-4027-875e-3b59db2418c7 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:54.184729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 879/1743] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:54.186205 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244b1f4-1b5e-4ad4-aea3-14aedaad6294 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:54.211684 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244b1f4-1b5e-4ad4-aea3-14aedaad6294 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:54.230478 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bc4d7-878a-4493-9556-0207c84de4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:54.232003 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bc4d7-878a-4493-9556-0207c84de4e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:54.232354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bc4d7-878a-4493-9556-0207c84de4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:54.232873 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bc4d7-878a-4493-9556-0207c84de4e0 admin admin] PATH_INFO: `/v3/projects/f7222969c79d4118884e7aad0d5c144d/users/50fd584266974eba9738abc453946edc/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:54.236267 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48bc4d7-878a-4493-9556-0207c84de4e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7222969c79d4118884e7aad0d5c144d, user_id=50fd584266974eba9738abc453946edc, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:54.243876 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48bc4d7-878a-4493-9556-0207c84de4e0 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:54.288705 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 865/1744] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:52:54 2022] PUT /identity/v3/projects/f7222969c79d4118884e7aad0d5c144d/users/50fd584266974eba9738abc453946edc/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:54.290652 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19555eec-a01a-4eb7-8a15-19bd01683bb2 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:54.290945 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19555eec-a01a-4eb7-8a15-19bd01683bb2 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:54.291226 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19555eec-a01a-4eb7-8a15-19bd01683bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:54.344382 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-19555eec-a01a-4eb7-8a15-19bd01683bb2 None None] MFA Rules not processed for user `50fd584266974eba9738abc453946edc`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:54.345669 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-19555eec-a01a-4eb7-8a15-19bd01683bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:54.438812 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 880/1745] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:54 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:54.451455 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bc4d7-878a-4493-9556-0207c84de4e0 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:54.453404 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-c48bc4d7-878a-4493-9556-0207c84de4e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:54.505638 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:54.607211 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bc4d7-878a-4493-9556-0207c84de4e0 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:54.619323 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60afe0-3240-4d10-bedb-5210a0b68a90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:54.620015 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60afe0-3240-4d10-bedb-5210a0b68a90 service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:54.620307 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60afe0-3240-4d10-bedb-5210a0b68a90 service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:54.620575 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60afe0-3240-4d10-bedb-5210a0b68a90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:54.656878 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60afe0-3240-4d10-bedb-5210a0b68a90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:54.660700 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60afe0-3240-4d10-bedb-5210a0b68a90 service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:54.668406 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19555eec-a01a-4eb7-8a15-19bd01683bb2 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:54.673525 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-19555eec-a01a-4eb7-8a15-19bd01683bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:54.686639 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 866/1746] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:54 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:52:54.834027 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1ab69-4274-4464-86f6-8e4b1e78248f None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:54.834410 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1ab69-4274-4464-86f6-8e4b1e78248f None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:54.834729 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1ab69-4274-4464-86f6-8e4b1e78248f None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:54.836411 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 867/1747] 10.222.0.39 () {54 vars in 961 bytes} [Tue Jul 26 04:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 26 04:52:54.848843 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b22b41-208d-481f-b7e8-f1977ef83f4d None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:54.849626 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b22b41-208d-481f-b7e8-f1977ef83f4d None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:54.850386 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b22b41-208d-481f-b7e8-f1977ef83f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:54.907101 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-70b22b41-208d-481f-b7e8-f1977ef83f4d None None] MFA Rules not processed for user `21dfe7b4d6524ec2885224d77395b00b`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:54.908518 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-70b22b41-208d-481f-b7e8-f1977ef83f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:55.011136 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19555eec-a01a-4eb7-8a15-19bd01683bb2 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:55.022754 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852e486-07f2-4fdf-97cb-8c693c021f06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:55.024277 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852e486-07f2-4fdf-97cb-8c693c021f06 service nova] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:55.026781 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852e486-07f2-4fdf-97cb-8c693c021f06 service nova] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:55.028657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852e486-07f2-4fdf-97cb-8c693c021f06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:55.076335 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:55.149305 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 868/1748] 10.222.0.39 () {58 vars in 1058 bytes} [Tue Jul 26 04:52:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:52:55.160113 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b22b41-208d-481f-b7e8-f1977ef83f4d None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:55.170500 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-70b22b41-208d-481f-b7e8-f1977ef83f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:55.185005 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b22b41-208d-481f-b7e8-f1977ef83f4d None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:55.203702 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c8be8-4744-4c25-96ef-473dabe1b51a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21dfe7b4d6524ec2885224d77395b00b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:55.204274 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c8be8-4744-4c25-96ef-473dabe1b51a service placement] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:55.204650 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c8be8-4744-4c25-96ef-473dabe1b51a service placement] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:55.205015 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c8be8-4744-4c25-96ef-473dabe1b51a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:55.207861 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-a82c8be8-4744-4c25-96ef-473dabe1b51a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:55.231419 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c8be8-4744-4c25-96ef-473dabe1b51a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:55.233335 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82c8be8-4744-4c25-96ef-473dabe1b51a service placement] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:55.233726 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852e486-07f2-4fdf-97cb-8c693c021f06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:55.235658 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852e486-07f2-4fdf-97cb-8c693c021f06 service nova] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:55.256486 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 881/1749] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:52:55.257669 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852e486-07f2-4fdf-97cb-8c693c021f06 service nova] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:55.279453 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 869/1750] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:52:55.284101 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c8be8-4744-4c25-96ef-473dabe1b51a service placement] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:55.347249 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c8be8-4744-4c25-96ef-473dabe1b51a service placement] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:55.367966 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691c757-cdbb-47a8-972f-dce4690b191b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21dfe7b4d6524ec2885224d77395b00b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:55.372054 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691c757-cdbb-47a8-972f-dce4690b191b service placement] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:55.372326 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691c757-cdbb-47a8-972f-dce4690b191b service placement] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:55.372636 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691c757-cdbb-47a8-972f-dce4690b191b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:55.409185 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852e486-07f2-4fdf-97cb-8c693c021f06 service nova] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:55.427762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691c757-cdbb-47a8-972f-dce4690b191b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:55.429823 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725bd75-5993-4fab-be04-c44484994ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:55.430533 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725bd75-5993-4fab-be04-c44484994ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:55.430813 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725bd75-5993-4fab-be04-c44484994ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:55.431085 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725bd75-5993-4fab-be04-c44484994ec6 admin admin] PATH_INFO: `/v3/users/17b92f8e011a47518793164f0791411e` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:55.432324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725bd75-5993-4fab-be04-c44484994ec6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17b92f8e011a47518793164f0791411e)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:55.432456 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691c757-cdbb-47a8-972f-dce4690b191b service placement] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:55.434711 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725bd75-5993-4fab-be04-c44484994ec6 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:55.467145 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 870/1751] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:52:55.591276 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2725bd75-5993-4fab-be04-c44484994ec6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17b92f8e011a47518793164f0791411e'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:55.595326 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2725bd75-5993-4fab-be04-c44484994ec6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17b92f8e011a47518793164f0791411e'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:55.630287 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2725bd75-5993-4fab-be04-c44484994ec6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17b92f8e011a47518793164f0791411e'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:55.686871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2725bd75-5993-4fab-be04-c44484994ec6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17b92f8e011a47518793164f0791411e'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:55.711519 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2725bd75-5993-4fab-be04-c44484994ec6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17b92f8e011a47518793164f0791411e'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:55.747353 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 882/1752] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:52:55 2022] DELETE /identity/v3/users/17b92f8e011a47518793164f0791411e => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:55.753173 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb88f2-89ca-44df-b67d-a25daf323800 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:55.753480 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb88f2-89ca-44df-b67d-a25daf323800 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:55.753937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb88f2-89ca-44df-b67d-a25daf323800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:55.794793 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-3afb88f2-89ca-44df-b67d-a25daf323800 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:55.798117 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-3afb88f2-89ca-44df-b67d-a25daf323800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:56.065550 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725bd75-5993-4fab-be04-c44484994ec6 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:56.069847 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-2725bd75-5993-4fab-be04-c44484994ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:56.104550 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725bd75-5993-4fab-be04-c44484994ec6 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:56.107431 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 871/1753] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:56.138171 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617dee23-8124-47d4-b227-6f5c9b366149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:56.138876 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617dee23-8124-47d4-b227-6f5c9b366149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:56.139168 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617dee23-8124-47d4-b227-6f5c9b366149 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:56.139431 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617dee23-8124-47d4-b227-6f5c9b366149 admin admin] PATH_INFO: `/v3/projects/75c9ba270792497db17c1d8088080c8a` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:56.145480 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617dee23-8124-47d4-b227-6f5c9b366149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75c9ba270792497db17c1d8088080c8a)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:56.152370 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617dee23-8124-47d4-b227-6f5c9b366149 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:56.215306 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb88f2-89ca-44df-b67d-a25daf323800 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:56.217947 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-3afb88f2-89ca-44df-b67d-a25daf323800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:56.258192 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:56.292121 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-617dee23-8124-47d4-b227-6f5c9b366149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75c9ba270792497db17c1d8088080c8a', 'request_id': 'req-617dee23-8124-47d4-b227-6f5c9b366149'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:56.325185 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-617dee23-8124-47d4-b227-6f5c9b366149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75c9ba270792497db17c1d8088080c8a', 'request_id': 'req-617dee23-8124-47d4-b227-6f5c9b366149'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:56.339832 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-617dee23-8124-47d4-b227-6f5c9b366149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75c9ba270792497db17c1d8088080c8a', 'request_id': 'req-617dee23-8124-47d4-b227-6f5c9b366149'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:56.391228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-617dee23-8124-47d4-b227-6f5c9b366149 admin admin] The token cache is being invalidate because project 75c9ba270792497db17c1d8088080c8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:52:56.391524 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-617dee23-8124-47d4-b227-6f5c9b366149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:56.394679 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-617dee23-8124-47d4-b227-6f5c9b366149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:56.396615 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 883/1754] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:52:56 2022] DELETE /identity/v3/projects/75c9ba270792497db17c1d8088080c8a => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:56.418162 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6fc8c-c1b6-46b1-9c7b-6feff1e1f2b4 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:56.418467 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6fc8c-c1b6-46b1-9c7b-6feff1e1f2b4 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:56.418735 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6fc8c-c1b6-46b1-9c7b-6feff1e1f2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:56.470928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:56.501237 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-e0a6fc8c-c1b6-46b1-9c7b-6feff1e1f2b4 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:56.502384 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-e0a6fc8c-c1b6-46b1-9c7b-6feff1e1f2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:56.574468 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb88f2-89ca-44df-b67d-a25daf323800 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:56.756472 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 884/1755] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:56.765846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad9b00-16f8-4dda-9d69-d99316963bdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:56.766793 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad9b00-16f8-4dda-9d69-d99316963bdb service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:56.767252 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad9b00-16f8-4dda-9d69-d99316963bdb service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:56.767887 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad9b00-16f8-4dda-9d69-d99316963bdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:56.770172 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b913c3-b57d-4c9f-b9ce-af4398086ba2 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:56.771820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b913c3-b57d-4c9f-b9ce-af4398086ba2 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:56.772955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b913c3-b57d-4c9f-b9ce-af4398086ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:56.773276 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-82ad9b00-16f8-4dda-9d69-d99316963bdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:56.825847 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad9b00-16f8-4dda-9d69-d99316963bdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:56.827919 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad9b00-16f8-4dda-9d69-d99316963bdb service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:56.879885 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-06b913c3-b57d-4c9f-b9ce-af4398086ba2 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:56.881200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-06b913c3-b57d-4c9f-b9ce-af4398086ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:56.894469 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 872/1756] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:52:56.940454 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 885/1757] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:56.941942 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad9b00-16f8-4dda-9d69-d99316963bdb service neutron] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:56.984161 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad9b00-16f8-4dda-9d69-d99316963bdb service neutron] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:57.002875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8751421-b9b4-41a1-81a6-06c5d56a1f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:57.003728 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8751421-b9b4-41a1-81a6-06c5d56a1f79 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:57.004155 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8751421-b9b4-41a1-81a6-06c5d56a1f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:57.004583 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8751421-b9b4-41a1-81a6-06c5d56a1f79 admin admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:57.005651 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8751421-b9b4-41a1-81a6-06c5d56a1f79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:52:57.006173 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8751421-b9b4-41a1-81a6-06c5d56a1f79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:57.008033 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8751421-b9b4-41a1-81a6-06c5d56a1f79 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:57.038082 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 873/1758] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:52:57.042449 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b913c3-b57d-4c9f-b9ce-af4398086ba2 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:57.053903 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b913c3-b57d-4c9f-b9ce-af4398086ba2 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:57.076061 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69748524-62d4-4eec-af94-0fef71addf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:57.077516 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69748524-62d4-4eec-af94-0fef71addf84 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:57.077811 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69748524-62d4-4eec-af94-0fef71addf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:57.078144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69748524-62d4-4eec-af94-0fef71addf84 admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:57.080847 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69748524-62d4-4eec-af94-0fef71addf84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:57.088341 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69748524-62d4-4eec-af94-0fef71addf84 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:57.162938 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 886/1759] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:52:57 2022] POST /identity/v3/projects => generated 359 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:52:57.167548 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8751421-b9b4-41a1-81a6-06c5d56a1f79 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:57.187627 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8751421-b9b4-41a1-81a6-06c5d56a1f79 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:57.425880 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1de2d0-c7e8-40a2-afbe-18a877a6fe54 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:57.426425 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1de2d0-c7e8-40a2-afbe-18a877a6fe54 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:57.427490 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1de2d0-c7e8-40a2-afbe-18a877a6fe54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:57.455638 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb36fc-b375-4090-9ed5-63da62a3d769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:57.457159 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb36fc-b375-4090-9ed5-63da62a3d769 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:57.459567 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb36fc-b375-4090-9ed5-63da62a3d769 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:57.460177 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb36fc-b375-4090-9ed5-63da62a3d769 admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:57.461169 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb36fc-b375-4090-9ed5-63da62a3d769 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:57.463293 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb36fc-b375-4090-9ed5-63da62a3d769 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:57.510227 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 874/1760] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:52:57 2022] POST /identity/v3/users => generated 280 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:52:57.520188 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb36fc-b375-4090-9ed5-63da62a3d769 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:57.539464 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-ad1de2d0-c7e8-40a2-afbe-18a877a6fe54 None None] MFA Rules not processed for user `8b912bfd686648fa9aae1dca24c78697`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:57.544308 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-ad1de2d0-c7e8-40a2-afbe-18a877a6fe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:57.544814 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb36fc-b375-4090-9ed5-63da62a3d769 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:57.551390 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46d7b8-1e47-4d26-9404-8bc34d443c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:57.552574 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46d7b8-1e47-4d26-9404-8bc34d443c0b admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:57.566816 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46d7b8-1e47-4d26-9404-8bc34d443c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:57.567549 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46d7b8-1e47-4d26-9404-8bc34d443c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:57.569290 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46d7b8-1e47-4d26-9404-8bc34d443c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:57.573101 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46d7b8-1e47-4d26-9404-8bc34d443c0b admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:57.633089 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 875/1761] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:57.636541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46d7b8-1e47-4d26-9404-8bc34d443c0b admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:57.657898 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46d7b8-1e47-4d26-9404-8bc34d443c0b admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:57.667504 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276333e-f40f-4aa9-a56a-d3faee6f988f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:57.668738 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276333e-f40f-4aa9-a56a-d3faee6f988f admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:57.669159 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276333e-f40f-4aa9-a56a-d3faee6f988f admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:57.669526 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f276333e-f40f-4aa9-a56a-d3faee6f988f admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:57.671233 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f276333e-f40f-4aa9-a56a-d3faee6f988f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:57.673474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f276333e-f40f-4aa9-a56a-d3faee6f988f admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:57.690940 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 876/1762] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:52:57.697691 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276333e-f40f-4aa9-a56a-d3faee6f988f admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:57.712978 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f276333e-f40f-4aa9-a56a-d3faee6f988f admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:57.713207 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 887/1763] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:52:57.719851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ada9b-cc8a-4e02-9c9e-cf1067e2b0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:57.720723 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ada9b-cc8a-4e02-9c9e-cf1067e2b0cb admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:57.721232 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ada9b-cc8a-4e02-9c9e-cf1067e2b0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:57.722013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ada9b-cc8a-4e02-9c9e-cf1067e2b0cb admin admin] PATH_INFO: `/v3/projects/b78c047e8de445e4b4cffa8793ce597c/users/588c18d852e24675ade6a011fa1d7799/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:57.728215 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5852ba-2736-4def-be25-c49e374a3e13 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:57.728648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5852ba-2736-4def-be25-c49e374a3e13 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:57.728997 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5852ba-2736-4def-be25-c49e374a3e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:57.756786 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ada9b-cc8a-4e02-9c9e-cf1067e2b0cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b78c047e8de445e4b4cffa8793ce597c, user_id=588c18d852e24675ade6a011fa1d7799, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:57.760224 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ada9b-cc8a-4e02-9c9e-cf1067e2b0cb admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:57.792589 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 877/1764] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:52:57 2022] PUT /identity/v3/projects/b78c047e8de445e4b4cffa8793ce597c/users/588c18d852e24675ade6a011fa1d7799/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:57.803522 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25176a4-8186-405c-9796-aae2ba2a7c0e None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:57.803808 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25176a4-8186-405c-9796-aae2ba2a7c0e None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:57.804084 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25176a4-8186-405c-9796-aae2ba2a7c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:57.804373 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-1c5852ba-2736-4def-be25-c49e374a3e13 None None] MFA Rules not processed for user `8b912bfd686648fa9aae1dca24c78697`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:57.810313 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-1c5852ba-2736-4def-be25-c49e374a3e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:57.840250 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:57.856471 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-d25176a4-8186-405c-9796-aae2ba2a7c0e None None] MFA Rules not processed for user `588c18d852e24675ade6a011fa1d7799`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:57.858160 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-d25176a4-8186-405c-9796-aae2ba2a7c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:57.873000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:58.027837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 888/1765] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:58.033965 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b91f2-0cc1-4bcf-8718-0f7c453bd55c None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:58.034291 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b91f2-0cc1-4bcf-8718-0f7c453bd55c None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:58.034570 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b91f2-0cc1-4bcf-8718-0f7c453bd55c None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:58.036320 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 889/1766] 10.222.0.39 () {54 vars in 921 bytes} [Tue Jul 26 04:52:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:52:58.094426 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787485e-a262-4620-9acf-fc25010d7b1c None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:58.094717 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787485e-a262-4620-9acf-fc25010d7b1c None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:58.095075 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787485e-a262-4620-9acf-fc25010d7b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:58.100384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 878/1767] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:57 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:58.149125 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25176a4-8186-405c-9796-aae2ba2a7c0e None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:58.150928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-d25176a4-8186-405c-9796-aae2ba2a7c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:58.160254 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-1787485e-a262-4620-9acf-fc25010d7b1c None None] MFA Rules not processed for user `21dfe7b4d6524ec2885224d77395b00b`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:58.178313 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-1787485e-a262-4620-9acf-fc25010d7b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:58.234786 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25176a4-8186-405c-9796-aae2ba2a7c0e None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:58.240337 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc87be-d60d-49cf-ad09-45d26e4176ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:58.241048 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc87be-d60d-49cf-ad09-45d26e4176ab service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:58.241487 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc87be-d60d-49cf-ad09-45d26e4176ab service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:58.241803 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc87be-d60d-49cf-ad09-45d26e4176ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:58.260639 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc87be-d60d-49cf-ad09-45d26e4176ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:58.262494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc87be-d60d-49cf-ad09-45d26e4176ab service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:58.304013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 879/1768] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:58 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:52:58.339398 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc87be-d60d-49cf-ad09-45d26e4176ab service cinder] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:58.532721 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 890/1769] 10.222.0.39 () {58 vars in 1018 bytes} [Tue Jul 26 04:52:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:52:58.539273 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787485e-a262-4620-9acf-fc25010d7b1c None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:58.546660 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-1787485e-a262-4620-9acf-fc25010d7b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:58.602665 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc87be-d60d-49cf-ad09-45d26e4176ab service cinder] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:58.615931 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036ab55-f8b7-4f21-a9f6-821058a0dc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:58.616624 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036ab55-f8b7-4f21-a9f6-821058a0dc15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:58.616906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036ab55-f8b7-4f21-a9f6-821058a0dc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:58.617182 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036ab55-f8b7-4f21-a9f6-821058a0dc15 admin admin] PATH_INFO: `/v3/users/588c18d852e24675ade6a011fa1d7799` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:58.620899 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036ab55-f8b7-4f21-a9f6-821058a0dc15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=588c18d852e24675ade6a011fa1d7799)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:58.622967 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036ab55-f8b7-4f21-a9f6-821058a0dc15 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:58.709122 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787485e-a262-4620-9acf-fc25010d7b1c None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:58.717435 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f577600-acf6-4b9e-aacf-a5245ac97de1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:58.718413 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f577600-acf6-4b9e-aacf-a5245ac97de1 service nova] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:58.718831 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f577600-acf6-4b9e-aacf-a5245ac97de1 service nova] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:58.719202 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f577600-acf6-4b9e-aacf-a5245ac97de1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:58.738845 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-0036ab55-f8b7-4f21-a9f6-821058a0dc15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '588c18d852e24675ade6a011fa1d7799'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:58.743636 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f577600-acf6-4b9e-aacf-a5245ac97de1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:58.746034 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f577600-acf6-4b9e-aacf-a5245ac97de1 service nova] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:58.757161 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-0036ab55-f8b7-4f21-a9f6-821058a0dc15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '588c18d852e24675ade6a011fa1d7799'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:58.761090 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:58.770926 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 891/1770] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:58 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:52:58.775466 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f577600-acf6-4b9e-aacf-a5245ac97de1 service nova] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:58.780535 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-9f577600-acf6-4b9e-aacf-a5245ac97de1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:58.783417 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-0036ab55-f8b7-4f21-a9f6-821058a0dc15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '588c18d852e24675ade6a011fa1d7799'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:58.800630 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-0036ab55-f8b7-4f21-a9f6-821058a0dc15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '588c18d852e24675ade6a011fa1d7799'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:58.802742 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-0036ab55-f8b7-4f21-a9f6-821058a0dc15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '588c18d852e24675ade6a011fa1d7799'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:58.812569 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f577600-acf6-4b9e-aacf-a5245ac97de1 service nova] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:58.819660 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 880/1771] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:52:58 2022] DELETE /identity/v3/users/588c18d852e24675ade6a011fa1d7799 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:58.821411 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ccbea2-ee98-4eb0-b627-0faca3a402a6 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:58.821813 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ccbea2-ee98-4eb0-b627-0faca3a402a6 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:58.823465 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ccbea2-ee98-4eb0-b627-0faca3a402a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:58.877328 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-66ccbea2-ee98-4eb0-b627-0faca3a402a6 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:58.878894 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-66ccbea2-ee98-4eb0-b627-0faca3a402a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:58.913924 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:58.936521 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cd3fe0-207c-485c-a182-723af5d83325 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21dfe7b4d6524ec2885224d77395b00b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:58.938534 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd3fe0-207c-485c-a182-723af5d83325 service placement] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:58.938978 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd3fe0-207c-485c-a182-723af5d83325 service placement] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:58.939550 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cd3fe0-207c-485c-a182-723af5d83325 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:58.942143 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-98cd3fe0-207c-485c-a182-723af5d83325 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:58.958148 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd3fe0-207c-485c-a182-723af5d83325 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:58.961095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cd3fe0-207c-485c-a182-723af5d83325 service placement] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:58.975729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 892/1772] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:52:58.977804 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577ac1a-d1d4-4ecc-8e1b-362148b7f1ba None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:58.978625 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577ac1a-d1d4-4ecc-8e1b-362148b7f1ba None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:58.981123 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577ac1a-d1d4-4ecc-8e1b-362148b7f1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:59.017291 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-4577ac1a-d1d4-4ecc-8e1b-362148b7f1ba None None] MFA Rules not processed for user `c01c17a9cf7e485da50e80b139cf19eb`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:52:59.019493 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-4577ac1a-d1d4-4ecc-8e1b-362148b7f1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:59.044063 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 881/1773] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:59.056169 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ccbea2-ee98-4eb0-b627-0faca3a402a6 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:59.058123 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-66ccbea2-ee98-4eb0-b627-0faca3a402a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:59.142699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ccbea2-ee98-4eb0-b627-0faca3a402a6 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:59.146008 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 893/1774] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:52:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:52:59.152330 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4f91c-a3f0-4934-be0b-f8b1b3972399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:59.153170 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4f91c-a3f0-4934-be0b-f8b1b3972399 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:59.153688 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4f91c-a3f0-4934-be0b-f8b1b3972399 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:59.155006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4f91c-a3f0-4934-be0b-f8b1b3972399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:59.169084 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4f91c-a3f0-4934-be0b-f8b1b3972399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:59.171838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4f91c-a3f0-4934-be0b-f8b1b3972399 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:59.206166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 882/1775] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:52:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:52:59.349398 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577ac1a-d1d4-4ecc-8e1b-362148b7f1ba None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:59.350937 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-4577ac1a-d1d4-4ecc-8e1b-362148b7f1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:52:59.374462 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577ac1a-d1d4-4ecc-8e1b-362148b7f1ba None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:59.380839 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82daeb92-8a65-4b4a-a0d1-b3bca6986b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:59.381601 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82daeb92-8a65-4b4a-a0d1-b3bca6986b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:59.381941 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82daeb92-8a65-4b4a-a0d1-b3bca6986b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:59.382255 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82daeb92-8a65-4b4a-a0d1-b3bca6986b15 admin admin] PATH_INFO: `/v3/projects/9c74e3bf949d4f9ba577f23c18f43f15` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:59.383725 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82daeb92-8a65-4b4a-a0d1-b3bca6986b15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c74e3bf949d4f9ba577f23c18f43f15)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:59.386273 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82daeb92-8a65-4b4a-a0d1-b3bca6986b15 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:59.519777 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-82daeb92-8a65-4b4a-a0d1-b3bca6986b15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c74e3bf949d4f9ba577f23c18f43f15', 'request_id': 'req-82daeb92-8a65-4b4a-a0d1-b3bca6986b15'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:59.539433 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-82daeb92-8a65-4b4a-a0d1-b3bca6986b15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c74e3bf949d4f9ba577f23c18f43f15', 'request_id': 'req-82daeb92-8a65-4b4a-a0d1-b3bca6986b15'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:59.559243 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-82daeb92-8a65-4b4a-a0d1-b3bca6986b15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c74e3bf949d4f9ba577f23c18f43f15', 'request_id': 'req-82daeb92-8a65-4b4a-a0d1-b3bca6986b15'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:59.603488 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-82daeb92-8a65-4b4a-a0d1-b3bca6986b15 admin admin] The token cache is being invalidate because project 9c74e3bf949d4f9ba577f23c18f43f15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:52:59.603855 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-82daeb92-8a65-4b4a-a0d1-b3bca6986b15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:59.607420 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-82daeb92-8a65-4b4a-a0d1-b3bca6986b15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:59.614870 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 894/1776] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:52:59 2022] DELETE /identity/v3/projects/9c74e3bf949d4f9ba577f23c18f43f15 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:52:59.618528 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4f91c-a3f0-4934-be0b-f8b1b3972399 service neutron] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:52:59.635528 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4f91c-a3f0-4934-be0b-f8b1b3972399 service neutron] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:52:59.814531 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3795e-df9c-4993-a99e-bc83ec591ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:52:59.815224 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3795e-df9c-4993-a99e-bc83ec591ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:59.815554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3795e-df9c-4993-a99e-bc83ec591ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:59.815829 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3795e-df9c-4993-a99e-bc83ec591ea4 admin admin] PATH_INFO: `/v3/users/50fd584266974eba9738abc453946edc` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:52:59.817154 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3795e-df9c-4993-a99e-bc83ec591ea4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50fd584266974eba9738abc453946edc)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:52:59.819384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3795e-df9c-4993-a99e-bc83ec591ea4 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:52:59.851388 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:52:59.896373 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-b8e3795e-df9c-4993-a99e-bc83ec591ea4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50fd584266974eba9738abc453946edc'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:59.909621 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-b8e3795e-df9c-4993-a99e-bc83ec591ea4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50fd584266974eba9738abc453946edc'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:59.934511 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-b8e3795e-df9c-4993-a99e-bc83ec591ea4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50fd584266974eba9738abc453946edc'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:59.950719 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-b8e3795e-df9c-4993-a99e-bc83ec591ea4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50fd584266974eba9738abc453946edc'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:59.951843 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-b8e3795e-df9c-4993-a99e-bc83ec591ea4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50fd584266974eba9738abc453946edc'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:52:59.959900 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 883/1777] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:52:59 2022] DELETE /identity/v3/users/50fd584266974eba9738abc453946edc => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:52:59.992667 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd45a3-4597-42f8-a817-02a655e8f8af None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:52:59.993219 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd45a3-4597-42f8-a817-02a655e8f8af None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:52:59.993487 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd45a3-4597-42f8-a817-02a655e8f8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:00.056079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-f2cd45a3-4597-42f8-a817-02a655e8f8af None None] MFA Rules not processed for user `b613dee1148c4822af2e7847b28cf4aa`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:00.057945 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-f2cd45a3-4597-42f8-a817-02a655e8f8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:00.105581 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:00.183273 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 895/1778] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Jul 26 04:52:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:00.298170 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3795e-df9c-4993-a99e-bc83ec591ea4 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:00.299778 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-b8e3795e-df9c-4993-a99e-bc83ec591ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:00.426778 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd45a3-4597-42f8-a817-02a655e8f8af None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:00.428385 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-f2cd45a3-4597-42f8-a817-02a655e8f8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:00.546095 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3795e-df9c-4993-a99e-bc83ec591ea4 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:00.559568 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffa380-9992-4e87-b333-5ed077c758ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:00.560262 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffa380-9992-4e87-b333-5ed077c758ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:00.560541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffa380-9992-4e87-b333-5ed077c758ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:00.560819 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffa380-9992-4e87-b333-5ed077c758ec admin admin] PATH_INFO: `/v3/users/3d222376c8fe4b45ab0f4a089d409671` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:00.562552 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ffa380-9992-4e87-b333-5ed077c758ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d222376c8fe4b45ab0f4a089d409671)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:00.566554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ffa380-9992-4e87-b333-5ed077c758ec admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:00.668881 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd45a3-4597-42f8-a817-02a655e8f8af None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:00.692684 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bf5e4-c3e2-4449-ba15-754957ae646f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:00.693646 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bf5e4-c3e2-4449-ba15-754957ae646f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:00.695027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bf5e4-c3e2-4449-ba15-754957ae646f admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:00.695507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bf5e4-c3e2-4449-ba15-754957ae646f admin admin] PATH_INFO: `/v3/projects/b78c047e8de445e4b4cffa8793ce597c` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:00.698941 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52bf5e4-c3e2-4449-ba15-754957ae646f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b78c047e8de445e4b4cffa8793ce597c)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:00.699282 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-27ffa380-9992-4e87-b333-5ed077c758ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d222376c8fe4b45ab0f4a089d409671'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:00.702134 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52bf5e4-c3e2-4449-ba15-754957ae646f admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:00.717875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-27ffa380-9992-4e87-b333-5ed077c758ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d222376c8fe4b45ab0f4a089d409671'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:00.741067 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-27ffa380-9992-4e87-b333-5ed077c758ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d222376c8fe4b45ab0f4a089d409671'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:00.752491 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-27ffa380-9992-4e87-b333-5ed077c758ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d222376c8fe4b45ab0f4a089d409671'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:00.753953 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-27ffa380-9992-4e87-b333-5ed077c758ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d222376c8fe4b45ab0f4a089d409671'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:00.768932 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 884/1779] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:53:00 2022] DELETE /identity/v3/users/3d222376c8fe4b45ab0f4a089d409671 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:00.771061 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffa380-9992-4e87-b333-5ed077c758ec admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:00.781223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-27ffa380-9992-4e87-b333-5ed077c758ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:00.789921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-b52bf5e4-c3e2-4449-ba15-754957ae646f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b78c047e8de445e4b4cffa8793ce597c', 'request_id': 'req-b52bf5e4-c3e2-4449-ba15-754957ae646f'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:00.809312 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-b52bf5e4-c3e2-4449-ba15-754957ae646f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b78c047e8de445e4b4cffa8793ce597c', 'request_id': 'req-b52bf5e4-c3e2-4449-ba15-754957ae646f'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:00.821718 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-b52bf5e4-c3e2-4449-ba15-754957ae646f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b78c047e8de445e4b4cffa8793ce597c', 'request_id': 'req-b52bf5e4-c3e2-4449-ba15-754957ae646f'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:00.851637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-b52bf5e4-c3e2-4449-ba15-754957ae646f admin admin] The token cache is being invalidate because project b78c047e8de445e4b4cffa8793ce597c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:53:00.852034 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-b52bf5e4-c3e2-4449-ba15-754957ae646f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:00.853914 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-b52bf5e4-c3e2-4449-ba15-754957ae646f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:00.857243 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:00.867900 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 896/1780] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:53:00 2022] DELETE /identity/v3/projects/b78c047e8de445e4b4cffa8793ce597c => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:53:00.874551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3dcf6-482d-4fd1-a662-5e13353b706b None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:00.877651 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3dcf6-482d-4fd1-a662-5e13353b706b None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:00.877651 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3dcf6-482d-4fd1-a662-5e13353b706b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:00.945651 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-4cf3dcf6-482d-4fd1-a662-5e13353b706b None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:00.947544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-4cf3dcf6-482d-4fd1-a662-5e13353b706b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:01.070105 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffa380-9992-4e87-b333-5ed077c758ec admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:01.078919 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e84347-0076-4b51-85db-ff5df82af784 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e089e39e9de419b9e2fb1d7fc2d245a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:01.079640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e84347-0076-4b51-85db-ff5df82af784 service swift] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:01.080050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e84347-0076-4b51-85db-ff5df82af784 service swift] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:01.080495 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e84347-0076-4b51-85db-ff5df82af784 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:01.083567 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-e1e84347-0076-4b51-85db-ff5df82af784 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:01.132233 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 897/1781] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:01.134354 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3dcf6-482d-4fd1-a662-5e13353b706b None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:01.136367 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-4cf3dcf6-482d-4fd1-a662-5e13353b706b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:01.163068 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3dcf6-482d-4fd1-a662-5e13353b706b None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:01.172261 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2243376-0c2f-46ce-b19e-efd967916420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:01.173622 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2243376-0c2f-46ce-b19e-efd967916420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:01.174058 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2243376-0c2f-46ce-b19e-efd967916420 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:01.174614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2243376-0c2f-46ce-b19e-efd967916420 admin admin] PATH_INFO: `/v3/projects/f7222969c79d4118884e7aad0d5c144d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:01.177038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2243376-0c2f-46ce-b19e-efd967916420 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7222969c79d4118884e7aad0d5c144d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:01.180270 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2243376-0c2f-46ce-b19e-efd967916420 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:01.182876 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:01.221677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e84347-0076-4b51-85db-ff5df82af784 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:01.223688 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e84347-0076-4b51-85db-ff5df82af784 service swift] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:01.235351 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 885/1782] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 04:53:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 04:53:01.239223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a8e01-fdbb-4c35-8812-356ad3f342c2 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:01.239893 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a8e01-fdbb-4c35-8812-356ad3f342c2 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:01.240265 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a8e01-fdbb-4c35-8812-356ad3f342c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:01.301562 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-a67a8e01-fdbb-4c35-8812-356ad3f342c2 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:01.306308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-a67a8e01-fdbb-4c35-8812-356ad3f342c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:01.325038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-c2243376-0c2f-46ce-b19e-efd967916420 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7222969c79d4118884e7aad0d5c144d', 'request_id': 'req-c2243376-0c2f-46ce-b19e-efd967916420'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:01.345878 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-c2243376-0c2f-46ce-b19e-efd967916420 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7222969c79d4118884e7aad0d5c144d', 'request_id': 'req-c2243376-0c2f-46ce-b19e-efd967916420'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:01.401777 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-c2243376-0c2f-46ce-b19e-efd967916420 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7222969c79d4118884e7aad0d5c144d', 'request_id': 'req-c2243376-0c2f-46ce-b19e-efd967916420'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:01.441881 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-c2243376-0c2f-46ce-b19e-efd967916420 admin admin] The token cache is being invalidate because project f7222969c79d4118884e7aad0d5c144d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:53:01.443457 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-c2243376-0c2f-46ce-b19e-efd967916420 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:01.444408 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-c2243376-0c2f-46ce-b19e-efd967916420 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:01.453449 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 898/1783] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:53:01 2022] DELETE /identity/v3/projects/f7222969c79d4118884e7aad0d5c144d => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:01.457774 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2243376-0c2f-46ce-b19e-efd967916420 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:01.461366 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-c2243376-0c2f-46ce-b19e-efd967916420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:01.481037 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 886/1784] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:01.481037 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257bd61-ef8e-44dc-86ea-cd4d52ddbee8 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:01.481037 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257bd61-ef8e-44dc-86ea-cd4d52ddbee8 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:01.481037 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257bd61-ef8e-44dc-86ea-cd4d52ddbee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:01.508337 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2243376-0c2f-46ce-b19e-efd967916420 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:01.524083 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f783b30-b957-4a9b-8197-47e2318c3505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:01.524838 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f783b30-b957-4a9b-8197-47e2318c3505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:01.525266 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f783b30-b957-4a9b-8197-47e2318c3505 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:01.525415 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f783b30-b957-4a9b-8197-47e2318c3505 admin admin] PATH_INFO: `/v3/projects/565895c180164f90b84cf2bf98569c5b` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:01.527193 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f783b30-b957-4a9b-8197-47e2318c3505 admin admin] RBAC: Authorizing `identity:delete_project(project_id=565895c180164f90b84cf2bf98569c5b)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:01.538128 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f783b30-b957-4a9b-8197-47e2318c3505 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:01.542356 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-5257bd61-ef8e-44dc-86ea-cd4d52ddbee8 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:01.544213 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-5257bd61-ef8e-44dc-86ea-cd4d52ddbee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:01.557454 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 887/1785] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:01.565280 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257bd61-ef8e-44dc-86ea-cd4d52ddbee8 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:01.602197 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257bd61-ef8e-44dc-86ea-cd4d52ddbee8 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:01.620010 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db1e94-2991-4d7f-9e56-8c6bb2b862f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:01.620844 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db1e94-2991-4d7f-9e56-8c6bb2b862f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:01.621166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db1e94-2991-4d7f-9e56-8c6bb2b862f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:01.621451 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db1e94-2991-4d7f-9e56-8c6bb2b862f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:01.622539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db1e94-2991-4d7f-9e56-8c6bb2b862f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:53:01.622676 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db1e94-2991-4d7f-9e56-8c6bb2b862f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:01.635641 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db1e94-2991-4d7f-9e56-8c6bb2b862f8 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:01.677715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 888/1786] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:53:01.680481 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faef7ff-0934-4149-ab0a-21b95637185f None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:01.681089 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faef7ff-0934-4149-ab0a-21b95637185f None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:01.682406 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faef7ff-0934-4149-ab0a-21b95637185f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:01.694993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2f783b30-b957-4a9b-8197-47e2318c3505 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '565895c180164f90b84cf2bf98569c5b', 'request_id': 'req-2f783b30-b957-4a9b-8197-47e2318c3505'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:01.722630 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2f783b30-b957-4a9b-8197-47e2318c3505 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '565895c180164f90b84cf2bf98569c5b', 'request_id': 'req-2f783b30-b957-4a9b-8197-47e2318c3505'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:01.742806 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-1faef7ff-0934-4149-ab0a-21b95637185f None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:01.743615 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2f783b30-b957-4a9b-8197-47e2318c3505 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '565895c180164f90b84cf2bf98569c5b', 'request_id': 'req-2f783b30-b957-4a9b-8197-47e2318c3505'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:01.744740 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-1faef7ff-0934-4149-ab0a-21b95637185f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:01.762674 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:01.777842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2f783b30-b957-4a9b-8197-47e2318c3505 admin admin] The token cache is being invalidate because project 565895c180164f90b84cf2bf98569c5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:53:01.779755 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2f783b30-b957-4a9b-8197-47e2318c3505 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:01.781011 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2f783b30-b957-4a9b-8197-47e2318c3505 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:01.783108 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 899/1787] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:53:01 2022] DELETE /identity/v3/projects/565895c180164f90b84cf2bf98569c5b => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:01.787117 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f783b30-b957-4a9b-8197-47e2318c3505 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:01.788939 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-2f783b30-b957-4a9b-8197-47e2318c3505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:01.938684 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 889/1788] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:01.941493 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f783b30-b957-4a9b-8197-47e2318c3505 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:01.951082 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faef7ff-0934-4149-ab0a-21b95637185f None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:01.951665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799900d-9064-4d89-a28d-aa89cd38d0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:01.952734 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799900d-9064-4d89-a28d-aa89cd38d0a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:01.953264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799900d-9064-4d89-a28d-aa89cd38d0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:01.954261 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799900d-9064-4d89-a28d-aa89cd38d0a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:01.955336 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799900d-9064-4d89-a28d-aa89cd38d0a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:01.959823 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8799900d-9064-4d89-a28d-aa89cd38d0a5 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:01.963034 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-1faef7ff-0934-4149-ab0a-21b95637185f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:01.995052 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faef7ff-0934-4149-ab0a-21b95637185f None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:02.004365 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:02.004695 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d120e8-dbd8-497e-9ae0-2a59cc41c742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:02.006220 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d120e8-dbd8-497e-9ae0-2a59cc41c742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:02.007735 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d120e8-dbd8-497e-9ae0-2a59cc41c742 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:02.008092 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d120e8-dbd8-497e-9ae0-2a59cc41c742 admin admin] PATH_INFO: `/v3/users/bd9aa1669b254c849568e2ecfe0dbf1a` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:02.012183 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d120e8-dbd8-497e-9ae0-2a59cc41c742 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd9aa1669b254c849568e2ecfe0dbf1a)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:02.016559 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d120e8-dbd8-497e-9ae0-2a59cc41c742 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:02.020749 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 900/1789] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:53:01 2022] POST /identity/v3/projects => generated 377 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:53:02.023024 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799900d-9064-4d89-a28d-aa89cd38d0a5 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:02.126517 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-83d120e8-dbd8-497e-9ae0-2a59cc41c742 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd9aa1669b254c849568e2ecfe0dbf1a'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:02.144765 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-83d120e8-dbd8-497e-9ae0-2a59cc41c742 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd9aa1669b254c849568e2ecfe0dbf1a'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:02.174075 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-83d120e8-dbd8-497e-9ae0-2a59cc41c742 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd9aa1669b254c849568e2ecfe0dbf1a'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:02.191238 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-83d120e8-dbd8-497e-9ae0-2a59cc41c742 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd9aa1669b254c849568e2ecfe0dbf1a'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:02.206819 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-83d120e8-dbd8-497e-9ae0-2a59cc41c742 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd9aa1669b254c849568e2ecfe0dbf1a'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:02.238129 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 890/1790] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:53:01 2022] DELETE /identity/v3/users/bd9aa1669b254c849568e2ecfe0dbf1a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:02.240500 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d120e8-dbd8-497e-9ae0-2a59cc41c742 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:02.245464 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-83d120e8-dbd8-497e-9ae0-2a59cc41c742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:02.339624 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799900d-9064-4d89-a28d-aa89cd38d0a5 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:02.439689 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d120e8-dbd8-497e-9ae0-2a59cc41c742 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:02.484883 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663619b1-dff1-4ba7-aa36-67ae9e4be863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:02.486362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663619b1-dff1-4ba7-aa36-67ae9e4be863 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:02.487057 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663619b1-dff1-4ba7-aa36-67ae9e4be863 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:02.488117 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663619b1-dff1-4ba7-aa36-67ae9e4be863 admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:02.489926 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663619b1-dff1-4ba7-aa36-67ae9e4be863 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:02.499330 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663619b1-dff1-4ba7-aa36-67ae9e4be863 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:02.559560 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 891/1791] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:53:02 2022] POST /identity/v3/users => generated 289 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:53:02.561299 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663619b1-dff1-4ba7-aa36-67ae9e4be863 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:02.584920 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663619b1-dff1-4ba7-aa36-67ae9e4be863 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:02.602937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b2e3f-f01d-4b41-859c-765b353d524b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:02.604516 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b2e3f-f01d-4b41-859c-765b353d524b admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:02.605311 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b2e3f-f01d-4b41-859c-765b353d524b admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:02.606099 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b2e3f-f01d-4b41-859c-765b353d524b admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:02.607747 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b2e3f-f01d-4b41-859c-765b353d524b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:02.611312 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b2e3f-f01d-4b41-859c-765b353d524b admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:02.618043 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32def27-65bf-4186-a769-6543fe8157e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:02.621933 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32def27-65bf-4186-a769-6543fe8157e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:02.626667 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32def27-65bf-4186-a769-6543fe8157e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:02.626667 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32def27-65bf-4186-a769-6543fe8157e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:02.631489 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32def27-65bf-4186-a769-6543fe8157e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:53:02.632244 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32def27-65bf-4186-a769-6543fe8157e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:02.638071 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 892/1792] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:53:02.639345 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b2e3f-f01d-4b41-859c-765b353d524b admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:02.643671 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32def27-65bf-4186-a769-6543fe8157e1 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:02.673750 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b2e3f-f01d-4b41-859c-765b353d524b admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:02.683032 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fec7d4-4ab3-4008-80bf-348a21ad3b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:02.684224 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fec7d4-4ab3-4008-80bf-348a21ad3b74 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:02.684686 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fec7d4-4ab3-4008-80bf-348a21ad3b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:02.685200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fec7d4-4ab3-4008-80bf-348a21ad3b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:02.686649 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fec7d4-4ab3-4008-80bf-348a21ad3b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:02.697817 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fec7d4-4ab3-4008-80bf-348a21ad3b74 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:02.704911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:02.718438 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 901/1793] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 696 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:53:02.727047 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32def27-65bf-4186-a769-6543fe8157e1 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:02.730934 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 893/1794] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:53:02.732168 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fec7d4-4ab3-4008-80bf-348a21ad3b74 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:02.738190 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-a32def27-65bf-4186-a769-6543fe8157e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:02.744996 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fec7d4-4ab3-4008-80bf-348a21ad3b74 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:02.750814 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffe0f3-e954-4fe9-a6a8-a3dab8db1b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:02.751573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffe0f3-e954-4fe9-a6a8-a3dab8db1b1c admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:02.751868 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffe0f3-e954-4fe9-a6a8-a3dab8db1b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:02.752197 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffe0f3-e954-4fe9-a6a8-a3dab8db1b1c admin admin] PATH_INFO: `/v3/projects/3327cd6a830b427eaec80f8609173376/users/1118f68143564baba3eb399a7e155a87/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:02.772699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffe0f3-e954-4fe9-a6a8-a3dab8db1b1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3327cd6a830b427eaec80f8609173376, user_id=1118f68143564baba3eb399a7e155a87, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:02.775966 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffe0f3-e954-4fe9-a6a8-a3dab8db1b1c admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:02.779709 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32def27-65bf-4186-a769-6543fe8157e1 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:02.823852 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af13cf-f76c-416f-89bb-af46c7ef7661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:02.831834 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 894/1795] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:53:02 2022] PUT /identity/v3/projects/3327cd6a830b427eaec80f8609173376/users/1118f68143564baba3eb399a7e155a87/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:02.834097 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af13cf-f76c-416f-89bb-af46c7ef7661 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:02.836859 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7824d-6b55-4a5c-a447-45fe8f78a68b None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:02.837149 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af13cf-f76c-416f-89bb-af46c7ef7661 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:02.837263 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7824d-6b55-4a5c-a447-45fe8f78a68b None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:02.837428 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7824d-6b55-4a5c-a447-45fe8f78a68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:02.837532 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af13cf-f76c-416f-89bb-af46c7ef7661 admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:02.838361 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af13cf-f76c-416f-89bb-af46c7ef7661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:02.843536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af13cf-f76c-416f-89bb-af46c7ef7661 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:02.938670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-44f7824d-6b55-4a5c-a447-45fe8f78a68b None None] MFA Rules not processed for user `1118f68143564baba3eb399a7e155a87`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:02.940288 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-44f7824d-6b55-4a5c-a447-45fe8f78a68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:02.957157 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 902/1796] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:53:02 2022] POST /identity/v3/projects => generated 409 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:53:02.962726 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af13cf-f76c-416f-89bb-af46c7ef7661 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:03.161301 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af13cf-f76c-416f-89bb-af46c7ef7661 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:03.167094 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b132db6-11dd-46d1-984c-6b5c401c977f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:03.167745 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b132db6-11dd-46d1-984c-6b5c401c977f admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:03.168029 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b132db6-11dd-46d1-984c-6b5c401c977f admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:03.168453 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b132db6-11dd-46d1-984c-6b5c401c977f admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:03.169148 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b132db6-11dd-46d1-984c-6b5c401c977f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:03.172194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b132db6-11dd-46d1-984c-6b5c401c977f admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:03.195913 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 895/1797] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:03.201928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7824d-6b55-4a5c-a447-45fe8f78a68b None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:03.211430 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-44f7824d-6b55-4a5c-a447-45fe8f78a68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:03.226197 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 903/1798] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:53:02 2022] POST /identity/v3/users => generated 305 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:53:03.227941 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef61f5f-f7ec-4ae3-8170-a3efee9b08da None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:03.228557 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef61f5f-f7ec-4ae3-8170-a3efee9b08da None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:03.229078 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef61f5f-f7ec-4ae3-8170-a3efee9b08da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:03.257483 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:03.268804 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-3ef61f5f-f7ec-4ae3-8170-a3efee9b08da None None] MFA Rules not processed for user `1395843934af46cc90694bb1c0fc8a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:03.270509 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-3ef61f5f-f7ec-4ae3-8170-a3efee9b08da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:03.349839 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 904/1799] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:03.351717 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef61f5f-f7ec-4ae3-8170-a3efee9b08da None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:03.381475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef61f5f-f7ec-4ae3-8170-a3efee9b08da None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:03.395840 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fae066-36f5-45ad-b2a6-03502453c14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:03.399202 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fae066-36f5-45ad-b2a6-03502453c14e admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:03.400348 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fae066-36f5-45ad-b2a6-03502453c14e admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:03.400746 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fae066-36f5-45ad-b2a6-03502453c14e admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:03.402351 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fae066-36f5-45ad-b2a6-03502453c14e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:03.412063 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fae066-36f5-45ad-b2a6-03502453c14e admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:03.424276 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7824d-6b55-4a5c-a447-45fe8f78a68b None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:03.449493 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fc676-2661-456a-8457-e46c04c505c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:03.450143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fc676-2661-456a-8457-e46c04c505c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:03.450434 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fc676-2661-456a-8457-e46c04c505c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:03.450713 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049fc676-2661-456a-8457-e46c04c505c0 admin admin] PATH_INFO: `/v3/projects/e61011cd987e40cea3c8790dc5460a15` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:03.453039 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049fc676-2661-456a-8457-e46c04c505c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e61011cd987e40cea3c8790dc5460a15)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:03.455944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049fc676-2661-456a-8457-e46c04c505c0 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:03.501774 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 905/1800] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:53:03 2022] POST /identity/v3/projects => generated 377 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:53:03.504573 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fae066-36f5-45ad-b2a6-03502453c14e admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:03.691124 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-049fc676-2661-456a-8457-e46c04c505c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e61011cd987e40cea3c8790dc5460a15', 'request_id': 'req-049fc676-2661-456a-8457-e46c04c505c0'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:03.718706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-049fc676-2661-456a-8457-e46c04c505c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e61011cd987e40cea3c8790dc5460a15', 'request_id': 'req-049fc676-2661-456a-8457-e46c04c505c0'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:03.744698 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-049fc676-2661-456a-8457-e46c04c505c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e61011cd987e40cea3c8790dc5460a15', 'request_id': 'req-049fc676-2661-456a-8457-e46c04c505c0'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:03.746252 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:03.814806 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-049fc676-2661-456a-8457-e46c04c505c0 admin admin] The token cache is being invalidate because project e61011cd987e40cea3c8790dc5460a15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:53:03.815113 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-049fc676-2661-456a-8457-e46c04c505c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:03.818661 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-049fc676-2661-456a-8457-e46c04c505c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:03.827201 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 896/1801] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:53:03 2022] DELETE /identity/v3/projects/e61011cd987e40cea3c8790dc5460a15 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:03.829117 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fae066-36f5-45ad-b2a6-03502453c14e admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:03.831099 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fc676-2661-456a-8457-e46c04c505c0 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:03.856434 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-049fc676-2661-456a-8457-e46c04c505c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:04.165743 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049fc676-2661-456a-8457-e46c04c505c0 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:04.174044 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2277d-905e-40b7-9482-11834991ca0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:04.179581 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480aed5-5733-44a8-b52d-0c3523712d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:04.180237 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480aed5-5733-44a8-b52d-0c3523712d1a admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:04.180514 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480aed5-5733-44a8-b52d-0c3523712d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:04.180784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480aed5-5733-44a8-b52d-0c3523712d1a admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:04.181468 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480aed5-5733-44a8-b52d-0c3523712d1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:04.182638 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2277d-905e-40b7-9482-11834991ca0b admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:04.185301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480aed5-5733-44a8-b52d-0c3523712d1a admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:04.186112 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2277d-905e-40b7-9482-11834991ca0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:04.190014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec2277d-905e-40b7-9482-11834991ca0b admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:04.194277 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2277d-905e-40b7-9482-11834991ca0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:04.196111 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec2277d-905e-40b7-9482-11834991ca0b admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:04.239046 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 897/1802] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:53:03 2022] POST /identity/v3/users => generated 289 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:53:04.241842 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1256304-e9e9-40f1-a4ce-cbb847a70eab None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:04.242535 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1256304-e9e9-40f1-a4ce-cbb847a70eab None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:04.243575 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1256304-e9e9-40f1-a4ce-cbb847a70eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:04.252471 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 906/1803] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 749 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:53:04.254540 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2277d-905e-40b7-9482-11834991ca0b admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:04.278453 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-d1256304-e9e9-40f1-a4ce-cbb847a70eab None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:04.280730 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec2277d-905e-40b7-9482-11834991ca0b admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:04.280916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-d1256304-e9e9-40f1-a4ce-cbb847a70eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:04.291971 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 898/1804] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:04.294224 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1256304-e9e9-40f1-a4ce-cbb847a70eab None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:04.297040 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-d1256304-e9e9-40f1-a4ce-cbb847a70eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:04.297536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccc7b4-a9b4-4f3b-b423-e5a8f8b51721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:04.300504 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccc7b4-a9b4-4f3b-b423-e5a8f8b51721 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:04.300813 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccc7b4-a9b4-4f3b-b423-e5a8f8b51721 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:04.301092 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dccc7b4-a9b4-4f3b-b423-e5a8f8b51721 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:04.306210 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dccc7b4-a9b4-4f3b-b423-e5a8f8b51721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:04.313654 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dccc7b4-a9b4-4f3b-b423-e5a8f8b51721 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:04.316013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1256304-e9e9-40f1-a4ce-cbb847a70eab None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:04.322216 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01463558-2dfa-4c38-bc25-f92e6a431713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:04.323081 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01463558-2dfa-4c38-bc25-f92e6a431713 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:04.324285 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01463558-2dfa-4c38-bc25-f92e6a431713 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:04.324590 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01463558-2dfa-4c38-bc25-f92e6a431713 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:04.325902 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01463558-2dfa-4c38-bc25-f92e6a431713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:04.328411 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01463558-2dfa-4c38-bc25-f92e6a431713 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:04.345415 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 899/1805] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:53:04.347837 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338272a-a2b6-49e2-be07-475db39c7b67 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:04.348347 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338272a-a2b6-49e2-be07-475db39c7b67 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:04.349328 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338272a-a2b6-49e2-be07-475db39c7b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:04.368792 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 907/1806] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:53:04.369867 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccc7b4-a9b4-4f3b-b423-e5a8f8b51721 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:04.376878 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-9338272a-a2b6-49e2-be07-475db39c7b67 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:04.378940 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-9338272a-a2b6-49e2-be07-475db39c7b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:04.402014 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 900/1807] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:04.405247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338272a-a2b6-49e2-be07-475db39c7b67 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:04.418523 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dccc7b4-a9b4-4f3b-b423-e5a8f8b51721 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:04.437154 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78235314-d6b4-4e21-8131-806e27907126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:04.437943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78235314-d6b4-4e21-8131-806e27907126 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:04.438253 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78235314-d6b4-4e21-8131-806e27907126 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:04.442020 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78235314-d6b4-4e21-8131-806e27907126 admin admin] PATH_INFO: `/v3/projects/19341ab6d3ed4ceea629a6e6db55bf34/users/253dd61325c44a85940140770e9694e1/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:04.462823 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338272a-a2b6-49e2-be07-475db39c7b67 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:04.489969 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca298d-1d2e-4b8c-9c5d-749c556d3e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:04.490712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca298d-1d2e-4b8c-9c5d-749c556d3e40 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:04.491111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca298d-1d2e-4b8c-9c5d-749c556d3e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:04.491952 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca298d-1d2e-4b8c-9c5d-749c556d3e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:04.492944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca298d-1d2e-4b8c-9c5d-749c556d3e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:04.494757 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca298d-1d2e-4b8c-9c5d-749c556d3e40 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:04.507860 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78235314-d6b4-4e21-8131-806e27907126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19341ab6d3ed4ceea629a6e6db55bf34, user_id=253dd61325c44a85940140770e9694e1, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:04.513725 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78235314-d6b4-4e21-8131-806e27907126 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:04.526600 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 901/1808] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:53:04.530527 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca298d-1d2e-4b8c-9c5d-749c556d3e40 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:04.537123 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:04.559985 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 908/1809] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:53:04 2022] PUT /identity/v3/projects/19341ab6d3ed4ceea629a6e6db55bf34/users/253dd61325c44a85940140770e9694e1/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:04.561070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78235314-d6b4-4e21-8131-806e27907126 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:04.562896 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca298d-1d2e-4b8c-9c5d-749c556d3e40 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:04.767428 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdabe1-9cf6-45b5-b87b-477b8a944f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:04.769526 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdabe1-9cf6-45b5-b87b-477b8a944f48 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:04.769740 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdabe1-9cf6-45b5-b87b-477b8a944f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:04.769921 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdabe1-9cf6-45b5-b87b-477b8a944f48 admin admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:04.776401 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdabe1-9cf6-45b5-b87b-477b8a944f48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:53:04.776754 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdabe1-9cf6-45b5-b87b-477b8a944f48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:04.793571 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdabe1-9cf6-45b5-b87b-477b8a944f48 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:04.820710 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78235314-d6b4-4e21-8131-806e27907126 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:04.837535 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23daad93-802d-4cf8-81ff-2066f6fe44b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:04.840106 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23daad93-802d-4cf8-81ff-2066f6fe44b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:04.840938 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23daad93-802d-4cf8-81ff-2066f6fe44b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:04.841169 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23daad93-802d-4cf8-81ff-2066f6fe44b0 admin admin] PATH_INFO: `/v3/projects/684de9d75e8648718ccb2e36b394affc/users/bc3a33a5b5744703b53ae6ca16733d48/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:04.853066 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 902/1810] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:53:04.868958 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73084e0-1661-4f79-a557-f7f9e26f2969 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:04.869095 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73084e0-1661-4f79-a557-f7f9e26f2969 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:04.869347 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73084e0-1661-4f79-a557-f7f9e26f2969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:04.907332 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23daad93-802d-4cf8-81ff-2066f6fe44b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=684de9d75e8648718ccb2e36b394affc, user_id=bc3a33a5b5744703b53ae6ca16733d48, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:04.916445 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23daad93-802d-4cf8-81ff-2066f6fe44b0 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:04.958950 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-e73084e0-1661-4f79-a557-f7f9e26f2969 None None] MFA Rules not processed for user `253dd61325c44a85940140770e9694e1`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:04.961678 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-e73084e0-1661-4f79-a557-f7f9e26f2969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:04.969633 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 909/1811] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:53:04 2022] PUT /identity/v3/projects/684de9d75e8648718ccb2e36b394affc/users/bc3a33a5b5744703b53ae6ca16733d48/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:04.970781 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23daad93-802d-4cf8-81ff-2066f6fe44b0 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:05.056513 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:05.205036 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23daad93-802d-4cf8-81ff-2066f6fe44b0 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:05.223212 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 903/1812] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:04 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:05.226545 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2fbb0-3cb2-4867-a20c-00b8048f073d None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:05.232879 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a1680-0f8d-49f1-bc44-2acd287472f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:05.233510 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2fbb0-3cb2-4867-a20c-00b8048f073d None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:05.235542 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c2fbb0-3cb2-4867-a20c-00b8048f073d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:05.235705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a1680-0f8d-49f1-bc44-2acd287472f6 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:05.235906 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a1680-0f8d-49f1-bc44-2acd287472f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:05.239229 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a1680-0f8d-49f1-bc44-2acd287472f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:05.239846 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a1680-0f8d-49f1-bc44-2acd287472f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:05.248709 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a1680-0f8d-49f1-bc44-2acd287472f6 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:05.353785 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 910/1813] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:53:04 2022] POST /identity/v3/projects => generated 381 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:53:05.355733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-27c2fbb0-3cb2-4867-a20c-00b8048f073d None None] MFA Rules not processed for user `bc3a33a5b5744703b53ae6ca16733d48`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:05.357500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a1680-0f8d-49f1-bc44-2acd287472f6 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:05.359235 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-27c2fbb0-3cb2-4867-a20c-00b8048f073d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:05.573132 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a1680-0f8d-49f1-bc44-2acd287472f6 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:05.590593 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215432e-c028-4936-8cc9-b78c31381e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:05.591255 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215432e-c028-4936-8cc9-b78c31381e22 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:05.591532 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215432e-c028-4936-8cc9-b78c31381e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:05.591802 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215432e-c028-4936-8cc9-b78c31381e22 admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:05.595814 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4215432e-c028-4936-8cc9-b78c31381e22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:05.608074 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4215432e-c028-4936-8cc9-b78c31381e22 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:05.653536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 904/1814] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:05.660765 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2fbb0-3cb2-4867-a20c-00b8048f073d None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:05.668930 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:05.714015 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 911/1815] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:53:05 2022] POST /identity/v3/projects => generated 409 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:53:05.714237 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c2fbb0-3cb2-4867-a20c-00b8048f073d None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:05.716062 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215432e-c028-4936-8cc9-b78c31381e22 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:05.877361 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc073285-0177-4efb-aa5d-88a79fe0ff11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:05.878267 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc073285-0177-4efb-aa5d-88a79fe0ff11 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:05.878682 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc073285-0177-4efb-aa5d-88a79fe0ff11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:05.879019 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc073285-0177-4efb-aa5d-88a79fe0ff11 admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:05.879963 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc073285-0177-4efb-aa5d-88a79fe0ff11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:05.884715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc073285-0177-4efb-aa5d-88a79fe0ff11 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:05.928961 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 905/1816] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:53:05 2022] POST /identity/v3/users => generated 291 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:53:05.930243 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc073285-0177-4efb-aa5d-88a79fe0ff11 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:05.942980 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215432e-c028-4936-8cc9-b78c31381e22 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:05.970244 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc073285-0177-4efb-aa5d-88a79fe0ff11 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:05.971759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6a758-2361-4272-a922-201c4b492b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:05.976899 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6a758-2361-4272-a922-201c4b492b7e admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:05.977241 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6a758-2361-4272-a922-201c4b492b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:05.978582 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6a758-2361-4272-a922-201c4b492b7e admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:05.979773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6a758-2361-4272-a922-201c4b492b7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:05.991480 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6a758-2361-4272-a922-201c4b492b7e admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:06.018374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37920ac-773d-4526-a7ff-a2e77335cb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:06.018374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37920ac-773d-4526-a7ff-a2e77335cb54 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:06.018374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37920ac-773d-4526-a7ff-a2e77335cb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:06.018374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37920ac-773d-4526-a7ff-a2e77335cb54 admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:06.018862 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37920ac-773d-4526-a7ff-a2e77335cb54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:06.018862 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37920ac-773d-4526-a7ff-a2e77335cb54 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:06.079506 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 906/1817] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:53:05 2022] POST /identity/v3/users => generated 311 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:53:06.081001 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37920ac-773d-4526-a7ff-a2e77335cb54 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:06.095507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 912/1818] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:53:05 2022] POST /identity/v3/projects => generated 375 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:53:06.096691 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5b193-c4f9-4750-bb95-ee01dbb2917a None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:06.096978 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5b193-c4f9-4750-bb95-ee01dbb2917a None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:06.097258 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5b193-c4f9-4750-bb95-ee01dbb2917a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:06.108273 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37920ac-773d-4526-a7ff-a2e77335cb54 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:06.184349 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-76a5b193-c4f9-4750-bb95-ee01dbb2917a None None] MFA Rules not processed for user `8b912bfd686648fa9aae1dca24c78697`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:06.194482 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-76a5b193-c4f9-4750-bb95-ee01dbb2917a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:06.236564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:06.344232 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c02c3-a5cb-4315-8113-c7e3ceffcb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:06.345557 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c02c3-a5cb-4315-8113-c7e3ceffcb8e admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:06.345965 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c02c3-a5cb-4315-8113-c7e3ceffcb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:06.347895 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c02c3-a5cb-4315-8113-c7e3ceffcb8e admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:06.349135 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c02c3-a5cb-4315-8113-c7e3ceffcb8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:06.351467 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c02c3-a5cb-4315-8113-c7e3ceffcb8e admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:06.394234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 907/1819] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:53:06.394234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c02c3-a5cb-4315-8113-c7e3ceffcb8e admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:06.436127 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c02c3-a5cb-4315-8113-c7e3ceffcb8e admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:06.453063 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb332e0-955a-439c-b4f1-6a328ee447f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:06.453781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb332e0-955a-439c-b4f1-6a328ee447f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:06.454084 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb332e0-955a-439c-b4f1-6a328ee447f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:06.454362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb332e0-955a-439c-b4f1-6a328ee447f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:06.455083 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb332e0-955a-439c-b4f1-6a328ee447f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:06.460061 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 913/1820] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:06.462692 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb332e0-955a-439c-b4f1-6a328ee447f7 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:06.468371 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a5b193-c4f9-4750-bb95-ee01dbb2917a None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:06.512702 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 908/1821] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:53:06.517651 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb332e0-955a-439c-b4f1-6a328ee447f7 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:06.525950 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a5b193-c4f9-4750-bb95-ee01dbb2917a None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:06.547623 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57840a-5ad2-4597-ae65-eb579448c55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:06.548410 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57840a-5ad2-4597-ae65-eb579448c55e admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:06.548692 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57840a-5ad2-4597-ae65-eb579448c55e admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:06.549064 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57840a-5ad2-4597-ae65-eb579448c55e admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:06.549787 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57840a-5ad2-4597-ae65-eb579448c55e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:06.554303 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57840a-5ad2-4597-ae65-eb579448c55e admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:06.555889 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb332e0-955a-439c-b4f1-6a328ee447f7 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:06.576933 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd0376-0be9-4f92-ba19-9438b47d90c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:06.577694 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd0376-0be9-4f92-ba19-9438b47d90c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:06.577999 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd0376-0be9-4f92-ba19-9438b47d90c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:06.581832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd0376-0be9-4f92-ba19-9438b47d90c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:06.582765 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd0376-0be9-4f92-ba19-9438b47d90c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:06.588586 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd0376-0be9-4f92-ba19-9438b47d90c8 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:06.650036 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 909/1822] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:53:06.653578 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd0376-0be9-4f92-ba19-9438b47d90c8 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:06.665148 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 914/1823] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:53:06 2022] POST /identity/v3/users => generated 294 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:53:06.670759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57840a-5ad2-4597-ae65-eb579448c55e admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:06.712867 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57840a-5ad2-4597-ae65-eb579448c55e admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:06.713326 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd0376-0be9-4f92-ba19-9438b47d90c8 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:06.739108 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b63c8-c596-49bf-968d-3a05bd581ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:06.739887 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b63c8-c596-49bf-968d-3a05bd581ac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:06.740168 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b63c8-c596-49bf-968d-3a05bd581ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:06.740443 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b63c8-c596-49bf-968d-3a05bd581ac0 admin admin] PATH_INFO: `/v3/projects/a29398a38ea547918087aa0f95d58df6/users/4e9436b20b444923b8e041e01fa7bfc7/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:06.742200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9cdda-8644-41ed-94e0-7e90510440c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:06.743279 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9cdda-8644-41ed-94e0-7e90510440c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:06.747523 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9cdda-8644-41ed-94e0-7e90510440c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:06.748078 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9cdda-8644-41ed-94e0-7e90510440c7 admin admin] PATH_INFO: `/v3/projects/7c50eb39d37e4158847ae1bd1f0715f4/users/adaf03659e3941039c09dea2dc2c547e/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:06.787767 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b63c8-c596-49bf-968d-3a05bd581ac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a29398a38ea547918087aa0f95d58df6, user_id=4e9436b20b444923b8e041e01fa7bfc7, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:06.805657 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35b63c8-c596-49bf-968d-3a05bd581ac0 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:06.837544 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 910/1824] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:53:06 2022] PUT /identity/v3/projects/a29398a38ea547918087aa0f95d58df6/users/4e9436b20b444923b8e041e01fa7bfc7/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:06.837742 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9cdda-8644-41ed-94e0-7e90510440c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c50eb39d37e4158847ae1bd1f0715f4, user_id=adaf03659e3941039c09dea2dc2c547e, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:06.837856 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b63c8-c596-49bf-968d-3a05bd581ac0 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:06.846789 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9cdda-8644-41ed-94e0-7e90510440c7 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:06.899525 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 915/1825] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:53:06 2022] PUT /identity/v3/projects/7c50eb39d37e4158847ae1bd1f0715f4/users/adaf03659e3941039c09dea2dc2c547e/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:06.900962 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9cdda-8644-41ed-94e0-7e90510440c7 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:07.081695 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b63c8-c596-49bf-968d-3a05bd581ac0 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:07.117606 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:07.156530 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9cdda-8644-41ed-94e0-7e90510440c7 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:07.169515 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49653b-781f-486a-bab2-8d595e8ce35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:07.170785 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49653b-781f-486a-bab2-8d595e8ce35d admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:07.171069 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49653b-781f-486a-bab2-8d595e8ce35d admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:07.171376 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49653b-781f-486a-bab2-8d595e8ce35d admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:07.174624 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49653b-781f-486a-bab2-8d595e8ce35d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:07.180437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49653b-781f-486a-bab2-8d595e8ce35d admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:07.228493 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 916/1826] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:53:07.251649 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b45fcb-5e22-4447-9ea4-7fbf582775af None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:07.251957 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b45fcb-5e22-4447-9ea4-7fbf582775af None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:07.254900 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b45fcb-5e22-4447-9ea4-7fbf582775af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:07.351951 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ff3fb-8f2b-4d28-aa62-1aabd2761467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:07.353070 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ff3fb-8f2b-4d28-aa62-1aabd2761467 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:07.356493 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ff3fb-8f2b-4d28-aa62-1aabd2761467 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:07.358359 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ff3fb-8f2b-4d28-aa62-1aabd2761467 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:07.360376 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ff3fb-8f2b-4d28-aa62-1aabd2761467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:07.375267 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ff3fb-8f2b-4d28-aa62-1aabd2761467 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:07.375583 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-78b45fcb-5e22-4447-9ea4-7fbf582775af None None] MFA Rules not processed for user `adaf03659e3941039c09dea2dc2c547e`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:07.376796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-78b45fcb-5e22-4447-9ea4-7fbf582775af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:07.434706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 911/1827] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 596 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:53:07.434706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b26ea1-ce90-451d-a8a9-b771461769de None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:07.434706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b26ea1-ce90-451d-a8a9-b771461769de None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:07.434706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b26ea1-ce90-451d-a8a9-b771461769de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:07.521172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-f3b26ea1-ce90-451d-a8a9-b771461769de None None] MFA Rules not processed for user `74fee029d5214ce18b4b9ddc2df72a23`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:07.524487 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-f3b26ea1-ce90-451d-a8a9-b771461769de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:07.596783 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:07.612133 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 917/1828] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:07.614169 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b45fcb-5e22-4447-9ea4-7fbf582775af None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:07.676798 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b45fcb-5e22-4447-9ea4-7fbf582775af None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:07.687358 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 912/1829] 10.222.0.47 () {58 vars in 1015 bytes} [Tue Jul 26 04:53:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:07.688419 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b26ea1-ce90-451d-a8a9-b771461769de None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:07.699147 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdeb8f8-2123-48c0-a3fd-0231038a16b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:07.700263 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdeb8f8-2123-48c0-a3fd-0231038a16b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:07.700739 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdeb8f8-2123-48c0-a3fd-0231038a16b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:07.701197 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdeb8f8-2123-48c0-a3fd-0231038a16b4 admin admin] PATH_INFO: `/v3/projects/a29398a38ea547918087aa0f95d58df6/users/4e9436b20b444923b8e041e01fa7bfc7/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:07.711118 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b26ea1-ce90-451d-a8a9-b771461769de None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:07.715209 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdeb8f8-2123-48c0-a3fd-0231038a16b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a29398a38ea547918087aa0f95d58df6, user_id=4e9436b20b444923b8e041e01fa7bfc7, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:07.721469 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdeb8f8-2123-48c0-a3fd-0231038a16b4 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:07.725906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727d60c-8e57-4693-a625-a5c7d0cb78c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:07.726607 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727d60c-8e57-4693-a625-a5c7d0cb78c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:07.726882 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727d60c-8e57-4693-a625-a5c7d0cb78c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:07.727172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727d60c-8e57-4693-a625-a5c7d0cb78c0 admin admin] PATH_INFO: `/v3/projects/b6eb156a733e42a695978f81e7397e4a/users/e3f94a2bc46e4fb0b2bd8197bfc1cbdc/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:07.777609 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 918/1830] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:53:07 2022] PUT /identity/v3/projects/a29398a38ea547918087aa0f95d58df6/users/4e9436b20b444923b8e041e01fa7bfc7/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:07.779403 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdeb8f8-2123-48c0-a3fd-0231038a16b4 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:07.807540 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727d60c-8e57-4693-a625-a5c7d0cb78c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6eb156a733e42a695978f81e7397e4a, user_id=e3f94a2bc46e4fb0b2bd8197bfc1cbdc, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:07.810387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727d60c-8e57-4693-a625-a5c7d0cb78c0 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:07.850600 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 913/1831] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:53:07 2022] PUT /identity/v3/projects/b6eb156a733e42a695978f81e7397e4a/users/e3f94a2bc46e4fb0b2bd8197bfc1cbdc/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:07.851865 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7dd389-ee93-4ae4-b4e9-ea737a75c4c7 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:07.852184 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7dd389-ee93-4ae4-b4e9-ea737a75c4c7 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:07.852386 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7dd389-ee93-4ae4-b4e9-ea737a75c4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:07.928154 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-5d7dd389-ee93-4ae4-b4e9-ea737a75c4c7 None None] MFA Rules not processed for user `4e9436b20b444923b8e041e01fa7bfc7`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:07.929329 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-5d7dd389-ee93-4ae4-b4e9-ea737a75c4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:08.018074 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdeb8f8-2123-48c0-a3fd-0231038a16b4 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:08.160870 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 914/1832] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:07 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:08.162984 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7dd389-ee93-4ae4-b4e9-ea737a75c4c7 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:08.249188 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df400672-3f97-4927-a3e6-c8a6dc7bc4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:08.250301 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df400672-3f97-4927-a3e6-c8a6dc7bc4a1 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:08.250794 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df400672-3f97-4927-a3e6-c8a6dc7bc4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:08.251272 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df400672-3f97-4927-a3e6-c8a6dc7bc4a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:08.252531 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df400672-3f97-4927-a3e6-c8a6dc7bc4a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:08.262854 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df400672-3f97-4927-a3e6-c8a6dc7bc4a1 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:08.301717 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:08.311629 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7dd389-ee93-4ae4-b4e9-ea737a75c4c7 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:08.318429 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71b164-bea8-49ec-97fb-5c735a80d4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:08.319697 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71b164-bea8-49ec-97fb-5c735a80d4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:08.321720 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71b164-bea8-49ec-97fb-5c735a80d4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:08.322284 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71b164-bea8-49ec-97fb-5c735a80d4b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:08.324661 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71b164-bea8-49ec-97fb-5c735a80d4b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:08.327043 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71b164-bea8-49ec-97fb-5c735a80d4b7 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:08.348101 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 915/1833] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:53:08.349557 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71b164-bea8-49ec-97fb-5c735a80d4b7 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:08.353514 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-af71b164-bea8-49ec-97fb-5c735a80d4b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:08.388731 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 919/1834] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:53:07 2022] POST /identity/v3/projects => generated 379 bytes in 610 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:53:08.390546 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df400672-3f97-4927-a3e6-c8a6dc7bc4a1 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:08.393206 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-df400672-3f97-4927-a3e6-c8a6dc7bc4a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:08.427041 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:08.511796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71b164-bea8-49ec-97fb-5c735a80d4b7 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:08.613006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df400672-3f97-4927-a3e6-c8a6dc7bc4a1 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:08.624545 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127293c7-a76a-451c-8780-92449130136d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:08.625211 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127293c7-a76a-451c-8780-92449130136d service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:08.625495 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127293c7-a76a-451c-8780-92449130136d service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:08.625775 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127293c7-a76a-451c-8780-92449130136d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:08.645344 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127293c7-a76a-451c-8780-92449130136d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:08.656248 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127293c7-a76a-451c-8780-92449130136d service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:08.676631 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 920/1835] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:53:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:53:08.677581 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127293c7-a76a-451c-8780-92449130136d service neutron] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:08.682846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b795d97-82e4-4185-945b-5f02231b6d26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:08.684508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b795d97-82e4-4185-945b-5f02231b6d26 service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:08.687178 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b795d97-82e4-4185-945b-5f02231b6d26 service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:08.687835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b795d97-82e4-4185-945b-5f02231b6d26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:08.875932 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127293c7-a76a-451c-8780-92449130136d service neutron] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:08.881283 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b795d97-82e4-4185-945b-5f02231b6d26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:08.883869 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b795d97-82e4-4185-945b-5f02231b6d26 service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:08.898278 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d0a196-21e3-4caa-9f92-fab3543c5d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:08.899447 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0a196-21e3-4caa-9f92-fab3543c5d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:08.899948 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0a196-21e3-4caa-9f92-fab3543c5d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:08.900436 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0a196-21e3-4caa-9f92-fab3543c5d71 admin admin] PATH_INFO: `/v3/projects/b6eb156a733e42a695978f81e7397e4a/users/e3f94a2bc46e4fb0b2bd8197bfc1cbdc/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:08.903136 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0a196-21e3-4caa-9f92-fab3543c5d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6eb156a733e42a695978f81e7397e4a, user_id=e3f94a2bc46e4fb0b2bd8197bfc1cbdc, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:08.906371 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0a196-21e3-4caa-9f92-fab3543c5d71 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:08.922228 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 916/1836] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:53:08 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:53:08.939895 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b795d97-82e4-4185-945b-5f02231b6d26 service cinder] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:08.949967 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 921/1837] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:53:08 2022] PUT /identity/v3/projects/b6eb156a733e42a695978f81e7397e4a/users/e3f94a2bc46e4fb0b2bd8197bfc1cbdc/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:08.954657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd78ca-f3de-4e3f-9dbb-546d918a2c71 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:08.955095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd78ca-f3de-4e3f-9dbb-546d918a2c71 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:08.955477 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd78ca-f3de-4e3f-9dbb-546d918a2c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:09.027606 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b795d97-82e4-4185-945b-5f02231b6d26 service cinder] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:09.029490 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-cdbd78ca-f3de-4e3f-9dbb-546d918a2c71 None None] MFA Rules not processed for user `e3f94a2bc46e4fb0b2bd8197bfc1cbdc`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:09.030886 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-cdbd78ca-f3de-4e3f-9dbb-546d918a2c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:09.252915 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a37bf1-487e-47ac-9a8b-f0c6b5c62f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:09.253516 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a37bf1-487e-47ac-9a8b-f0c6b5c62f24 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:09.253644 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a37bf1-487e-47ac-9a8b-f0c6b5c62f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:09.256056 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a37bf1-487e-47ac-9a8b-f0c6b5c62f24 admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:09.257054 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a37bf1-487e-47ac-9a8b-f0c6b5c62f24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:09.261367 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a37bf1-487e-47ac-9a8b-f0c6b5c62f24 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:09.311438 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 917/1838] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:53:08 2022] POST /identity/v3/users => generated 296 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:53:09.313082 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a37bf1-487e-47ac-9a8b-f0c6b5c62f24 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:09.326875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a37bf1-487e-47ac-9a8b-f0c6b5c62f24 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:09.337054 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde75df-975d-4e20-ac6e-26f389eb6662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:09.337784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde75df-975d-4e20-ac6e-26f389eb6662 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:09.338110 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde75df-975d-4e20-ac6e-26f389eb6662 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:09.338430 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde75df-975d-4e20-ac6e-26f389eb6662 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:09.339213 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde75df-975d-4e20-ac6e-26f389eb6662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:09.343218 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde75df-975d-4e20-ac6e-26f389eb6662 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:09.376249 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 918/1839] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:53:09.377567 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde75df-975d-4e20-ac6e-26f389eb6662 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:09.392645 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 922/1840] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:09.401259 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde75df-975d-4e20-ac6e-26f389eb6662 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:09.403396 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd78ca-f3de-4e3f-9dbb-546d918a2c71 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:09.415904 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd368af-b1c0-4114-bd63-d71932e65bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:09.416669 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd368af-b1c0-4114-bd63-d71932e65bdc admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:09.417020 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd368af-b1c0-4114-bd63-d71932e65bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:09.417299 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd368af-b1c0-4114-bd63-d71932e65bdc admin admin] PATH_INFO: `/v3/projects/70117ded200f4dbe93c4415b9bf14f77/users/41c694138fd74fc8bc1c840551651cff/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:09.423393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:09.496733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd368af-b1c0-4114-bd63-d71932e65bdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=70117ded200f4dbe93c4415b9bf14f77, user_id=41c694138fd74fc8bc1c840551651cff, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:09.506942 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd368af-b1c0-4114-bd63-d71932e65bdc admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:09.517228 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:09.559920 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 919/1841] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:53:09 2022] PUT /identity/v3/projects/70117ded200f4dbe93c4415b9bf14f77/users/41c694138fd74fc8bc1c840551651cff/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:09.561257 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd368af-b1c0-4114-bd63-d71932e65bdc admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:09.568059 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-4dd368af-b1c0-4114-bd63-d71932e65bdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:09.647616 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd78ca-f3de-4e3f-9dbb-546d918a2c71 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:09.774504 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527b82d-ad8d-43f4-9d18-e82d15c16957 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:09.775459 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527b82d-ad8d-43f4-9d18-e82d15c16957 service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:09.775750 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527b82d-ad8d-43f4-9d18-e82d15c16957 service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:09.776031 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527b82d-ad8d-43f4-9d18-e82d15c16957 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:09.795765 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-d527b82d-ad8d-43f4-9d18-e82d15c16957 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:09.826346 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd368af-b1c0-4114-bd63-d71932e65bdc admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:09.852658 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78cef8-7328-4b3d-9008-395d933f6e6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:09.853408 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78cef8-7328-4b3d-9008-395d933f6e6b service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:09.853699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78cef8-7328-4b3d-9008-395d933f6e6b service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:09.854126 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78cef8-7328-4b3d-9008-395d933f6e6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:09.957625 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d527b82d-ad8d-43f4-9d18-e82d15c16957 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:09.965518 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d527b82d-ad8d-43f4-9d18-e82d15c16957 service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:09.992739 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78cef8-7328-4b3d-9008-395d933f6e6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:09.994588 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78cef8-7328-4b3d-9008-395d933f6e6b service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:09.998482 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 923/1842] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:53:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:53:09.999110 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527b82d-ad8d-43f4-9d18-e82d15c16957 service cinder] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:10.039998 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 920/1843] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:53:09 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:53:10.292897 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527b82d-ad8d-43f4-9d18-e82d15c16957 service cinder] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:10.299349 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1817eef-2746-493c-93b5-56a1374f83f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:10.300698 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1817eef-2746-493c-93b5-56a1374f83f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:10.301209 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1817eef-2746-493c-93b5-56a1374f83f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:10.301665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1817eef-2746-493c-93b5-56a1374f83f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:10.302751 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1817eef-2746-493c-93b5-56a1374f83f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:10.305024 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1817eef-2746-493c-93b5-56a1374f83f8 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:10.347817 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 924/1844] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:53:10.352685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78cef8-7328-4b3d-9008-395d933f6e6b service cinder] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:10.376831 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78cef8-7328-4b3d-9008-395d933f6e6b service cinder] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:10.384715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa2a2c-6f2a-45d7-b137-dc6c9297deda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:10.386069 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa2a2c-6f2a-45d7-b137-dc6c9297deda admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:10.386354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa2a2c-6f2a-45d7-b137-dc6c9297deda admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:10.386627 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa2a2c-6f2a-45d7-b137-dc6c9297deda admin admin] PATH_INFO: `/v3/projects/70117ded200f4dbe93c4415b9bf14f77/users/41c694138fd74fc8bc1c840551651cff/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:10.391363 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa2a2c-6f2a-45d7-b137-dc6c9297deda admin admin] RBAC: Authorizing `identity:create_grant(project_id=70117ded200f4dbe93c4415b9bf14f77, user_id=41c694138fd74fc8bc1c840551651cff, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:10.397840 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa2a2c-6f2a-45d7-b137-dc6c9297deda admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:10.425604 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b167247-2b97-4d9d-a480-ecdd43f6185e None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:10.425891 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b167247-2b97-4d9d-a480-ecdd43f6185e None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:10.426206 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b167247-2b97-4d9d-a480-ecdd43f6185e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:10.429528 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 921/1845] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:53:10 2022] PUT /identity/v3/projects/70117ded200f4dbe93c4415b9bf14f77/users/41c694138fd74fc8bc1c840551651cff/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:10.481182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:10.486156 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-7b167247-2b97-4d9d-a480-ecdd43f6185e None None] MFA Rules not processed for user `41c694138fd74fc8bc1c840551651cff`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:10.488843 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-7b167247-2b97-4d9d-a480-ecdd43f6185e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:10.721862 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 925/1846] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:10 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:10.879368 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa2a2c-6f2a-45d7-b137-dc6c9297deda admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:11.069067 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa2a2c-6f2a-45d7-b137-dc6c9297deda admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:11.083072 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e584429-866f-4848-aaf8-0cb8e3ffd8c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:11.085271 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e584429-866f-4848-aaf8-0cb8e3ffd8c9 service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:11.085967 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e584429-866f-4848-aaf8-0cb8e3ffd8c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:11.086917 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e584429-866f-4848-aaf8-0cb8e3ffd8c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:11.120179 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e584429-866f-4848-aaf8-0cb8e3ffd8c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:11.122593 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e584429-866f-4848-aaf8-0cb8e3ffd8c9 service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:11.158513 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 922/1847] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:53:10 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:53:11.351533 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b167247-2b97-4d9d-a480-ecdd43f6185e None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:11.367757 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b167247-2b97-4d9d-a480-ecdd43f6185e None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:11.379433 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f6aff-974d-42cc-b546-62383d31ddde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:11.380964 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f6aff-974d-42cc-b546-62383d31ddde service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:11.381518 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f6aff-974d-42cc-b546-62383d31ddde service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:11.382501 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f6aff-974d-42cc-b546-62383d31ddde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:11.533829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f6aff-974d-42cc-b546-62383d31ddde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:11.536112 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f6aff-974d-42cc-b546-62383d31ddde service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:11.550926 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 926/1848] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:53:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:53:12.801055 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e584429-866f-4848-aaf8-0cb8e3ffd8c9 service cinder] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:12.811937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e584429-866f-4848-aaf8-0cb8e3ffd8c9 service cinder] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:12.827128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c3ec6-6dde-494b-ab69-e61aed7ae146 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:12.827817 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c3ec6-6dde-494b-ab69-e61aed7ae146 service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:12.828097 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c3ec6-6dde-494b-ab69-e61aed7ae146 service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:12.828440 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c3ec6-6dde-494b-ab69-e61aed7ae146 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:12.950267 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:13.000748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c3ec6-6dde-494b-ab69-e61aed7ae146 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:13.002718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c3ec6-6dde-494b-ab69-e61aed7ae146 service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:13.022472 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 923/1849] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:53:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:53:14.435293 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f6aff-974d-42cc-b546-62383d31ddde service cinder] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:14.447320 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f6aff-974d-42cc-b546-62383d31ddde service cinder] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:14.457270 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3e74f-afd1-42c9-8c09-09025f7d53ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:14.467467 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3e74f-afd1-42c9-8c09-09025f7d53ba service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:14.468385 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3e74f-afd1-42c9-8c09-09025f7d53ba service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:14.468820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3e74f-afd1-42c9-8c09-09025f7d53ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:14.754127 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3e74f-afd1-42c9-8c09-09025f7d53ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:14.761204 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3e74f-afd1-42c9-8c09-09025f7d53ba service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:14.838898 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 927/1850] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:53:14 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:53:15.002014 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94052ab-e838-4e3b-8c46-d908f571cdaf None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:15.003947 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94052ab-e838-4e3b-8c46-d908f571cdaf None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:15.004484 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94052ab-e838-4e3b-8c46-d908f571cdaf None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:15.008915 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 924/1851] 10.222.0.39 () {54 vars in 921 bytes} [Tue Jul 26 04:53:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:53:15.105828 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b445966-1b55-4e27-98c2-4ff785b0b21f None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:15.107077 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b445966-1b55-4e27-98c2-4ff785b0b21f None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:15.108153 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b445966-1b55-4e27-98c2-4ff785b0b21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:15.211344 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-0b445966-1b55-4e27-98c2-4ff785b0b21f None None] MFA Rules not processed for user `ae8593e125da4b208dd100608aa2b462`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:15.215405 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-0b445966-1b55-4e27-98c2-4ff785b0b21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:15.439134 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:15.603230 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 928/1852] 10.222.0.39 () {58 vars in 1018 bytes} [Tue Jul 26 04:53:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 497 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:16.618892 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94052ab-e838-4e3b-8c46-d908f571cdaf None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:16.621250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-c94052ab-e838-4e3b-8c46-d908f571cdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:16.657264 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94052ab-e838-4e3b-8c46-d908f571cdaf None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:16.687649 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c29f7-9a5b-4f0e-8558-5af5fa5cfc5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:16.690885 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c29f7-9a5b-4f0e-8558-5af5fa5cfc5a service nova] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:16.691230 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c29f7-9a5b-4f0e-8558-5af5fa5cfc5a service nova] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:16.691518 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c29f7-9a5b-4f0e-8558-5af5fa5cfc5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:16.715471 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c29f7-9a5b-4f0e-8558-5af5fa5cfc5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:16.717377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c29f7-9a5b-4f0e-8558-5af5fa5cfc5a service nova] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:16.767725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 925/1853] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:53:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:53:16.814065 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102b581-afaf-490f-98bc-83cce8b7b9af None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:16.815565 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102b581-afaf-490f-98bc-83cce8b7b9af None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:16.816400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102b581-afaf-490f-98bc-83cce8b7b9af None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:16.819216 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 929/1854] 10.222.0.39 () {54 vars in 921 bytes} [Tue Jul 26 04:53:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:53:16.888893 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95beef-59dc-46e0-b835-d79eef4b8882 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:16.889715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95beef-59dc-46e0-b835-d79eef4b8882 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:16.890224 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95beef-59dc-46e0-b835-d79eef4b8882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:16.964836 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-af95beef-59dc-46e0-b835-d79eef4b8882 None None] MFA Rules not processed for user `ae8593e125da4b208dd100608aa2b462`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:16.966351 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-af95beef-59dc-46e0-b835-d79eef4b8882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:16.997047 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 926/1855] 10.222.0.39 () {58 vars in 1018 bytes} [Tue Jul 26 04:53:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:17.013288 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102b581-afaf-490f-98bc-83cce8b7b9af None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:17.046571 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102b581-afaf-490f-98bc-83cce8b7b9af None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:17.055191 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14d51ed-6aa3-4cf9-98c5-b6c11ace27db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:17.056152 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d51ed-6aa3-4cf9-98c5-b6c11ace27db service nova] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:17.057143 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d51ed-6aa3-4cf9-98c5-b6c11ace27db service nova] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:17.057637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14d51ed-6aa3-4cf9-98c5-b6c11ace27db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:17.068352 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d51ed-6aa3-4cf9-98c5-b6c11ace27db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:17.070281 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14d51ed-6aa3-4cf9-98c5-b6c11ace27db service nova] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:17.086407 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 930/1856] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:53:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:53:18.604734 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95beef-59dc-46e0-b835-d79eef4b8882 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:18.726155 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95beef-59dc-46e0-b835-d79eef4b8882 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:18.741564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29498dc9-c138-42f0-b3e3-7d8f9edba704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:18.741804 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29498dc9-c138-42f0-b3e3-7d8f9edba704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:18.742278 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29498dc9-c138-42f0-b3e3-7d8f9edba704 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:18.742717 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29498dc9-c138-42f0-b3e3-7d8f9edba704 admin admin] PATH_INFO: `/v3/users/253dd61325c44a85940140770e9694e1` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:18.744134 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29498dc9-c138-42f0-b3e3-7d8f9edba704 admin admin] RBAC: Authorizing `identity:delete_user(user_id=253dd61325c44a85940140770e9694e1)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:18.746321 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29498dc9-c138-42f0-b3e3-7d8f9edba704 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:18.838563 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-29498dc9-c138-42f0-b3e3-7d8f9edba704 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '253dd61325c44a85940140770e9694e1'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:18.863613 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-29498dc9-c138-42f0-b3e3-7d8f9edba704 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '253dd61325c44a85940140770e9694e1'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:18.882898 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-29498dc9-c138-42f0-b3e3-7d8f9edba704 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '253dd61325c44a85940140770e9694e1'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:18.893511 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-29498dc9-c138-42f0-b3e3-7d8f9edba704 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '253dd61325c44a85940140770e9694e1'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:18.894750 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-29498dc9-c138-42f0-b3e3-7d8f9edba704 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '253dd61325c44a85940140770e9694e1'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:18.905540 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 927/1857] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:53:18 2022] DELETE /identity/v3/users/253dd61325c44a85940140770e9694e1 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:18.910252 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fea28d-dbd3-4801-8dc6-70e7d9465776 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:18.911249 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fea28d-dbd3-4801-8dc6-70e7d9465776 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:18.911835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fea28d-dbd3-4801-8dc6-70e7d9465776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:18.942085 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-21fea28d-dbd3-4801-8dc6-70e7d9465776 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:18.944015 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-21fea28d-dbd3-4801-8dc6-70e7d9465776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:19.065295 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 931/1858] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:19.077043 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29498dc9-c138-42f0-b3e3-7d8f9edba704 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:19.079651 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-29498dc9-c138-42f0-b3e3-7d8f9edba704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:19.133421 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:19.169380 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29498dc9-c138-42f0-b3e3-7d8f9edba704 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:19.173478 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65a9e5-9607-49fa-81e8-3d6942a79b31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:19.174156 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65a9e5-9607-49fa-81e8-3d6942a79b31 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:19.174620 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65a9e5-9607-49fa-81e8-3d6942a79b31 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:19.174924 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65a9e5-9607-49fa-81e8-3d6942a79b31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:19.187573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65a9e5-9607-49fa-81e8-3d6942a79b31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:19.189037 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b65a9e5-9607-49fa-81e8-3d6942a79b31 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:19.202441 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 928/1859] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:53:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:53:19.807547 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fea28d-dbd3-4801-8dc6-70e7d9465776 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:19.809467 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-21fea28d-dbd3-4801-8dc6-70e7d9465776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:19.825586 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fea28d-dbd3-4801-8dc6-70e7d9465776 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:19.832760 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc88a1-bf35-4786-a878-2ae31ae357e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:19.833803 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc88a1-bf35-4786-a878-2ae31ae357e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:19.834294 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc88a1-bf35-4786-a878-2ae31ae357e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:19.834826 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc88a1-bf35-4786-a878-2ae31ae357e3 admin admin] PATH_INFO: `/v3/users/1118f68143564baba3eb399a7e155a87` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:19.837077 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc88a1-bf35-4786-a878-2ae31ae357e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1118f68143564baba3eb399a7e155a87)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:19.839502 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc88a1-bf35-4786-a878-2ae31ae357e3 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:19.853615 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65a9e5-9607-49fa-81e8-3d6942a79b31 service neutron] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:19.857547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-6b65a9e5-9607-49fa-81e8-3d6942a79b31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:19.882653 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65a9e5-9607-49fa-81e8-3d6942a79b31 service neutron] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:19.900260 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5ae9b-5654-419e-afd7-59018edfb410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:19.901820 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5ae9b-5654-419e-afd7-59018edfb410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:19.902403 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5ae9b-5654-419e-afd7-59018edfb410 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:19.903947 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5ae9b-5654-419e-afd7-59018edfb410 admin admin] PATH_INFO: `/v3/projects/19341ab6d3ed4ceea629a6e6db55bf34` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:19.908862 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5ae9b-5654-419e-afd7-59018edfb410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19341ab6d3ed4ceea629a6e6db55bf34)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:19.914113 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5ae9b-5654-419e-afd7-59018edfb410 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:19.921570 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-88fc88a1-bf35-4786-a878-2ae31ae357e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1118f68143564baba3eb399a7e155a87'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:19.923311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-88fc88a1-bf35-4786-a878-2ae31ae357e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1118f68143564baba3eb399a7e155a87'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:19.939048 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-88fc88a1-bf35-4786-a878-2ae31ae357e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1118f68143564baba3eb399a7e155a87'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:19.997300 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-88fc88a1-bf35-4786-a878-2ae31ae357e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1118f68143564baba3eb399a7e155a87'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:20.027792 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-88fc88a1-bf35-4786-a878-2ae31ae357e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1118f68143564baba3eb399a7e155a87'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:20.053663 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 932/1860] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:53:19 2022] DELETE /identity/v3/users/1118f68143564baba3eb399a7e155a87 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:20.059223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8e51a-7f3e-409e-bc71-928062726385 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:20.059518 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8e51a-7f3e-409e-bc71-928062726385 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:20.059798 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8e51a-7f3e-409e-bc71-928062726385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:20.095010 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-90e5ae9b-5654-419e-afd7-59018edfb410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19341ab6d3ed4ceea629a6e6db55bf34', 'request_id': 'req-90e5ae9b-5654-419e-afd7-59018edfb410'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:20.105305 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-90e5ae9b-5654-419e-afd7-59018edfb410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19341ab6d3ed4ceea629a6e6db55bf34', 'request_id': 'req-90e5ae9b-5654-419e-afd7-59018edfb410'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:20.115710 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-90e5ae9b-5654-419e-afd7-59018edfb410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19341ab6d3ed4ceea629a6e6db55bf34', 'request_id': 'req-90e5ae9b-5654-419e-afd7-59018edfb410'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:20.119960 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-a4b8e51a-7f3e-409e-bc71-928062726385 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:20.121257 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-a4b8e51a-7f3e-409e-bc71-928062726385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:20.150778 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-90e5ae9b-5654-419e-afd7-59018edfb410 admin admin] The token cache is being invalidate because project 19341ab6d3ed4ceea629a6e6db55bf34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:53:20.151076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-90e5ae9b-5654-419e-afd7-59018edfb410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:20.152210 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-90e5ae9b-5654-419e-afd7-59018edfb410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:20.154270 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 929/1861] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:53:19 2022] DELETE /identity/v3/projects/19341ab6d3ed4ceea629a6e6db55bf34 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:53:20.158363 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5ae9b-5654-419e-afd7-59018edfb410 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:20.159019 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:20.168463 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-90e5ae9b-5654-419e-afd7-59018edfb410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:20.240550 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 933/1862] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:20.261630 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5ae9b-5654-419e-afd7-59018edfb410 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:20.273008 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876dbe5-8f87-4c7d-b10a-4f388655c839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:20.273908 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876dbe5-8f87-4c7d-b10a-4f388655c839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:20.274487 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876dbe5-8f87-4c7d-b10a-4f388655c839 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:20.274975 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876dbe5-8f87-4c7d-b10a-4f388655c839 admin admin] PATH_INFO: `/v3/users/4e9436b20b444923b8e041e01fa7bfc7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:20.276803 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876dbe5-8f87-4c7d-b10a-4f388655c839 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e9436b20b444923b8e041e01fa7bfc7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:20.277884 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8e51a-7f3e-409e-bc71-928062726385 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:20.280117 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876dbe5-8f87-4c7d-b10a-4f388655c839 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:20.291887 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-a4b8e51a-7f3e-409e-bc71-928062726385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:20.386923 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-1876dbe5-8f87-4c7d-b10a-4f388655c839 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e9436b20b444923b8e041e01fa7bfc7'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:20.402404 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-1876dbe5-8f87-4c7d-b10a-4f388655c839 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e9436b20b444923b8e041e01fa7bfc7'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:20.420615 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8e51a-7f3e-409e-bc71-928062726385 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:20.422525 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:20.426750 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb12b2c-653c-4035-a1c3-5b943ac18c4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:20.427765 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb12b2c-653c-4035-a1c3-5b943ac18c4e service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:20.428124 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb12b2c-653c-4035-a1c3-5b943ac18c4e service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:20.428602 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb12b2c-653c-4035-a1c3-5b943ac18c4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:20.438637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-1876dbe5-8f87-4c7d-b10a-4f388655c839 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e9436b20b444923b8e041e01fa7bfc7'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:20.442878 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb12b2c-653c-4035-a1c3-5b943ac18c4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:20.446232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb12b2c-653c-4035-a1c3-5b943ac18c4e service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:20.451419 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-1876dbe5-8f87-4c7d-b10a-4f388655c839 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e9436b20b444923b8e041e01fa7bfc7'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:20.452868 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-1876dbe5-8f87-4c7d-b10a-4f388655c839 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e9436b20b444923b8e041e01fa7bfc7'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:20.461454 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 934/1863] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:53:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:53:20.473433 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 930/1864] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:53:20 2022] DELETE /identity/v3/users/4e9436b20b444923b8e041e01fa7bfc7 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:20.672211 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb12b2c-653c-4035-a1c3-5b943ac18c4e service neutron] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:20.673784 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-7fb12b2c-653c-4035-a1c3-5b943ac18c4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:20.691732 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb12b2c-653c-4035-a1c3-5b943ac18c4e service neutron] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:20.776250 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a853f2-8424-4873-9a60-c7dd7e485ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:20.777058 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a853f2-8424-4873-9a60-c7dd7e485ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:20.777440 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a853f2-8424-4873-9a60-c7dd7e485ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:20.777817 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a853f2-8424-4873-9a60-c7dd7e485ff9 admin admin] PATH_INFO: `/v3/users/adaf03659e3941039c09dea2dc2c547e` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:20.782057 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a853f2-8424-4873-9a60-c7dd7e485ff9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adaf03659e3941039c09dea2dc2c547e)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:20.784309 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a853f2-8424-4873-9a60-c7dd7e485ff9 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:20.873439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-24a853f2-8424-4873-9a60-c7dd7e485ff9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adaf03659e3941039c09dea2dc2c547e'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:20.877829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-24a853f2-8424-4873-9a60-c7dd7e485ff9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adaf03659e3941039c09dea2dc2c547e'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:20.891451 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-24a853f2-8424-4873-9a60-c7dd7e485ff9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adaf03659e3941039c09dea2dc2c547e'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:20.910640 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:20.922224 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-24a853f2-8424-4873-9a60-c7dd7e485ff9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adaf03659e3941039c09dea2dc2c547e'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:20.939024 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-24a853f2-8424-4873-9a60-c7dd7e485ff9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adaf03659e3941039c09dea2dc2c547e'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:20.947769 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 935/1865] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:53:20 2022] DELETE /identity/v3/users/adaf03659e3941039c09dea2dc2c547e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:20.952598 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691c579-1498-4e38-9963-37be3c006848 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:20.953447 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691c579-1498-4e38-9963-37be3c006848 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:20.953734 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691c579-1498-4e38-9963-37be3c006848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:20.978141 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-c691c579-1498-4e38-9963-37be3c006848 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:20.979893 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-c691c579-1498-4e38-9963-37be3c006848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:21.086085 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 931/1866] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:21.117579 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a853f2-8424-4873-9a60-c7dd7e485ff9 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:21.119729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-24a853f2-8424-4873-9a60-c7dd7e485ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:21.198153 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a853f2-8424-4873-9a60-c7dd7e485ff9 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:21.203245 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c8f85-a00a-4e19-b80e-86a6c4ceb35c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:21.204047 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c8f85-a00a-4e19-b80e-86a6c4ceb35c service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:21.204618 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c8f85-a00a-4e19-b80e-86a6c4ceb35c service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:21.205014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c8f85-a00a-4e19-b80e-86a6c4ceb35c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:21.219098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c8f85-a00a-4e19-b80e-86a6c4ceb35c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:21.220920 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c8f85-a00a-4e19-b80e-86a6c4ceb35c service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:21.234164 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 936/1867] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:53:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:53:21.320190 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691c579-1498-4e38-9963-37be3c006848 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:21.321726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-c691c579-1498-4e38-9963-37be3c006848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:21.335174 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691c579-1498-4e38-9963-37be3c006848 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:21.342494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26614d38-a85f-422a-a9a1-c29676814918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:21.343357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26614d38-a85f-422a-a9a1-c29676814918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:21.343837 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26614d38-a85f-422a-a9a1-c29676814918 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:21.344137 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26614d38-a85f-422a-a9a1-c29676814918 admin admin] PATH_INFO: `/v3/projects/a29398a38ea547918087aa0f95d58df6` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:21.345626 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26614d38-a85f-422a-a9a1-c29676814918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a29398a38ea547918087aa0f95d58df6)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:21.347763 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26614d38-a85f-422a-a9a1-c29676814918 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:21.452165 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-26614d38-a85f-422a-a9a1-c29676814918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a29398a38ea547918087aa0f95d58df6', 'request_id': 'req-26614d38-a85f-422a-a9a1-c29676814918'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:21.465078 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-26614d38-a85f-422a-a9a1-c29676814918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a29398a38ea547918087aa0f95d58df6', 'request_id': 'req-26614d38-a85f-422a-a9a1-c29676814918'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:21.476796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-26614d38-a85f-422a-a9a1-c29676814918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a29398a38ea547918087aa0f95d58df6', 'request_id': 'req-26614d38-a85f-422a-a9a1-c29676814918'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:21.496309 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-26614d38-a85f-422a-a9a1-c29676814918 admin admin] The token cache is being invalidate because project a29398a38ea547918087aa0f95d58df6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:53:21.496658 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-26614d38-a85f-422a-a9a1-c29676814918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:21.498603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-26614d38-a85f-422a-a9a1-c29676814918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:21.501126 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 932/1868] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:53:21 2022] DELETE /identity/v3/projects/a29398a38ea547918087aa0f95d58df6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:21.507222 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d05afe-a6cd-4c27-bfd8-0e54c778b18e None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:21.508238 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d05afe-a6cd-4c27-bfd8-0e54c778b18e None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:21.508528 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d05afe-a6cd-4c27-bfd8-0e54c778b18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:21.542226 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-a3d05afe-a6cd-4c27-bfd8-0e54c778b18e None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:21.543101 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-a3d05afe-a6cd-4c27-bfd8-0e54c778b18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:21.740260 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 937/1869] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:21.748707 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52379f89-ecf9-42ca-a390-493b91187c61 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:21.748707 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52379f89-ecf9-42ca-a390-493b91187c61 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:21.748707 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52379f89-ecf9-42ca-a390-493b91187c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:21.780634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d05afe-a6cd-4c27-bfd8-0e54c778b18e None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:21.782111 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-a3d05afe-a6cd-4c27-bfd8-0e54c778b18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:21.800207 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d05afe-a6cd-4c27-bfd8-0e54c778b18e None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:21.807794 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-52379f89-ecf9-42ca-a390-493b91187c61 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:21.810086 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-52379f89-ecf9-42ca-a390-493b91187c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:21.832033 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 933/1870] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:21.833267 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52379f89-ecf9-42ca-a390-493b91187c61 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:21.847025 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52379f89-ecf9-42ca-a390-493b91187c61 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:21.849366 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235b0af-4ef8-4009-a10e-143cadce0e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:21.850053 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235b0af-4ef8-4009-a10e-143cadce0e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:21.850337 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235b0af-4ef8-4009-a10e-143cadce0e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:21.850609 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235b0af-4ef8-4009-a10e-143cadce0e63 admin admin] PATH_INFO: `/v3/projects/7c50eb39d37e4158847ae1bd1f0715f4` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:21.855287 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78378ec0-ff2b-4fd3-9a98-6a8481f94d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:21.855771 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235b0af-4ef8-4009-a10e-143cadce0e63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c50eb39d37e4158847ae1bd1f0715f4)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:21.856222 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78378ec0-ff2b-4fd3-9a98-6a8481f94d10 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:21.856789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78378ec0-ff2b-4fd3-9a98-6a8481f94d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:21.857189 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78378ec0-ff2b-4fd3-9a98-6a8481f94d10 admin admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:21.857925 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235b0af-4ef8-4009-a10e-143cadce0e63 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:21.859066 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78378ec0-ff2b-4fd3-9a98-6a8481f94d10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:53:21.859455 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78378ec0-ff2b-4fd3-9a98-6a8481f94d10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:21.861245 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78378ec0-ff2b-4fd3-9a98-6a8481f94d10 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:21.883344 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 934/1871] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:53:21.884483 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78378ec0-ff2b-4fd3-9a98-6a8481f94d10 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:21.905586 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78378ec0-ff2b-4fd3-9a98-6a8481f94d10 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:21.912697 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260880b-a054-4315-a1df-69f22c1e0e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:21.913414 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260880b-a054-4315-a1df-69f22c1e0e6f admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:21.913699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260880b-a054-4315-a1df-69f22c1e0e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:21.914904 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260880b-a054-4315-a1df-69f22c1e0e6f admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:21.915537 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260880b-a054-4315-a1df-69f22c1e0e6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:21.918489 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260880b-a054-4315-a1df-69f22c1e0e6f admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:21.977273 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 935/1872] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:53:21 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:53:21.979237 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260880b-a054-4315-a1df-69f22c1e0e6f admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:21.990888 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2235b0af-4ef8-4009-a10e-143cadce0e63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c50eb39d37e4158847ae1bd1f0715f4', 'request_id': 'req-2235b0af-4ef8-4009-a10e-143cadce0e63'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:22.011517 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2235b0af-4ef8-4009-a10e-143cadce0e63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c50eb39d37e4158847ae1bd1f0715f4', 'request_id': 'req-2235b0af-4ef8-4009-a10e-143cadce0e63'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:22.023034 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2235b0af-4ef8-4009-a10e-143cadce0e63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c50eb39d37e4158847ae1bd1f0715f4', 'request_id': 'req-2235b0af-4ef8-4009-a10e-143cadce0e63'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:22.036448 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:22.047810 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2235b0af-4ef8-4009-a10e-143cadce0e63 admin admin] The token cache is being invalidate because project 7c50eb39d37e4158847ae1bd1f0715f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:53:22.048358 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2235b0af-4ef8-4009-a10e-143cadce0e63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:22.049393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2235b0af-4ef8-4009-a10e-143cadce0e63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:22.054564 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 938/1873] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:53:21 2022] DELETE /identity/v3/projects/7c50eb39d37e4158847ae1bd1f0715f4 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:22.055758 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235b0af-4ef8-4009-a10e-143cadce0e63 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:22.057419 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-2235b0af-4ef8-4009-a10e-143cadce0e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:22.071575 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:22.107848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260880b-a054-4315-a1df-69f22c1e0e6f admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:22.114280 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9ecc6-99b5-4503-aa11-16528b718f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:22.114933 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9ecc6-99b5-4503-aa11-16528b718f27 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:22.115216 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9ecc6-99b5-4503-aa11-16528b718f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:22.115600 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9ecc6-99b5-4503-aa11-16528b718f27 admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:22.116281 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d9ecc6-99b5-4503-aa11-16528b718f27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:22.118632 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d9ecc6-99b5-4503-aa11-16528b718f27 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:22.149297 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235b0af-4ef8-4009-a10e-143cadce0e63 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:22.156179 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95bcefc-bfdf-48e9-a7b9-162a84fedf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:22.157206 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bcefc-bfdf-48e9-a7b9-162a84fedf46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:22.157536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bcefc-bfdf-48e9-a7b9-162a84fedf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:22.157838 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bcefc-bfdf-48e9-a7b9-162a84fedf46 admin admin] PATH_INFO: `/v3/users/41c694138fd74fc8bc1c840551651cff` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:22.159094 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95bcefc-bfdf-48e9-a7b9-162a84fedf46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41c694138fd74fc8bc1c840551651cff)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:22.161414 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95bcefc-bfdf-48e9-a7b9-162a84fedf46 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:22.170537 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 936/1874] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:53:21 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:53:22.176141 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9ecc6-99b5-4503-aa11-16528b718f27 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:22.178951 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-94d9ecc6-99b5-4503-aa11-16528b718f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:22.202960 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9ecc6-99b5-4503-aa11-16528b718f27 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:22.213761 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bfee85-cd0d-4436-86b0-fc51722494e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:22.217226 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfee85-cd0d-4436-86b0-fc51722494e8 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:22.218395 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfee85-cd0d-4436-86b0-fc51722494e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:22.219029 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bfee85-cd0d-4436-86b0-fc51722494e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:22.220683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bfee85-cd0d-4436-86b0-fc51722494e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:22.225317 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bfee85-cd0d-4436-86b0-fc51722494e8 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:22.228904 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-f95bcefc-bfdf-48e9-a7b9-162a84fedf46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41c694138fd74fc8bc1c840551651cff'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:22.229856 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-f95bcefc-bfdf-48e9-a7b9-162a84fedf46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41c694138fd74fc8bc1c840551651cff'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:22.241313 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-f95bcefc-bfdf-48e9-a7b9-162a84fedf46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41c694138fd74fc8bc1c840551651cff'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:22.246225 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 937/1875] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:53:22.252182 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bfee85-cd0d-4436-86b0-fc51722494e8 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:22.257920 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-f95bcefc-bfdf-48e9-a7b9-162a84fedf46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41c694138fd74fc8bc1c840551651cff'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:22.269246 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-f95bcefc-bfdf-48e9-a7b9-162a84fedf46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41c694138fd74fc8bc1c840551651cff'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:22.275902 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bfee85-cd0d-4436-86b0-fc51722494e8 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:22.281751 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 939/1876] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:53:22 2022] DELETE /identity/v3/users/41c694138fd74fc8bc1c840551651cff => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:22.376453 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ddd34-b4d0-4605-8ea3-c39d93ffd694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:22.378633 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ddd34-b4d0-4605-8ea3-c39d93ffd694 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:22.378916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ddd34-b4d0-4605-8ea3-c39d93ffd694 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:22.379195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ddd34-b4d0-4605-8ea3-c39d93ffd694 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:22.381876 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ddd34-b4d0-4605-8ea3-c39d93ffd694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:22.383559 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ddd34-b4d0-4605-8ea3-c39d93ffd694 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:22.410225 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 938/1877] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:53:22.415953 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95bcefc-bfdf-48e9-a7b9-162a84fedf46 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:22.417500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-f95bcefc-bfdf-48e9-a7b9-162a84fedf46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:22.440978 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95bcefc-bfdf-48e9-a7b9-162a84fedf46 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:22.453943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48dbde-c51d-4e7b-9439-f382c7ee65cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:22.455104 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48dbde-c51d-4e7b-9439-f382c7ee65cb admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:22.455282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48dbde-c51d-4e7b-9439-f382c7ee65cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:22.455581 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48dbde-c51d-4e7b-9439-f382c7ee65cb admin admin] PATH_INFO: `/v3/projects/44a0e736bd8247b89d28a367c1abbe95/users/c8f41c07be5c4b798da450b31b05817b/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:22.494396 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48dbde-c51d-4e7b-9439-f382c7ee65cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=44a0e736bd8247b89d28a367c1abbe95, user_id=c8f41c07be5c4b798da450b31b05817b, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:22.497126 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48dbde-c51d-4e7b-9439-f382c7ee65cb admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:22.528455 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 940/1878] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:53:22 2022] PUT /identity/v3/projects/44a0e736bd8247b89d28a367c1abbe95/users/c8f41c07be5c4b798da450b31b05817b/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:53:22.551762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204bd65-6f66-48e9-a636-9f67bd21d6a1 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:22.552377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204bd65-6f66-48e9-a636-9f67bd21d6a1 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:22.552993 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204bd65-6f66-48e9-a636-9f67bd21d6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:22.573316 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48dbde-c51d-4e7b-9439-f382c7ee65cb admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:22.575212 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-9b48dbde-c51d-4e7b-9439-f382c7ee65cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:22.617407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-f204bd65-6f66-48e9-a636-9f67bd21d6a1 None None] MFA Rules not processed for user `c8f41c07be5c4b798da450b31b05817b`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:22.620268 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-f204bd65-6f66-48e9-a636-9f67bd21d6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:22.700761 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48dbde-c51d-4e7b-9439-f382c7ee65cb admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:22.720787 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906dd2f-f932-43f8-92ee-71fed4e60e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:22.723988 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906dd2f-f932-43f8-92ee-71fed4e60e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:22.724530 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906dd2f-f932-43f8-92ee-71fed4e60e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:22.725335 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906dd2f-f932-43f8-92ee-71fed4e60e88 admin admin] PATH_INFO: `/v3/projects/3327cd6a830b427eaec80f8609173376` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:22.730380 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906dd2f-f932-43f8-92ee-71fed4e60e88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3327cd6a830b427eaec80f8609173376)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:22.733776 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906dd2f-f932-43f8-92ee-71fed4e60e88 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:22.750029 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:22.838871 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 939/1879] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:53:22.843323 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204bd65-6f66-48e9-a636-9f67bd21d6a1 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:22.872148 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204bd65-6f66-48e9-a636-9f67bd21d6a1 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:22.888878 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2906dd2f-f932-43f8-92ee-71fed4e60e88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3327cd6a830b427eaec80f8609173376', 'request_id': 'req-2906dd2f-f932-43f8-92ee-71fed4e60e88'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:22.903894 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2906dd2f-f932-43f8-92ee-71fed4e60e88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3327cd6a830b427eaec80f8609173376', 'request_id': 'req-2906dd2f-f932-43f8-92ee-71fed4e60e88'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:22.920614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2906dd2f-f932-43f8-92ee-71fed4e60e88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3327cd6a830b427eaec80f8609173376', 'request_id': 'req-2906dd2f-f932-43f8-92ee-71fed4e60e88'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:22.945278 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2906dd2f-f932-43f8-92ee-71fed4e60e88 admin admin] The token cache is being invalidate because project 3327cd6a830b427eaec80f8609173376 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:53:22.945822 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2906dd2f-f932-43f8-92ee-71fed4e60e88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:22.947579 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2906dd2f-f932-43f8-92ee-71fed4e60e88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:22.952207 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 941/1880] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:53:22 2022] DELETE /identity/v3/projects/3327cd6a830b427eaec80f8609173376 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:53:22.958607 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906dd2f-f932-43f8-92ee-71fed4e60e88 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:22.958996 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:22.962179 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-2906dd2f-f932-43f8-92ee-71fed4e60e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:23.041601 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4feff-1303-4c6d-8b2f-9c0335f16d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:23.042279 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4feff-1303-4c6d-8b2f-9c0335f16d98 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:23.042735 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4feff-1303-4c6d-8b2f-9c0335f16d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:23.043016 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4feff-1303-4c6d-8b2f-9c0335f16d98 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:23.043699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4feff-1303-4c6d-8b2f-9c0335f16d98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:23.045637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4feff-1303-4c6d-8b2f-9c0335f16d98 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:23.085411 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906dd2f-f932-43f8-92ee-71fed4e60e88 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:23.093055 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987c3ff-af7c-4ef3-b99d-d923b2a9a67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:23.094067 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987c3ff-af7c-4ef3-b99d-d923b2a9a67f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:23.094438 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987c3ff-af7c-4ef3-b99d-d923b2a9a67f admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:23.094815 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987c3ff-af7c-4ef3-b99d-d923b2a9a67f admin admin] PATH_INFO: `/v3/users/bc3a33a5b5744703b53ae6ca16733d48` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:23.095519 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 940/1881] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:53:22 2022] POST /identity/v3/projects => generated 387 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:53:23.099543 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987c3ff-af7c-4ef3-b99d-d923b2a9a67f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc3a33a5b5744703b53ae6ca16733d48)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:23.099717 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4feff-1303-4c6d-8b2f-9c0335f16d98 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:23.101621 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987c3ff-af7c-4ef3-b99d-d923b2a9a67f admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:23.101960 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-38a4feff-1303-4c6d-8b2f-9c0335f16d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:23.168110 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-0987c3ff-af7c-4ef3-b99d-d923b2a9a67f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc3a33a5b5744703b53ae6ca16733d48'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:23.168924 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-0987c3ff-af7c-4ef3-b99d-d923b2a9a67f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc3a33a5b5744703b53ae6ca16733d48'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:23.183016 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-0987c3ff-af7c-4ef3-b99d-d923b2a9a67f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc3a33a5b5744703b53ae6ca16733d48'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:23.226033 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-0987c3ff-af7c-4ef3-b99d-d923b2a9a67f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc3a33a5b5744703b53ae6ca16733d48'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:23.242198 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-0987c3ff-af7c-4ef3-b99d-d923b2a9a67f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc3a33a5b5744703b53ae6ca16733d48'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:23.266438 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 942/1882] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:53:22 2022] DELETE /identity/v3/users/bc3a33a5b5744703b53ae6ca16733d48 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:23.282631 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4feff-1303-4c6d-8b2f-9c0335f16d98 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:23.397361 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c6cac-6011-426b-81b3-e006b3b1c50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:23.398050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c6cac-6011-426b-81b3-e006b3b1c50d admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:23.398342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c6cac-6011-426b-81b3-e006b3b1c50d admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:23.398618 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c6cac-6011-426b-81b3-e006b3b1c50d admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:23.399585 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c6cac-6011-426b-81b3-e006b3b1c50d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:23.401777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c6cac-6011-426b-81b3-e006b3b1c50d admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:23.430526 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 941/1883] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:53:23 2022] POST /identity/v3/users => generated 300 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:53:23.434688 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987c3ff-af7c-4ef3-b99d-d923b2a9a67f admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:23.437543 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-0987c3ff-af7c-4ef3-b99d-d923b2a9a67f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:23.461407 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987c3ff-af7c-4ef3-b99d-d923b2a9a67f admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:23.481800 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb97666-0625-4f79-b081-cb85cbdc5dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:23.482872 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb97666-0625-4f79-b081-cb85cbdc5dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:23.483381 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb97666-0625-4f79-b081-cb85cbdc5dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:23.483754 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb97666-0625-4f79-b081-cb85cbdc5dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:23.484722 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb97666-0625-4f79-b081-cb85cbdc5dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:23.487189 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb97666-0625-4f79-b081-cb85cbdc5dc7 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:23.506382 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 943/1884] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:53:23.510650 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c6cac-6011-426b-81b3-e006b3b1c50d admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:23.524510 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c6cac-6011-426b-81b3-e006b3b1c50d admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:23.530463 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6619a-ac52-42ac-b235-08b6bcb55263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:23.531050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6619a-ac52-42ac-b235-08b6bcb55263 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:23.531326 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6619a-ac52-42ac-b235-08b6bcb55263 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:23.532269 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6619a-ac52-42ac-b235-08b6bcb55263 admin admin] PATH_INFO: `/v3/projects/7ca331b95ec94e6b910089d970d6a731/users/f996cddc8ea34397ad5af0fbf64ceaf5/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:23.551890 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6619a-ac52-42ac-b235-08b6bcb55263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ca331b95ec94e6b910089d970d6a731, user_id=f996cddc8ea34397ad5af0fbf64ceaf5, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:23.555215 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6619a-ac52-42ac-b235-08b6bcb55263 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:23.574784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 942/1885] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:53:23 2022] PUT /identity/v3/projects/7ca331b95ec94e6b910089d970d6a731/users/f996cddc8ea34397ad5af0fbf64ceaf5/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:23.578912 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb97666-0625-4f79-b081-cb85cbdc5dc7 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:23.587459 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:23.593510 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb97666-0625-4f79-b081-cb85cbdc5dc7 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:23.629277 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6619a-ac52-42ac-b235-08b6bcb55263 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:23.631301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-9fc6619a-ac52-42ac-b235-08b6bcb55263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:23.688532 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:23.718065 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db278f-48cd-43ef-8616-74a079de4e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:23.719396 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db278f-48cd-43ef-8616-74a079de4e3d admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:23.719396 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db278f-48cd-43ef-8616-74a079de4e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:23.719749 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db278f-48cd-43ef-8616-74a079de4e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:23.720568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db278f-48cd-43ef-8616-74a079de4e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:23.723413 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db278f-48cd-43ef-8616-74a079de4e3d admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:23.743332 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 944/1886] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:53:23.746415 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db278f-48cd-43ef-8616-74a079de4e3d admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:23.758455 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db278f-48cd-43ef-8616-74a079de4e3d admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:23.767178 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00fc85-1072-41a0-b34f-3f52f84462b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:23.768185 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00fc85-1072-41a0-b34f-3f52f84462b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:23.768476 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00fc85-1072-41a0-b34f-3f52f84462b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:23.768752 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00fc85-1072-41a0-b34f-3f52f84462b7 admin admin] PATH_INFO: `/v3/projects/7ca331b95ec94e6b910089d970d6a731/users/f996cddc8ea34397ad5af0fbf64ceaf5/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:23.772815 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00fc85-1072-41a0-b34f-3f52f84462b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ca331b95ec94e6b910089d970d6a731, user_id=f996cddc8ea34397ad5af0fbf64ceaf5, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:23.776680 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00fc85-1072-41a0-b34f-3f52f84462b7 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:23.789340 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6619a-ac52-42ac-b235-08b6bcb55263 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:23.792461 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 945/1887] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:53:23 2022] PUT /identity/v3/projects/7ca331b95ec94e6b910089d970d6a731/users/f996cddc8ea34397ad5af0fbf64ceaf5/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:53:23.814027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022dff7b-5df8-4c07-96ff-7533d8537c3e None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:23.814027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022dff7b-5df8-4c07-96ff-7533d8537c3e None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:23.814027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022dff7b-5df8-4c07-96ff-7533d8537c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:23.882575 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-022dff7b-5df8-4c07-96ff-7533d8537c3e None None] MFA Rules not processed for user `f996cddc8ea34397ad5af0fbf64ceaf5`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:23.883829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-022dff7b-5df8-4c07-96ff-7533d8537c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:23.959102 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75e92f-c581-40e5-af64-d66f4ebc8082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:23.959790 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75e92f-c581-40e5-af64-d66f4ebc8082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:23.960075 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75e92f-c581-40e5-af64-d66f4ebc8082 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:23.960354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75e92f-c581-40e5-af64-d66f4ebc8082 admin admin] PATH_INFO: `/v3/projects/684de9d75e8648718ccb2e36b394affc` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:23.964362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75e92f-c581-40e5-af64-d66f4ebc8082 admin admin] RBAC: Authorizing `identity:delete_project(project_id=684de9d75e8648718ccb2e36b394affc)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:23.966377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75e92f-c581-40e5-af64-d66f4ebc8082 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:24.049641 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 946/1888] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:53:24.050848 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022dff7b-5df8-4c07-96ff-7533d8537c3e None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:24.057527 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-022dff7b-5df8-4c07-96ff-7533d8537c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:24.095034 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022dff7b-5df8-4c07-96ff-7533d8537c3e None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:24.104949 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2c75e92f-c581-40e5-af64-d66f4ebc8082 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '684de9d75e8648718ccb2e36b394affc', 'request_id': 'req-2c75e92f-c581-40e5-af64-d66f4ebc8082'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:24.128168 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2c75e92f-c581-40e5-af64-d66f4ebc8082 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '684de9d75e8648718ccb2e36b394affc', 'request_id': 'req-2c75e92f-c581-40e5-af64-d66f4ebc8082'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:24.144957 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2c75e92f-c581-40e5-af64-d66f4ebc8082 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '684de9d75e8648718ccb2e36b394affc', 'request_id': 'req-2c75e92f-c581-40e5-af64-d66f4ebc8082'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:24.164782 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2c75e92f-c581-40e5-af64-d66f4ebc8082 admin admin] The token cache is being invalidate because project 684de9d75e8648718ccb2e36b394affc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:53:24.165080 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2c75e92f-c581-40e5-af64-d66f4ebc8082 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:24.165797 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2c75e92f-c581-40e5-af64-d66f4ebc8082 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:24.167823 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 943/1889] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:53:23 2022] DELETE /identity/v3/projects/684de9d75e8648718ccb2e36b394affc => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:53:24.168640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75e92f-c581-40e5-af64-d66f4ebc8082 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:24.170108 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-2c75e92f-c581-40e5-af64-d66f4ebc8082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:24.243412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca9f2b-71ba-4946-a002-eea6d2deccfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:24.245191 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca9f2b-71ba-4946-a002-eea6d2deccfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:24.245634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca9f2b-71ba-4946-a002-eea6d2deccfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:24.246088 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca9f2b-71ba-4946-a002-eea6d2deccfd admin admin] PATH_INFO: `/v3/projects/70117ded200f4dbe93c4415b9bf14f77` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:24.247832 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca9f2b-71ba-4946-a002-eea6d2deccfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=70117ded200f4dbe93c4415b9bf14f77)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:24.250288 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbca9f2b-71ba-4946-a002-eea6d2deccfd admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:24.296574 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:24.300058 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75e92f-c581-40e5-af64-d66f4ebc8082 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:24.303806 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47493b02-b5a9-4714-b0fc-47189d630b1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:24.304459 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47493b02-b5a9-4714-b0fc-47189d630b1a service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:24.304739 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47493b02-b5a9-4714-b0fc-47189d630b1a service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:24.305012 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47493b02-b5a9-4714-b0fc-47189d630b1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:24.306945 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-47493b02-b5a9-4714-b0fc-47189d630b1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:24.326327 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:24.340937 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-cbca9f2b-71ba-4946-a002-eea6d2deccfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70117ded200f4dbe93c4415b9bf14f77', 'request_id': 'req-cbca9f2b-71ba-4946-a002-eea6d2deccfd'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:24.353721 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-cbca9f2b-71ba-4946-a002-eea6d2deccfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70117ded200f4dbe93c4415b9bf14f77', 'request_id': 'req-cbca9f2b-71ba-4946-a002-eea6d2deccfd'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:24.364515 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-cbca9f2b-71ba-4946-a002-eea6d2deccfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70117ded200f4dbe93c4415b9bf14f77', 'request_id': 'req-cbca9f2b-71ba-4946-a002-eea6d2deccfd'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:24.383603 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-cbca9f2b-71ba-4946-a002-eea6d2deccfd admin admin] The token cache is being invalidate because project 70117ded200f4dbe93c4415b9bf14f77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:53:24.384096 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-cbca9f2b-71ba-4946-a002-eea6d2deccfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:24.384950 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-cbca9f2b-71ba-4946-a002-eea6d2deccfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:24.395952 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 947/1890] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:53:24 2022] DELETE /identity/v3/projects/70117ded200f4dbe93c4415b9bf14f77 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:24.399615 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca9f2b-71ba-4946-a002-eea6d2deccfd admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:24.403340 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-cbca9f2b-71ba-4946-a002-eea6d2deccfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:24.406184 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47493b02-b5a9-4714-b0fc-47189d630b1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:24.409187 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47493b02-b5a9-4714-b0fc-47189d630b1a service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:24.437246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 944/1891] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:53:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:53:24.439595 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53fcfa-edea-4598-b205-de7e0300cb79 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:24.440154 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53fcfa-edea-4598-b205-de7e0300cb79 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:24.440759 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53fcfa-edea-4598-b205-de7e0300cb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:24.497938 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-2e53fcfa-edea-4598-b205-de7e0300cb79 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:24.500140 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-2e53fcfa-edea-4598-b205-de7e0300cb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:24.659003 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca9f2b-71ba-4946-a002-eea6d2deccfd admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:24.682356 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3840025-23d1-4a41-8bae-66914f2acb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:24.683422 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3840025-23d1-4a41-8bae-66914f2acb34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:24.683908 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3840025-23d1-4a41-8bae-66914f2acb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:24.684374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3840025-23d1-4a41-8bae-66914f2acb34 admin admin] PATH_INFO: `/v3/users/e3f94a2bc46e4fb0b2bd8197bfc1cbdc` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:24.689228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3840025-23d1-4a41-8bae-66914f2acb34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3f94a2bc46e4fb0b2bd8197bfc1cbdc)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:24.693512 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3840025-23d1-4a41-8bae-66914f2acb34 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:24.790103 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 945/1892] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:24.790103 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21557aa3-ee67-424b-899e-cc129dd4e632 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:24.790103 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21557aa3-ee67-424b-899e-cc129dd4e632 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:24.790103 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21557aa3-ee67-424b-899e-cc129dd4e632 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:24.790893 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 946/1893] 10.222.0.39 () {54 vars in 921 bytes} [Tue Jul 26 04:53:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:53:24.796560 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22b47d-080f-4ae1-93af-94d17b0fccec None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:24.796857 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22b47d-080f-4ae1-93af-94d17b0fccec None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:24.797148 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22b47d-080f-4ae1-93af-94d17b0fccec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:24.824376 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-ce22b47d-080f-4ae1-93af-94d17b0fccec None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:24.825913 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-ce22b47d-080f-4ae1-93af-94d17b0fccec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:24.844325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 947/1894] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:24.844923 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972cdd0-9e08-4fb9-b4db-4581a57c1553 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:24.845230 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972cdd0-9e08-4fb9-b4db-4581a57c1553 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:24.845511 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972cdd0-9e08-4fb9-b4db-4581a57c1553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:24.868954 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-c3840025-23d1-4a41-8bae-66914f2acb34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3f94a2bc46e4fb0b2bd8197bfc1cbdc'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:24.871503 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-c3840025-23d1-4a41-8bae-66914f2acb34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3f94a2bc46e4fb0b2bd8197bfc1cbdc'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:24.898195 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-c3840025-23d1-4a41-8bae-66914f2acb34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3f94a2bc46e4fb0b2bd8197bfc1cbdc'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:24.916406 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-c3840025-23d1-4a41-8bae-66914f2acb34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3f94a2bc46e4fb0b2bd8197bfc1cbdc'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:24.920791 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-7972cdd0-9e08-4fb9-b4db-4581a57c1553 None None] MFA Rules not processed for user `ae8593e125da4b208dd100608aa2b462`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:24.922474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-7972cdd0-9e08-4fb9-b4db-4581a57c1553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:24.934378 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-c3840025-23d1-4a41-8bae-66914f2acb34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3f94a2bc46e4fb0b2bd8197bfc1cbdc'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:24.953534 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 948/1895] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:53:24 2022] DELETE /identity/v3/users/e3f94a2bc46e4fb0b2bd8197bfc1cbdc => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:24.955126 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3840025-23d1-4a41-8bae-66914f2acb34 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:24.959279 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-c3840025-23d1-4a41-8bae-66914f2acb34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:25.011756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:25.089262 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 948/1896] 10.222.0.39 () {58 vars in 1018 bytes} [Tue Jul 26 04:53:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:25.106138 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3840025-23d1-4a41-8bae-66914f2acb34 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:25.113680 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd83ec7-406b-4152-9cb3-bc67da7180f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:25.114670 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd83ec7-406b-4152-9cb3-bc67da7180f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:25.114962 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd83ec7-406b-4152-9cb3-bc67da7180f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:25.115238 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd83ec7-406b-4152-9cb3-bc67da7180f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:25.116270 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd83ec7-406b-4152-9cb3-bc67da7180f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:53:25.116733 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd83ec7-406b-4152-9cb3-bc67da7180f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:25.119339 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd83ec7-406b-4152-9cb3-bc67da7180f7 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:25.143207 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 949/1897] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:53:25.147862 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972cdd0-9e08-4fb9-b4db-4581a57c1553 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:25.162601 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972cdd0-9e08-4fb9-b4db-4581a57c1553 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:25.179835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdd7b3-b86b-4116-b18d-99cec2c623d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:25.180494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdd7b3-b86b-4116-b18d-99cec2c623d0 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:25.180774 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdd7b3-b86b-4116-b18d-99cec2c623d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:25.181049 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdd7b3-b86b-4116-b18d-99cec2c623d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:25.181737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdd7b3-b86b-4116-b18d-99cec2c623d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:25.183917 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdd7b3-b86b-4116-b18d-99cec2c623d0 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:25.260018 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 949/1898] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:53:25 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:53:25.264679 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd83ec7-406b-4152-9cb3-bc67da7180f7 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:25.281286 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd83ec7-406b-4152-9cb3-bc67da7180f7 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:25.405066 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600625c3-f01d-4aaa-8ad5-aaa75150a74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:25.407884 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600625c3-f01d-4aaa-8ad5-aaa75150a74f admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:25.409591 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600625c3-f01d-4aaa-8ad5-aaa75150a74f admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:25.410069 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600625c3-f01d-4aaa-8ad5-aaa75150a74f admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:25.411191 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600625c3-f01d-4aaa-8ad5-aaa75150a74f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:25.416073 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600625c3-f01d-4aaa-8ad5-aaa75150a74f admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:25.481645 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdd7b3-b86b-4116-b18d-99cec2c623d0 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:25.481645 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-09fdd7b3-b86b-4116-b18d-99cec2c623d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:25.483360 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 950/1899] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:53:25 2022] POST /identity/v3/users => generated 287 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:53:25.484353 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600625c3-f01d-4aaa-8ad5-aaa75150a74f admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:25.496677 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600625c3-f01d-4aaa-8ad5-aaa75150a74f admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:25.501926 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96b874-0266-4b0c-96b9-5aeb2e01ea31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:25.502564 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96b874-0266-4b0c-96b9-5aeb2e01ea31 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:25.502864 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96b874-0266-4b0c-96b9-5aeb2e01ea31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:25.503170 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96b874-0266-4b0c-96b9-5aeb2e01ea31 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:25.503882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce96b874-0266-4b0c-96b9-5aeb2e01ea31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:25.505699 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce96b874-0266-4b0c-96b9-5aeb2e01ea31 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:25.515207 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdd7b3-b86b-4116-b18d-99cec2c623d0 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:25.521416 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 951/1900] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:53:25.523464 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96b874-0266-4b0c-96b9-5aeb2e01ea31 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:25.535618 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96b874-0266-4b0c-96b9-5aeb2e01ea31 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:25.542538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6daef-8f9e-4f87-8185-5cbae97a3447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:25.543353 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6daef-8f9e-4f87-8185-5cbae97a3447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:25.544168 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6daef-8f9e-4f87-8185-5cbae97a3447 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:25.544929 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6daef-8f9e-4f87-8185-5cbae97a3447 admin admin] PATH_INFO: `/v3/projects/b6eb156a733e42a695978f81e7397e4a` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:25.547675 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c6daef-8f9e-4f87-8185-5cbae97a3447 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6eb156a733e42a695978f81e7397e4a)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:25.550706 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbdc6f2-1026-440a-a6a4-34cf174ecca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:25.552883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdc6f2-1026-440a-a6a4-34cf174ecca4 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:25.553226 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdc6f2-1026-440a-a6a4-34cf174ecca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:25.553505 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdc6f2-1026-440a-a6a4-34cf174ecca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:25.554269 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbdc6f2-1026-440a-a6a4-34cf174ecca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:25.554686 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c6daef-8f9e-4f87-8185-5cbae97a3447 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:25.560027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbdc6f2-1026-440a-a6a4-34cf174ecca4 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:25.579716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 952/1901] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:53:25.580680 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbdc6f2-1026-440a-a6a4-34cf174ecca4 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:25.581933 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:25.592671 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbdc6f2-1026-440a-a6a4-34cf174ecca4 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:25.598428 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba92732-5e6d-49f6-ad29-f4cdde3b78e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:25.599345 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba92732-5e6d-49f6-ad29-f4cdde3b78e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:25.599639 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba92732-5e6d-49f6-ad29-f4cdde3b78e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:25.599974 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba92732-5e6d-49f6-ad29-f4cdde3b78e2 admin admin] PATH_INFO: `/v3/projects/7518f77d13d144e0b7307c71b40b8783/users/30dba3dd63394038aadeb4c2f5980b23/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:25.622106 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba92732-5e6d-49f6-ad29-f4cdde3b78e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7518f77d13d144e0b7307c71b40b8783, user_id=30dba3dd63394038aadeb4c2f5980b23, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:25.625126 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba92732-5e6d-49f6-ad29-f4cdde3b78e2 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:25.642993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 953/1902] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:53:25 2022] PUT /identity/v3/projects/7518f77d13d144e0b7307c71b40b8783/users/30dba3dd63394038aadeb4c2f5980b23/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:25.654625 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57eb2d6-1bec-4bb9-ab19-6254e1fc421e None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:25.655112 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57eb2d6-1bec-4bb9-ab19-6254e1fc421e None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:25.655553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57eb2d6-1bec-4bb9-ab19-6254e1fc421e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:25.660075 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-12c6daef-8f9e-4f87-8185-5cbae97a3447 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6eb156a733e42a695978f81e7397e4a', 'request_id': 'req-12c6daef-8f9e-4f87-8185-5cbae97a3447'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:25.677142 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-12c6daef-8f9e-4f87-8185-5cbae97a3447 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6eb156a733e42a695978f81e7397e4a', 'request_id': 'req-12c6daef-8f9e-4f87-8185-5cbae97a3447'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:25.685882 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-12c6daef-8f9e-4f87-8185-5cbae97a3447 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6eb156a733e42a695978f81e7397e4a', 'request_id': 'req-12c6daef-8f9e-4f87-8185-5cbae97a3447'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:25.690830 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-e57eb2d6-1bec-4bb9-ab19-6254e1fc421e None None] MFA Rules not processed for user `30dba3dd63394038aadeb4c2f5980b23`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:25.691701 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-e57eb2d6-1bec-4bb9-ab19-6254e1fc421e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:25.703821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-12c6daef-8f9e-4f87-8185-5cbae97a3447 admin admin] The token cache is being invalidate because project b6eb156a733e42a695978f81e7397e4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:53:25.704181 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-12c6daef-8f9e-4f87-8185-5cbae97a3447 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:25.705019 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-12c6daef-8f9e-4f87-8185-5cbae97a3447 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:25.722904 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 950/1903] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:53:25 2022] DELETE /identity/v3/projects/b6eb156a733e42a695978f81e7397e4a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:25.725526 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6daef-8f9e-4f87-8185-5cbae97a3447 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:25.728947 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-12c6daef-8f9e-4f87-8185-5cbae97a3447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:25.787088 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:25.818845 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 954/1904] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:25.825103 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1a41e-e217-4317-8df1-e78a885c2f8c None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:25.825403 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1a41e-e217-4317-8df1-e78a885c2f8c None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:25.825690 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1a41e-e217-4317-8df1-e78a885c2f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:25.861267 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-c9f1a41e-e217-4317-8df1-e78a885c2f8c None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:25.863780 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-c9f1a41e-e217-4317-8df1-e78a885c2f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:25.902094 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6daef-8f9e-4f87-8185-5cbae97a3447 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:25.912113 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679ac7e-5a75-4ebb-b1af-b150ea99b501 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:25.912795 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679ac7e-5a75-4ebb-b1af-b150ea99b501 service nova] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:25.913439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679ac7e-5a75-4ebb-b1af-b150ea99b501 service nova] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:25.913790 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679ac7e-5a75-4ebb-b1af-b150ea99b501 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:25.916854 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-5679ac7e-5a75-4ebb-b1af-b150ea99b501 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:25.932576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679ac7e-5a75-4ebb-b1af-b150ea99b501 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:25.935021 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679ac7e-5a75-4ebb-b1af-b150ea99b501 service nova] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:25.953959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 951/1905] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:53:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:53:25.955498 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679ac7e-5a75-4ebb-b1af-b150ea99b501 service nova] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:25.957050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-5679ac7e-5a75-4ebb-b1af-b150ea99b501 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:25.974617 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 955/1906] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:25.975500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1a41e-e217-4317-8df1-e78a885c2f8c None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:25.977350 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-c9f1a41e-e217-4317-8df1-e78a885c2f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:26.000475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1a41e-e217-4317-8df1-e78a885c2f8c None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:26.012181 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28eed73-cfaa-4bfd-a4af-36c9f89a3210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:26.013398 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28eed73-cfaa-4bfd-a4af-36c9f89a3210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:26.013932 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28eed73-cfaa-4bfd-a4af-36c9f89a3210 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:26.014635 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28eed73-cfaa-4bfd-a4af-36c9f89a3210 admin admin] PATH_INFO: `/v3/users/c8f41c07be5c4b798da450b31b05817b` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:26.019768 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28eed73-cfaa-4bfd-a4af-36c9f89a3210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8f41c07be5c4b798da450b31b05817b)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:26.023707 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28eed73-cfaa-4bfd-a4af-36c9f89a3210 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:26.106286 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-d28eed73-cfaa-4bfd-a4af-36c9f89a3210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8f41c07be5c4b798da450b31b05817b'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:26.107599 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-d28eed73-cfaa-4bfd-a4af-36c9f89a3210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8f41c07be5c4b798da450b31b05817b'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:26.119105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-d28eed73-cfaa-4bfd-a4af-36c9f89a3210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8f41c07be5c4b798da450b31b05817b'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:26.121897 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679ac7e-5a75-4ebb-b1af-b150ea99b501 service nova] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:26.135295 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709aa820-227e-4aff-9313-05c3163d40a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:26.136434 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-d28eed73-cfaa-4bfd-a4af-36c9f89a3210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8f41c07be5c4b798da450b31b05817b'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:26.137457 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709aa820-227e-4aff-9313-05c3163d40a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:26.137768 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709aa820-227e-4aff-9313-05c3163d40a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:26.138075 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709aa820-227e-4aff-9313-05c3163d40a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:26.138784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709aa820-227e-4aff-9313-05c3163d40a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:26.145827 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709aa820-227e-4aff-9313-05c3163d40a8 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:26.146783 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-d28eed73-cfaa-4bfd-a4af-36c9f89a3210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8f41c07be5c4b798da450b31b05817b'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:26.161796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 956/1907] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:53:25 2022] DELETE /identity/v3/users/c8f41c07be5c4b798da450b31b05817b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:26.165122 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556c27e-f831-4a80-b545-b0dc7d8f24a6 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:26.165122 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556c27e-f831-4a80-b545-b0dc7d8f24a6 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:26.165122 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556c27e-f831-4a80-b545-b0dc7d8f24a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:26.192780 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-e556c27e-f831-4a80-b545-b0dc7d8f24a6 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:26.194384 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-e556c27e-f831-4a80-b545-b0dc7d8f24a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:26.241786 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 952/1908] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:53:25 2022] POST /identity/v3/projects => generated 373 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:53:26.246498 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee54b7-bc98-4533-a0c3-51ee4665497d None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:26.246790 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee54b7-bc98-4533-a0c3-51ee4665497d None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:26.248913 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee54b7-bc98-4533-a0c3-51ee4665497d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:26.307459 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-89ee54b7-bc98-4533-a0c3-51ee4665497d None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:26.310418 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-89ee54b7-bc98-4533-a0c3-51ee4665497d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:26.314941 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 957/1909] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:26.316187 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556c27e-f831-4a80-b545-b0dc7d8f24a6 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:26.317688 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-e556c27e-f831-4a80-b545-b0dc7d8f24a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:26.325183 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:26.330618 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:26.342639 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556c27e-f831-4a80-b545-b0dc7d8f24a6 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:26.455346 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec4673-f0e6-4b66-88ec-dd34cb4e49ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:26.455867 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec4673-f0e6-4b66-88ec-dd34cb4e49ce admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:26.455965 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec4673-f0e6-4b66-88ec-dd34cb4e49ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:26.456176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec4673-f0e6-4b66-88ec-dd34cb4e49ce admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:26.456870 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec4673-f0e6-4b66-88ec-dd34cb4e49ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:26.458963 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec4673-f0e6-4b66-88ec-dd34cb4e49ce admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:26.494947 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 958/1910] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:53:26 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:53:26.495979 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec4673-f0e6-4b66-88ec-dd34cb4e49ce admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:26.499759 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 953/1911] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:26.500719 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee54b7-bc98-4533-a0c3-51ee4665497d None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:26.514423 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec4673-f0e6-4b66-88ec-dd34cb4e49ce admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:26.522219 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6f0ac-343b-4e9a-a1e8-0addf48ba213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:26.523392 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6f0ac-343b-4e9a-a1e8-0addf48ba213 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:26.523963 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6f0ac-343b-4e9a-a1e8-0addf48ba213 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:26.524469 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de6f0ac-343b-4e9a-a1e8-0addf48ba213 admin admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:26.524694 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee54b7-bc98-4533-a0c3-51ee4665497d None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:26.525713 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6f0ac-343b-4e9a-a1e8-0addf48ba213 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:53:26.526314 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6f0ac-343b-4e9a-a1e8-0addf48ba213 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:26.528282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de6f0ac-343b-4e9a-a1e8-0addf48ba213 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:26.539115 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13181710-b79e-4664-852c-32f9f937571b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:26.539826 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13181710-b79e-4664-852c-32f9f937571b admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:26.540883 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13181710-b79e-4664-852c-32f9f937571b admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:26.541173 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13181710-b79e-4664-852c-32f9f937571b admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:26.542069 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13181710-b79e-4664-852c-32f9f937571b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:26.549160 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 959/1912] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:53:26.550615 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6f0ac-343b-4e9a-a1e8-0addf48ba213 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:26.550728 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13181710-b79e-4664-852c-32f9f937571b admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:26.554758 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-3de6f0ac-343b-4e9a-a1e8-0addf48ba213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:26.580689 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 954/1913] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:53:26.580689 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13181710-b79e-4664-852c-32f9f937571b admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:26.604547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13181710-b79e-4664-852c-32f9f937571b admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:26.617469 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67760361-35d8-4e72-be1c-c5d33ccd8e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:26.618893 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67760361-35d8-4e72-be1c-c5d33ccd8e08 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:26.619169 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67760361-35d8-4e72-be1c-c5d33ccd8e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:26.620279 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67760361-35d8-4e72-be1c-c5d33ccd8e08 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:26.623175 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67760361-35d8-4e72-be1c-c5d33ccd8e08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:26.627427 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67760361-35d8-4e72-be1c-c5d33ccd8e08 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:26.650783 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de6f0ac-343b-4e9a-a1e8-0addf48ba213 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:26.656432 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75bdbc-8910-4dc4-92b7-51a2ce3c17b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:26.657659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75bdbc-8910-4dc4-92b7-51a2ce3c17b2 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:26.658176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75bdbc-8910-4dc4-92b7-51a2ce3c17b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:26.658793 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a75bdbc-8910-4dc4-92b7-51a2ce3c17b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:26.685465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75bdbc-8910-4dc4-92b7-51a2ce3c17b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:26.691898 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a75bdbc-8910-4dc4-92b7-51a2ce3c17b2 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:26.693518 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 955/1914] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:53:26 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:53:26.706011 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67760361-35d8-4e72-be1c-c5d33ccd8e08 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:26.741114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 960/1915] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:53:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:53:26.752855 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75bdbc-8910-4dc4-92b7-51a2ce3c17b2 service neutron] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:26.779651 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a75bdbc-8910-4dc4-92b7-51a2ce3c17b2 service neutron] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:26.844856 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67760361-35d8-4e72-be1c-c5d33ccd8e08 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:26.855932 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633bacb4-a5ff-4224-b567-67ad2f3ca928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:26.857136 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bacb4-a5ff-4224-b567-67ad2f3ca928 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:26.857767 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bacb4-a5ff-4224-b567-67ad2f3ca928 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:26.858201 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bacb4-a5ff-4224-b567-67ad2f3ca928 admin admin] PATH_INFO: `/v3/projects/19f438298bca492e926822bd1e9255e4/users/a4bf0663e536440d8d638dd7b0f5a738/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:26.867071 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff349feb-f8ee-46f3-9c9f-578761c4d8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:26.869466 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff349feb-f8ee-46f3-9c9f-578761c4d8a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:26.869637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff349feb-f8ee-46f3-9c9f-578761c4d8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:26.869911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff349feb-f8ee-46f3-9c9f-578761c4d8a8 admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:26.870666 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff349feb-f8ee-46f3-9c9f-578761c4d8a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:26.874685 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff349feb-f8ee-46f3-9c9f-578761c4d8a8 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:26.884280 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633bacb4-a5ff-4224-b567-67ad2f3ca928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f438298bca492e926822bd1e9255e4, user_id=a4bf0663e536440d8d638dd7b0f5a738, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:26.887631 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633bacb4-a5ff-4224-b567-67ad2f3ca928 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:26.911067 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 961/1916] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:53:26 2022] POST /identity/v3/users => generated 285 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:53:26.913862 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff349feb-f8ee-46f3-9c9f-578761c4d8a8 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:26.917703 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 956/1917] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:53:26 2022] PUT /identity/v3/projects/19f438298bca492e926822bd1e9255e4/users/a4bf0663e536440d8d638dd7b0f5a738/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:26.924503 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633bacb4-a5ff-4224-b567-67ad2f3ca928 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:26.954629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff349feb-f8ee-46f3-9c9f-578761c4d8a8 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:26.978071 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:27.054743 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633bacb4-a5ff-4224-b567-67ad2f3ca928 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:27.062606 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11638fb-8894-4708-abb2-908896e4f2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:27.063491 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11638fb-8894-4708-abb2-908896e4f2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:27.063771 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11638fb-8894-4708-abb2-908896e4f2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:27.064038 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11638fb-8894-4708-abb2-908896e4f2d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:27.064492 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744b1a8-39da-47a2-9026-9317672dff11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:27.064789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11638fb-8894-4708-abb2-908896e4f2d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:27.065356 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744b1a8-39da-47a2-9026-9317672dff11 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:27.065745 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744b1a8-39da-47a2-9026-9317672dff11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:27.066134 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744b1a8-39da-47a2-9026-9317672dff11 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:27.066506 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11638fb-8894-4708-abb2-908896e4f2d8 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:27.067096 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744b1a8-39da-47a2-9026-9317672dff11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:27.068356 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:27.070457 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8744b1a8-39da-47a2-9026-9317672dff11 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:27.084762 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 962/1918] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:53:27.088667 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744b1a8-39da-47a2-9026-9317672dff11 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:27.090020 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 957/1919] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:53:27.096657 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11638fb-8894-4708-abb2-908896e4f2d8 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:27.104544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744b1a8-39da-47a2-9026-9317672dff11 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:27.111355 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117d61b-4fa1-4f9a-ab60-3c93ffbb64bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:27.112215 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117d61b-4fa1-4f9a-ab60-3c93ffbb64bd admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:27.112604 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117d61b-4fa1-4f9a-ab60-3c93ffbb64bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:27.113335 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117d61b-4fa1-4f9a-ab60-3c93ffbb64bd admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:27.113853 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11638fb-8894-4708-abb2-908896e4f2d8 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:27.114685 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117d61b-4fa1-4f9a-ab60-3c93ffbb64bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:27.117256 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117d61b-4fa1-4f9a-ab60-3c93ffbb64bd admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:27.122021 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd061d-e41e-45d6-8a42-834895facce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:27.122957 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd061d-e41e-45d6-8a42-834895facce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:27.123382 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd061d-e41e-45d6-8a42-834895facce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:27.123827 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd061d-e41e-45d6-8a42-834895facce9 admin admin] PATH_INFO: `/v3/projects/19f438298bca492e926822bd1e9255e4/users/a4bf0663e536440d8d638dd7b0f5a738/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:27.126403 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd061d-e41e-45d6-8a42-834895facce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f438298bca492e926822bd1e9255e4, user_id=a4bf0663e536440d8d638dd7b0f5a738, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:27.129903 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd061d-e41e-45d6-8a42-834895facce9 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:27.136155 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 963/1920] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:53:27.140060 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117d61b-4fa1-4f9a-ab60-3c93ffbb64bd admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:27.143049 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 958/1921] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:53:27 2022] PUT /identity/v3/projects/19f438298bca492e926822bd1e9255e4/users/a4bf0663e536440d8d638dd7b0f5a738/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:27.154039 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c8969-98b6-4bb8-ac37-6ab3b9aed8c3 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:27.154530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c8969-98b6-4bb8-ac37-6ab3b9aed8c3 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:27.155272 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c8969-98b6-4bb8-ac37-6ab3b9aed8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:27.159936 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117d61b-4fa1-4f9a-ab60-3c93ffbb64bd admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:27.188540 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-0d5c8969-98b6-4bb8-ac37-6ab3b9aed8c3 None None] MFA Rules not processed for user `a4bf0663e536440d8d638dd7b0f5a738`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:27.190296 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-0d5c8969-98b6-4bb8-ac37-6ab3b9aed8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:27.234733 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5efd405-b4c5-4112-abbf-3ee309296d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:27.235938 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efd405-b4c5-4112-abbf-3ee309296d04 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:27.236566 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efd405-b4c5-4112-abbf-3ee309296d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:27.236930 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5efd405-b4c5-4112-abbf-3ee309296d04 admin admin] PATH_INFO: `/v3/projects/b5415a6c63dd4e278dd9acf2441c8366/users/f4cc4de940574c74a287aeb6baad35df/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:27.262814 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5efd405-b4c5-4112-abbf-3ee309296d04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5415a6c63dd4e278dd9acf2441c8366, user_id=f4cc4de940574c74a287aeb6baad35df, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:27.266584 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5efd405-b4c5-4112-abbf-3ee309296d04 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:27.279918 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 959/1922] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:53:27.293310 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 964/1923] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:53:27 2022] PUT /identity/v3/projects/b5415a6c63dd4e278dd9acf2441c8366/users/f4cc4de940574c74a287aeb6baad35df/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:53:27.294955 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c8969-98b6-4bb8-ac37-6ab3b9aed8c3 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:27.307778 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926c7a6-50ed-4637-976f-c0400da1ac8a None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:27.308096 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926c7a6-50ed-4637-976f-c0400da1ac8a None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:27.308402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926c7a6-50ed-4637-976f-c0400da1ac8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:27.308998 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-0d5c8969-98b6-4bb8-ac37-6ab3b9aed8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:27.348886 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-e926c7a6-50ed-4637-976f-c0400da1ac8a None None] MFA Rules not processed for user `f4cc4de940574c74a287aeb6baad35df`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:27.350884 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-e926c7a6-50ed-4637-976f-c0400da1ac8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:27.395570 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c8969-98b6-4bb8-ac37-6ab3b9aed8c3 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:27.449259 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 965/1924] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:27 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:27.464807 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926c7a6-50ed-4637-976f-c0400da1ac8a None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:27.467047 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-e926c7a6-50ed-4637-976f-c0400da1ac8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:27.472208 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d4e0a-fda1-4026-a908-7b75c2747d0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:27.472896 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d4e0a-fda1-4026-a908-7b75c2747d0d service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:27.473156 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d4e0a-fda1-4026-a908-7b75c2747d0d service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:27.473432 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d4e0a-fda1-4026-a908-7b75c2747d0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:27.487435 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:27.537806 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:27.593121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d4e0a-fda1-4026-a908-7b75c2747d0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:27.598369 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d4e0a-fda1-4026-a908-7b75c2747d0d service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:27.628212 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 960/1925] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:53:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:53:27.628716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926c7a6-50ed-4637-976f-c0400da1ac8a None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:27.633047 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56531fb7-6fbe-4829-b934-cb9a6179560c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfbf2c03eb740ed8b72c4825cffc341', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:27.633742 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56531fb7-6fbe-4829-b934-cb9a6179560c service glance] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:27.634402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56531fb7-6fbe-4829-b934-cb9a6179560c service glance] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:27.634402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56531fb7-6fbe-4829-b934-cb9a6179560c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:27.647196 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56531fb7-6fbe-4829-b934-cb9a6179560c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:27.649675 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56531fb7-6fbe-4829-b934-cb9a6179560c service glance] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:27.668088 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 966/1926] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:53:27 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:53:27.730448 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d4e0a-fda1-4026-a908-7b75c2747d0d service cinder] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:27.731954 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-340d4e0a-fda1-4026-a908-7b75c2747d0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:27.851994 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d4e0a-fda1-4026-a908-7b75c2747d0d service cinder] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:27.858257 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d8b91-2440-4077-8cba-9ff6aa093674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:27.859414 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d8b91-2440-4077-8cba-9ff6aa093674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:27.859987 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d8b91-2440-4077-8cba-9ff6aa093674 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:27.860415 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d8b91-2440-4077-8cba-9ff6aa093674 admin admin] PATH_INFO: `/v3/projects/44a0e736bd8247b89d28a367c1abbe95` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:27.862232 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d8b91-2440-4077-8cba-9ff6aa093674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44a0e736bd8247b89d28a367c1abbe95)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:27.865446 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d8b91-2440-4077-8cba-9ff6aa093674 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:27.981209 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-ec2d8b91-2440-4077-8cba-9ff6aa093674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44a0e736bd8247b89d28a367c1abbe95', 'request_id': 'req-ec2d8b91-2440-4077-8cba-9ff6aa093674'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:28.004198 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-ec2d8b91-2440-4077-8cba-9ff6aa093674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44a0e736bd8247b89d28a367c1abbe95', 'request_id': 'req-ec2d8b91-2440-4077-8cba-9ff6aa093674'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:28.013176 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-ec2d8b91-2440-4077-8cba-9ff6aa093674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44a0e736bd8247b89d28a367c1abbe95', 'request_id': 'req-ec2d8b91-2440-4077-8cba-9ff6aa093674'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:28.039515 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-ec2d8b91-2440-4077-8cba-9ff6aa093674 admin admin] The token cache is being invalidate because project 44a0e736bd8247b89d28a367c1abbe95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:53:28.040282 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-ec2d8b91-2440-4077-8cba-9ff6aa093674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:28.041604 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-ec2d8b91-2440-4077-8cba-9ff6aa093674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:28.043285 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 961/1927] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:53:27 2022] DELETE /identity/v3/projects/44a0e736bd8247b89d28a367c1abbe95 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:28.047095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56531fb7-6fbe-4829-b934-cb9a6179560c service glance] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:28.064329 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56531fb7-6fbe-4829-b934-cb9a6179560c service glance] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:28.159263 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23bfe7-4e54-4f98-94a9-47bf28af6e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:28.160102 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23bfe7-4e54-4f98-94a9-47bf28af6e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:28.160382 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23bfe7-4e54-4f98-94a9-47bf28af6e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:28.160659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23bfe7-4e54-4f98-94a9-47bf28af6e89 admin admin] PATH_INFO: `/v3/users/f996cddc8ea34397ad5af0fbf64ceaf5` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:28.161942 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23bfe7-4e54-4f98-94a9-47bf28af6e89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f996cddc8ea34397ad5af0fbf64ceaf5)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:28.164144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23bfe7-4e54-4f98-94a9-47bf28af6e89 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:28.255976 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2a23bfe7-4e54-4f98-94a9-47bf28af6e89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f996cddc8ea34397ad5af0fbf64ceaf5'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:28.257363 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2a23bfe7-4e54-4f98-94a9-47bf28af6e89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f996cddc8ea34397ad5af0fbf64ceaf5'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:28.270050 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2a23bfe7-4e54-4f98-94a9-47bf28af6e89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f996cddc8ea34397ad5af0fbf64ceaf5'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:28.290847 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2a23bfe7-4e54-4f98-94a9-47bf28af6e89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f996cddc8ea34397ad5af0fbf64ceaf5'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:28.299614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2a23bfe7-4e54-4f98-94a9-47bf28af6e89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f996cddc8ea34397ad5af0fbf64ceaf5'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:28.310827 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d8b91-2440-4077-8cba-9ff6aa093674 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:28.312613 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-ec2d8b91-2440-4077-8cba-9ff6aa093674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:28.316853 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 967/1928] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:53:28 2022] DELETE /identity/v3/users/f996cddc8ea34397ad5af0fbf64ceaf5 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:28.333456 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d8b91-2440-4077-8cba-9ff6aa093674 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:28.501012 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5486efd-661a-497d-a74a-58c2734553ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:28.501715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5486efd-661a-497d-a74a-58c2734553ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:28.502198 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5486efd-661a-497d-a74a-58c2734553ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:28.502529 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5486efd-661a-497d-a74a-58c2734553ae admin admin] PATH_INFO: `/v3/users/30dba3dd63394038aadeb4c2f5980b23` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:28.503878 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5486efd-661a-497d-a74a-58c2734553ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=30dba3dd63394038aadeb4c2f5980b23)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:28.506614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5486efd-661a-497d-a74a-58c2734553ae admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:28.512989 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:28.584119 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-b5486efd-661a-497d-a74a-58c2734553ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30dba3dd63394038aadeb4c2f5980b23'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:28.595213 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-b5486efd-661a-497d-a74a-58c2734553ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30dba3dd63394038aadeb4c2f5980b23'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:28.610787 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-b5486efd-661a-497d-a74a-58c2734553ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30dba3dd63394038aadeb4c2f5980b23'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:28.619509 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-b5486efd-661a-497d-a74a-58c2734553ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30dba3dd63394038aadeb4c2f5980b23'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:28.620265 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-b5486efd-661a-497d-a74a-58c2734553ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30dba3dd63394038aadeb4c2f5980b23'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:28.629214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 962/1929] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:53:28 2022] DELETE /identity/v3/users/30dba3dd63394038aadeb4c2f5980b23 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:53:28.634168 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c29fa-2685-4f97-950e-464c84e4ce57 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:28.634807 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c29fa-2685-4f97-950e-464c84e4ce57 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:28.635140 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c29fa-2685-4f97-950e-464c84e4ce57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:28.659976 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-591c29fa-2685-4f97-950e-464c84e4ce57 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:28.661506 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-591c29fa-2685-4f97-950e-464c84e4ce57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:28.668010 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:28.788387 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 968/1930] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:28.806685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5486efd-661a-497d-a74a-58c2734553ae admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:28.808501 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-b5486efd-661a-497d-a74a-58c2734553ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:28.914555 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c29fa-2685-4f97-950e-464c84e4ce57 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:28.916246 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-591c29fa-2685-4f97-950e-464c84e4ce57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:28.925547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5486efd-661a-497d-a74a-58c2734553ae admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:28.930807 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6111a3-4922-4787-80bb-5ecdcaee5091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:28.931458 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6111a3-4922-4787-80bb-5ecdcaee5091 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:28.932989 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6111a3-4922-4787-80bb-5ecdcaee5091 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:28.933320 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6111a3-4922-4787-80bb-5ecdcaee5091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:28.946278 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6111a3-4922-4787-80bb-5ecdcaee5091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:28.947919 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6111a3-4922-4787-80bb-5ecdcaee5091 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:28.958521 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c29fa-2685-4f97-950e-464c84e4ce57 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:28.961116 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 963/1931] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:53:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:53:28.993325 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2125d5-9c46-4f2a-bb1f-f734ef89a39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:28.994029 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2125d5-9c46-4f2a-bb1f-f734ef89a39d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:28.994317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2125d5-9c46-4f2a-bb1f-f734ef89a39d admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:28.994591 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2125d5-9c46-4f2a-bb1f-f734ef89a39d admin admin] PATH_INFO: `/v3/projects/7ca331b95ec94e6b910089d970d6a731` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:29.001565 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2125d5-9c46-4f2a-bb1f-f734ef89a39d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ca331b95ec94e6b910089d970d6a731)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:29.004076 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2125d5-9c46-4f2a-bb1f-f734ef89a39d admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:29.136822 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-4a2125d5-9c46-4f2a-bb1f-f734ef89a39d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ca331b95ec94e6b910089d970d6a731', 'request_id': 'req-4a2125d5-9c46-4f2a-bb1f-f734ef89a39d'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:29.165419 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-4a2125d5-9c46-4f2a-bb1f-f734ef89a39d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ca331b95ec94e6b910089d970d6a731', 'request_id': 'req-4a2125d5-9c46-4f2a-bb1f-f734ef89a39d'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:29.180752 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-4a2125d5-9c46-4f2a-bb1f-f734ef89a39d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ca331b95ec94e6b910089d970d6a731', 'request_id': 'req-4a2125d5-9c46-4f2a-bb1f-f734ef89a39d'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:29.222353 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-4a2125d5-9c46-4f2a-bb1f-f734ef89a39d admin admin] The token cache is being invalidate because project 7ca331b95ec94e6b910089d970d6a731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:53:29.223641 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-4a2125d5-9c46-4f2a-bb1f-f734ef89a39d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:29.225202 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-4a2125d5-9c46-4f2a-bb1f-f734ef89a39d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:29.229468 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 969/1932] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:53:28 2022] DELETE /identity/v3/projects/7ca331b95ec94e6b910089d970d6a731 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:53:29.236614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb8adc-2a87-4b08-94d3-39ecb88f0989 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:29.237064 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb8adc-2a87-4b08-94d3-39ecb88f0989 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:29.237541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb8adc-2a87-4b08-94d3-39ecb88f0989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:29.291676 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-69bb8adc-2a87-4b08-94d3-39ecb88f0989 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:29.293621 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-69bb8adc-2a87-4b08-94d3-39ecb88f0989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:29.449912 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 964/1933] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:53:29.463557 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b141a80-2611-405c-bf59-f74447edfef7 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:29.464019 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b141a80-2611-405c-bf59-f74447edfef7 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:29.464502 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b141a80-2611-405c-bf59-f74447edfef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:29.503397 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-7b141a80-2611-405c-bf59-f74447edfef7 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:29.505628 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-7b141a80-2611-405c-bf59-f74447edfef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:29.526292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 970/1934] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:53:29.526634 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb8adc-2a87-4b08-94d3-39ecb88f0989 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:29.539118 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb8adc-2a87-4b08-94d3-39ecb88f0989 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:29.547036 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b48c77-14f4-49a5-8971-bba301a37e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:29.547791 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b48c77-14f4-49a5-8971-bba301a37e13 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:29.548878 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b48c77-14f4-49a5-8971-bba301a37e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:29.549173 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b48c77-14f4-49a5-8971-bba301a37e13 admin admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:29.551179 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b48c77-14f4-49a5-8971-bba301a37e13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:53:29.551179 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b48c77-14f4-49a5-8971-bba301a37e13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:29.553176 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b48c77-14f4-49a5-8971-bba301a37e13 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:29.578445 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b141a80-2611-405c-bf59-f74447edfef7 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:29.583636 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 965/1935] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:53:29.606500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b141a80-2611-405c-bf59-f74447edfef7 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:29.608571 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b48c77-14f4-49a5-8971-bba301a37e13 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:29.612189 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-36b48c77-14f4-49a5-8971-bba301a37e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:29.612617 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207269b-376e-473a-bb0b-8735187e12fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:29.613770 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207269b-376e-473a-bb0b-8735187e12fd admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:29.614188 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207269b-376e-473a-bb0b-8735187e12fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:29.614557 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207269b-376e-473a-bb0b-8735187e12fd admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:29.615443 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207269b-376e-473a-bb0b-8735187e12fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:29.617569 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207269b-376e-473a-bb0b-8735187e12fd admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:29.636901 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b48c77-14f4-49a5-8971-bba301a37e13 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:29.658956 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00b121-324d-4c17-8c8a-4ba4c41d39d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:29.659592 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00b121-324d-4c17-8c8a-4ba4c41d39d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:29.659869 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00b121-324d-4c17-8c8a-4ba4c41d39d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:29.660150 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00b121-324d-4c17-8c8a-4ba4c41d39d3 admin admin] PATH_INFO: `/v3/projects/7518f77d13d144e0b7307c71b40b8783` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:29.661854 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00b121-324d-4c17-8c8a-4ba4c41d39d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7518f77d13d144e0b7307c71b40b8783)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:29.664463 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00b121-324d-4c17-8c8a-4ba4c41d39d3 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:29.676979 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 971/1936] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:53:29 2022] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:53:29.676979 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207269b-376e-473a-bb0b-8735187e12fd admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:29.683981 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:29.749062 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-ab00b121-324d-4c17-8c8a-4ba4c41d39d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7518f77d13d144e0b7307c71b40b8783', 'request_id': 'req-ab00b121-324d-4c17-8c8a-4ba4c41d39d3'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:29.759084 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-ab00b121-324d-4c17-8c8a-4ba4c41d39d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7518f77d13d144e0b7307c71b40b8783', 'request_id': 'req-ab00b121-324d-4c17-8c8a-4ba4c41d39d3'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:29.765773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-ab00b121-324d-4c17-8c8a-4ba4c41d39d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7518f77d13d144e0b7307c71b40b8783', 'request_id': 'req-ab00b121-324d-4c17-8c8a-4ba4c41d39d3'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:29.784861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207269b-376e-473a-bb0b-8735187e12fd admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:29.784972 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-ab00b121-324d-4c17-8c8a-4ba4c41d39d3 admin admin] The token cache is being invalidate because project 7518f77d13d144e0b7307c71b40b8783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:53:29.784972 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-ab00b121-324d-4c17-8c8a-4ba4c41d39d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:29.784972 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-ab00b121-324d-4c17-8c8a-4ba4c41d39d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:29.785400 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 966/1937] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:53:29 2022] DELETE /identity/v3/projects/7518f77d13d144e0b7307c71b40b8783 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:29.789655 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00b121-324d-4c17-8c8a-4ba4c41d39d3 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:29.791243 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-ab00b121-324d-4c17-8c8a-4ba4c41d39d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:29.795350 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:29.870249 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdce9f9-a189-4d06-a447-7816e35f3f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:29.871715 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdce9f9-a189-4d06-a447-7816e35f3f0b admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:29.872489 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdce9f9-a189-4d06-a447-7816e35f3f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:29.872928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdce9f9-a189-4d06-a447-7816e35f3f0b admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:29.875167 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdce9f9-a189-4d06-a447-7816e35f3f0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:29.888285 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdce9f9-a189-4d06-a447-7816e35f3f0b admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:29.919719 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00b121-324d-4c17-8c8a-4ba4c41d39d3 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:29.926172 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 972/1938] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:53:29 2022] POST /identity/v3/users => generated 291 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:53:29.928341 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdce9f9-a189-4d06-a447-7816e35f3f0b admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:29.928478 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe973b9-aa7d-4f27-a7b8-b2747eb301b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:29.929250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe973b9-aa7d-4f27-a7b8-b2747eb301b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:29.929701 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe973b9-aa7d-4f27-a7b8-b2747eb301b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:29.930307 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe973b9-aa7d-4f27-a7b8-b2747eb301b0 admin admin] PATH_INFO: `/v3/users/a4bf0663e536440d8d638dd7b0f5a738` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:29.932468 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe973b9-aa7d-4f27-a7b8-b2747eb301b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4bf0663e536440d8d638dd7b0f5a738)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:29.935141 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe973b9-aa7d-4f27-a7b8-b2747eb301b0 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:29.944330 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-8fdce9f9-a189-4d06-a447-7816e35f3f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:29.958058 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdce9f9-a189-4d06-a447-7816e35f3f0b admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:29.964626 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64551a-6188-4a38-90f3-d130e61d95ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:29.965704 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64551a-6188-4a38-90f3-d130e61d95ee admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:29.965704 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64551a-6188-4a38-90f3-d130e61d95ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:29.965912 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64551a-6188-4a38-90f3-d130e61d95ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:29.966644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64551a-6188-4a38-90f3-d130e61d95ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:29.968402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64551a-6188-4a38-90f3-d130e61d95ee admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:29.982018 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 973/1939] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:53:29.985456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64551a-6188-4a38-90f3-d130e61d95ee admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:30.005715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-ebe973b9-aa7d-4f27-a7b8-b2747eb301b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4bf0663e536440d8d638dd7b0f5a738'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:30.007995 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64551a-6188-4a38-90f3-d130e61d95ee admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:30.013721 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65707b-7572-4f5a-9ed1-aafb39a0d7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:30.014632 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65707b-7572-4f5a-9ed1-aafb39a0d7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:30.014988 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65707b-7572-4f5a-9ed1-aafb39a0d7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:30.015308 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65707b-7572-4f5a-9ed1-aafb39a0d7f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:30.016100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65707b-7572-4f5a-9ed1-aafb39a0d7f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:30.020583 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca65707b-7572-4f5a-9ed1-aafb39a0d7f3 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:30.031119 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-ebe973b9-aa7d-4f27-a7b8-b2747eb301b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4bf0663e536440d8d638dd7b0f5a738'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:30.039782 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 974/1940] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:53:30.043675 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65707b-7572-4f5a-9ed1-aafb39a0d7f3 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:30.050888 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-ebe973b9-aa7d-4f27-a7b8-b2747eb301b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4bf0663e536440d8d638dd7b0f5a738'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:30.059599 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-ebe973b9-aa7d-4f27-a7b8-b2747eb301b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4bf0663e536440d8d638dd7b0f5a738'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:30.060467 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-ebe973b9-aa7d-4f27-a7b8-b2747eb301b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4bf0663e536440d8d638dd7b0f5a738'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:30.060835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65707b-7572-4f5a-9ed1-aafb39a0d7f3 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:30.067415 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 967/1941] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:53:29 2022] DELETE /identity/v3/users/a4bf0663e536440d8d638dd7b0f5a738 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:53:30.071832 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb22183-d0e6-4ca7-9364-b44b83eb11bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:30.072964 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb22183-d0e6-4ca7-9364-b44b83eb11bd admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:30.073213 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb22183-d0e6-4ca7-9364-b44b83eb11bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:30.073494 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb22183-d0e6-4ca7-9364-b44b83eb11bd admin admin] PATH_INFO: `/v3/projects/b9b438835b824b4bad98b127f485cef8/users/a2f95d3e39d64628b0c524322afec289/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:30.092785 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb22183-d0e6-4ca7-9364-b44b83eb11bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b438835b824b4bad98b127f485cef8, user_id=a2f95d3e39d64628b0c524322afec289, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:30.097077 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb22183-d0e6-4ca7-9364-b44b83eb11bd admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:30.126883 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 975/1942] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:53:30 2022] PUT /identity/v3/projects/b9b438835b824b4bad98b127f485cef8/users/a2f95d3e39d64628b0c524322afec289/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:53:30.129031 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77546d4b-be6d-4e95-9ea6-b2ff158de9b1 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:30.129321 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77546d4b-be6d-4e95-9ea6-b2ff158de9b1 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:30.129595 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77546d4b-be6d-4e95-9ea6-b2ff158de9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:30.183273 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-77546d4b-be6d-4e95-9ea6-b2ff158de9b1 None None] MFA Rules not processed for user `a2f95d3e39d64628b0c524322afec289`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:30.184936 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-77546d4b-be6d-4e95-9ea6-b2ff158de9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:30.192120 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:30.301463 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 968/1943] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:30.302948 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb22183-d0e6-4ca7-9364-b44b83eb11bd admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:30.309226 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-2cb22183-d0e6-4ca7-9364-b44b83eb11bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:30.410644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb22183-d0e6-4ca7-9364-b44b83eb11bd admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:30.423874 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e40d9-97d5-4f23-8013-f2dbfd5944c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:30.424616 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e40d9-97d5-4f23-8013-f2dbfd5944c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:30.429648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e40d9-97d5-4f23-8013-f2dbfd5944c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:30.429648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e40d9-97d5-4f23-8013-f2dbfd5944c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:30.429648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e40d9-97d5-4f23-8013-f2dbfd5944c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:30.429648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e40d9-97d5-4f23-8013-f2dbfd5944c9 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:30.450266 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77546d4b-be6d-4e95-9ea6-b2ff158de9b1 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:30.452380 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-77546d4b-be6d-4e95-9ea6-b2ff158de9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:30.483060 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77546d4b-be6d-4e95-9ea6-b2ff158de9b1 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:30.492836 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587100dd-8fac-42ff-83d8-e780c00ec4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:30.494327 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587100dd-8fac-42ff-83d8-e780c00ec4bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:30.494491 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587100dd-8fac-42ff-83d8-e780c00ec4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:30.494715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587100dd-8fac-42ff-83d8-e780c00ec4bd admin admin] PATH_INFO: `/v3/projects/19f438298bca492e926822bd1e9255e4` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:30.496157 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587100dd-8fac-42ff-83d8-e780c00ec4bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=19f438298bca492e926822bd1e9255e4)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:30.498567 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587100dd-8fac-42ff-83d8-e780c00ec4bd admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:30.517015 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 976/1944] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:53:30 2022] POST /identity/v3/projects => generated 381 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:53:30.518173 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e40d9-97d5-4f23-8013-f2dbfd5944c9 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:30.580010 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:30.588423 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-587100dd-8fac-42ff-83d8-e780c00ec4bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19f438298bca492e926822bd1e9255e4', 'request_id': 'req-587100dd-8fac-42ff-83d8-e780c00ec4bd'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:30.607372 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e40d9-97d5-4f23-8013-f2dbfd5944c9 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:30.612293 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-587100dd-8fac-42ff-83d8-e780c00ec4bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19f438298bca492e926822bd1e9255e4', 'request_id': 'req-587100dd-8fac-42ff-83d8-e780c00ec4bd'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:30.636659 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-587100dd-8fac-42ff-83d8-e780c00ec4bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19f438298bca492e926822bd1e9255e4', 'request_id': 'req-587100dd-8fac-42ff-83d8-e780c00ec4bd'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:30.657846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-587100dd-8fac-42ff-83d8-e780c00ec4bd admin admin] The token cache is being invalidate because project 19f438298bca492e926822bd1e9255e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:53:30.658443 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-587100dd-8fac-42ff-83d8-e780c00ec4bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:30.662630 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-587100dd-8fac-42ff-83d8-e780c00ec4bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:30.665268 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 969/1945] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:53:30 2022] DELETE /identity/v3/projects/19f438298bca492e926822bd1e9255e4 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:53:30.669971 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bbbee-8ca5-493d-8457-239e311f5181 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:30.671098 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bbbee-8ca5-493d-8457-239e311f5181 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:30.672562 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059bbbee-8ca5-493d-8457-239e311f5181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:30.726805 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-059bbbee-8ca5-493d-8457-239e311f5181 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:30.727138 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76b974-c599-4aed-b166-3a5b40ec0ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:30.727743 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76b974-c599-4aed-b166-3a5b40ec0ead admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:30.728025 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76b974-c599-4aed-b166-3a5b40ec0ead admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:30.728188 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-059bbbee-8ca5-493d-8457-239e311f5181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:30.728342 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76b974-c599-4aed-b166-3a5b40ec0ead admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:30.729265 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76b974-c599-4aed-b166-3a5b40ec0ead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:30.731292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76b974-c599-4aed-b166-3a5b40ec0ead admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:30.737694 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 970/1946] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:53:30.748320 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353aa88e-1ce6-440e-8baa-a25ce107823a None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:30.748666 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353aa88e-1ce6-440e-8baa-a25ce107823a None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:30.748877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353aa88e-1ce6-440e-8baa-a25ce107823a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:30.759193 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 977/1947] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:53:30 2022] POST /identity/v3/users => generated 297 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:53:30.768300 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76b974-c599-4aed-b166-3a5b40ec0ead admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:30.771894 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-9e76b974-c599-4aed-b166-3a5b40ec0ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:30.778782 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-353aa88e-1ce6-440e-8baa-a25ce107823a None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:30.780150 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-353aa88e-1ce6-440e-8baa-a25ce107823a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:30.789789 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76b974-c599-4aed-b166-3a5b40ec0ead admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:30.798859 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ed36a-10a3-47d0-a3e5-9e11a5168df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:30.799524 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ed36a-10a3-47d0-a3e5-9e11a5168df7 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:30.799812 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ed36a-10a3-47d0-a3e5-9e11a5168df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:30.800099 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ed36a-10a3-47d0-a3e5-9e11a5168df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:30.800815 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ed36a-10a3-47d0-a3e5-9e11a5168df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:30.802558 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ed36a-10a3-47d0-a3e5-9e11a5168df7 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:30.823097 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 971/1948] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:53:30.827476 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353aa88e-1ce6-440e-8baa-a25ce107823a None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:30.828629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 978/1949] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:53:30.832795 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ed36a-10a3-47d0-a3e5-9e11a5168df7 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:30.844498 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353aa88e-1ce6-440e-8baa-a25ce107823a None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:30.851248 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ed36a-10a3-47d0-a3e5-9e11a5168df7 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:30.852882 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9c791-c3c6-4f2e-8620-29a4812038bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:30.854087 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9c791-c3c6-4f2e-8620-29a4812038bd admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:30.854512 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9c791-c3c6-4f2e-8620-29a4812038bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:30.855023 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9c791-c3c6-4f2e-8620-29a4812038bd admin admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:30.856250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc9c791-c3c6-4f2e-8620-29a4812038bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:53:30.864768 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc9c791-c3c6-4f2e-8620-29a4812038bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:30.866888 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd0d4b-9830-4df2-afd8-3ec0f1795e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:30.867660 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd0d4b-9830-4df2-afd8-3ec0f1795e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:30.867883 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc9c791-c3c6-4f2e-8620-29a4812038bd admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:30.868779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd0d4b-9830-4df2-afd8-3ec0f1795e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:30.868779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd0d4b-9830-4df2-afd8-3ec0f1795e64 admin admin] PATH_INFO: `/v3/projects/85152632b16d44fbbca8a169552686cc/users/020405521d1b4ca8917258da260e7a91/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:30.889172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 972/1950] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:53:30.903496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd0d4b-9830-4df2-afd8-3ec0f1795e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85152632b16d44fbbca8a169552686cc, user_id=020405521d1b4ca8917258da260e7a91, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:30.906412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd0d4b-9830-4df2-afd8-3ec0f1795e64 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:30.917192 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9c791-c3c6-4f2e-8620-29a4812038bd admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:30.928668 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 979/1951] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:53:30 2022] PUT /identity/v3/projects/85152632b16d44fbbca8a169552686cc/users/020405521d1b4ca8917258da260e7a91/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:30.933658 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd0d4b-9830-4df2-afd8-3ec0f1795e64 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:30.947121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9c791-c3c6-4f2e-8620-29a4812038bd admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:31.029860 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd0d4b-9830-4df2-afd8-3ec0f1795e64 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:31.034779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9376b80-c1c7-44a5-921d-0f5e19e28d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:31.035519 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9376b80-c1c7-44a5-921d-0f5e19e28d33 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:31.035865 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9376b80-c1c7-44a5-921d-0f5e19e28d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:31.036361 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9376b80-c1c7-44a5-921d-0f5e19e28d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:31.037150 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9376b80-c1c7-44a5-921d-0f5e19e28d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:31.038967 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9376b80-c1c7-44a5-921d-0f5e19e28d33 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:31.048076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bf8f3-559d-46d1-aa3e-3fa4e2b148d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:31.049369 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bf8f3-559d-46d1-aa3e-3fa4e2b148d0 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:31.049792 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bf8f3-559d-46d1-aa3e-3fa4e2b148d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:31.050133 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bf8f3-559d-46d1-aa3e-3fa4e2b148d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:31.052652 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992bf8f3-559d-46d1-aa3e-3fa4e2b148d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:31.054786 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992bf8f3-559d-46d1-aa3e-3fa4e2b148d0 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:31.058388 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 980/1952] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:53:31.059618 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9376b80-c1c7-44a5-921d-0f5e19e28d33 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:31.062874 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:31.072431 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9376b80-c1c7-44a5-921d-0f5e19e28d33 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:31.078474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aafda3-3526-4a2d-ad6e-1de04995a728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:31.079707 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aafda3-3526-4a2d-ad6e-1de04995a728 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:31.080140 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aafda3-3526-4a2d-ad6e-1de04995a728 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:31.080738 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aafda3-3526-4a2d-ad6e-1de04995a728 admin admin] PATH_INFO: `/v3/projects/85152632b16d44fbbca8a169552686cc/users/020405521d1b4ca8917258da260e7a91/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:31.084612 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aafda3-3526-4a2d-ad6e-1de04995a728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85152632b16d44fbbca8a169552686cc, user_id=020405521d1b4ca8917258da260e7a91, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:31.091267 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aafda3-3526-4a2d-ad6e-1de04995a728 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:31.129116 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 981/1953] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:53:31 2022] PUT /identity/v3/projects/85152632b16d44fbbca8a169552686cc/users/020405521d1b4ca8917258da260e7a91/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:31.129523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 973/1954] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:53:30 2022] POST /identity/v3/projects => generated 373 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:53:31.131916 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d8b62-4f8a-4888-b9ac-619453c27880 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:31.132353 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d8b62-4f8a-4888-b9ac-619453c27880 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:31.133097 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d8b62-4f8a-4888-b9ac-619453c27880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:31.135389 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bf8f3-559d-46d1-aa3e-3fa4e2b148d0 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:31.171029 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-ee2d8b62-4f8a-4888-b9ac-619453c27880 None None] MFA Rules not processed for user `020405521d1b4ca8917258da260e7a91`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:31.172320 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-ee2d8b62-4f8a-4888-b9ac-619453c27880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:31.187742 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:31.281147 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bf8f3-559d-46d1-aa3e-3fa4e2b148d0 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:31.287194 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb664b82-9823-4ce4-95b8-5ce57e8c08a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:31.287947 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb664b82-9823-4ce4-95b8-5ce57e8c08a9 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:31.288334 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb664b82-9823-4ce4-95b8-5ce57e8c08a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:31.288849 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb664b82-9823-4ce4-95b8-5ce57e8c08a9 admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:31.290146 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb664b82-9823-4ce4-95b8-5ce57e8c08a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:31.292611 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb664b82-9823-4ce4-95b8-5ce57e8c08a9 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:31.300124 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 982/1955] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:31.315185 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d8b62-4f8a-4888-b9ac-619453c27880 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:31.317334 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-ee2d8b62-4f8a-4888-b9ac-619453c27880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:31.340854 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 974/1956] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:53:31 2022] POST /identity/v3/users => generated 287 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:53:31.344937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb664b82-9823-4ce4-95b8-5ce57e8c08a9 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:31.358231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb664b82-9823-4ce4-95b8-5ce57e8c08a9 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:31.370532 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb0107-1f00-430e-b8f6-60c8e217eb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:31.371373 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb0107-1f00-430e-b8f6-60c8e217eb3b admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:31.371726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb0107-1f00-430e-b8f6-60c8e217eb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:31.372071 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb0107-1f00-430e-b8f6-60c8e217eb3b admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:31.372973 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb0107-1f00-430e-b8f6-60c8e217eb3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:31.375131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb0107-1f00-430e-b8f6-60c8e217eb3b admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:31.399081 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 975/1957] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:53:31.403417 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb0107-1f00-430e-b8f6-60c8e217eb3b admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:31.411397 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d8b62-4f8a-4888-b9ac-619453c27880 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:31.418439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9f304-10ef-43f7-8170-ae0d000f34a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:31.419104 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9f304-10ef-43f7-8170-ae0d000f34a2 service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:31.419385 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9f304-10ef-43f7-8170-ae0d000f34a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:31.419664 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9f304-10ef-43f7-8170-ae0d000f34a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:31.421937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb0107-1f00-430e-b8f6-60c8e217eb3b admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:31.430336 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbf4c5-d50d-402b-ae3e-144a39fa97a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:31.431575 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbf4c5-d50d-402b-ae3e-144a39fa97a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:31.432060 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbf4c5-d50d-402b-ae3e-144a39fa97a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:31.432435 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbf4c5-d50d-402b-ae3e-144a39fa97a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:31.433749 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fbf4c5-d50d-402b-ae3e-144a39fa97a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:31.437183 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fbf4c5-d50d-402b-ae3e-144a39fa97a3 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:31.450964 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9f304-10ef-43f7-8170-ae0d000f34a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:31.453133 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9f304-10ef-43f7-8170-ae0d000f34a2 service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:31.465059 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 976/1958] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:53:31.465850 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 983/1959] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:53:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:53:31.467075 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbf4c5-d50d-402b-ae3e-144a39fa97a3 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:31.484258 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbf4c5-d50d-402b-ae3e-144a39fa97a3 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:31.493681 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a8bc7-c8a8-43b7-9ce4-08c490973f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:31.494954 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a8bc7-c8a8-43b7-9ce4-08c490973f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:31.495426 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a8bc7-c8a8-43b7-9ce4-08c490973f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:31.495912 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a8bc7-c8a8-43b7-9ce4-08c490973f5f admin admin] PATH_INFO: `/v3/projects/7372ad4e3f724ad280b5b11fb595568f/users/581f486fd7604503a44f1267c79a8fae/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:31.528002 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a8bc7-c8a8-43b7-9ce4-08c490973f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7372ad4e3f724ad280b5b11fb595568f, user_id=581f486fd7604503a44f1267c79a8fae, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:31.534929 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a8bc7-c8a8-43b7-9ce4-08c490973f5f admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:31.582047 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 977/1960] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:53:31 2022] PUT /identity/v3/projects/7372ad4e3f724ad280b5b11fb595568f/users/581f486fd7604503a44f1267c79a8fae/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:31.589600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba342d-01fd-45d2-b12c-e315ec58c95e None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:31.589889 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba342d-01fd-45d2-b12c-e315ec58c95e None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:31.590202 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba342d-01fd-45d2-b12c-e315ec58c95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:31.646106 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-cbba342d-01fd-45d2-b12c-e315ec58c95e None None] MFA Rules not processed for user `581f486fd7604503a44f1267c79a8fae`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:31.650038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-cbba342d-01fd-45d2-b12c-e315ec58c95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:31.864712 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 984/1961] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:31.885201 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a8bc7-c8a8-43b7-9ce4-08c490973f5f admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:31.886956 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-de9a8bc7-c8a8-43b7-9ce4-08c490973f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:32.052000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a8bc7-c8a8-43b7-9ce4-08c490973f5f admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:32.057611 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7be506-284a-4978-b119-56c1d7c92440 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfbf2c03eb740ed8b72c4825cffc341', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:32.058336 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7be506-284a-4978-b119-56c1d7c92440 service glance] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:32.058755 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7be506-284a-4978-b119-56c1d7c92440 service glance] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:32.059031 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7be506-284a-4978-b119-56c1d7c92440 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:32.088528 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7be506-284a-4978-b119-56c1d7c92440 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:32.090737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7be506-284a-4978-b119-56c1d7c92440 service glance] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:32.111905 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 978/1962] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:53:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:53:32.401022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba342d-01fd-45d2-b12c-e315ec58c95e None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:32.511693 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:32.533753 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba342d-01fd-45d2-b12c-e315ec58c95e None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:32.541064 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa264e8f-29aa-4594-b9d2-6943278331e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:32.541865 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa264e8f-29aa-4594-b9d2-6943278331e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:32.542283 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa264e8f-29aa-4594-b9d2-6943278331e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:32.542624 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa264e8f-29aa-4594-b9d2-6943278331e5 admin admin] PATH_INFO: `/v3/users/a2f95d3e39d64628b0c524322afec289` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:32.544757 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa264e8f-29aa-4594-b9d2-6943278331e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2f95d3e39d64628b0c524322afec289)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:32.547125 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa264e8f-29aa-4594-b9d2-6943278331e5 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:32.635932 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-aa264e8f-29aa-4594-b9d2-6943278331e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2f95d3e39d64628b0c524322afec289'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:32.636818 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-aa264e8f-29aa-4594-b9d2-6943278331e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2f95d3e39d64628b0c524322afec289'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:32.647837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-aa264e8f-29aa-4594-b9d2-6943278331e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2f95d3e39d64628b0c524322afec289'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:32.667533 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-aa264e8f-29aa-4594-b9d2-6943278331e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2f95d3e39d64628b0c524322afec289'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:32.683893 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-aa264e8f-29aa-4594-b9d2-6943278331e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2f95d3e39d64628b0c524322afec289'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:32.696690 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 985/1963] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:53:32 2022] DELETE /identity/v3/users/a2f95d3e39d64628b0c524322afec289 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:32.701434 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc146c5-c699-4636-9aab-a1343dae2361 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:32.702123 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc146c5-c699-4636-9aab-a1343dae2361 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:32.702123 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc146c5-c699-4636-9aab-a1343dae2361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:32.735969 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-3bc146c5-c699-4636-9aab-a1343dae2361 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:32.738232 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-3bc146c5-c699-4636-9aab-a1343dae2361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:32.779273 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:32.841017 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 979/1964] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:53:32.852927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa264e8f-29aa-4594-b9d2-6943278331e5 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:32.854762 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-aa264e8f-29aa-4594-b9d2-6943278331e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:32.956638 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa264e8f-29aa-4594-b9d2-6943278331e5 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:32.971199 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a9f32-ff04-4473-acb3-96788ad1cb51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:32.972504 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a9f32-ff04-4473-acb3-96788ad1cb51 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:32.972622 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a9f32-ff04-4473-acb3-96788ad1cb51 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:32.973063 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a9f32-ff04-4473-acb3-96788ad1cb51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:32.996987 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a9f32-ff04-4473-acb3-96788ad1cb51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:32.998982 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a9f32-ff04-4473-acb3-96788ad1cb51 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:33.012629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 986/1965] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:53:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:53:33.478089 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc146c5-c699-4636-9aab-a1343dae2361 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:33.479466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-3bc146c5-c699-4636-9aab-a1343dae2361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:33.494856 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc146c5-c699-4636-9aab-a1343dae2361 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:33.499796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c98758-9611-4e3e-9541-89a89d1b1fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:33.500550 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c98758-9611-4e3e-9541-89a89d1b1fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:33.500976 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c98758-9611-4e3e-9541-89a89d1b1fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:33.501255 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c98758-9611-4e3e-9541-89a89d1b1fd9 admin admin] PATH_INFO: `/v3/projects/b9b438835b824b4bad98b127f485cef8` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:33.502502 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c98758-9611-4e3e-9541-89a89d1b1fd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9b438835b824b4bad98b127f485cef8)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:33.504495 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c98758-9611-4e3e-9541-89a89d1b1fd9 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:33.575573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-c3c98758-9611-4e3e-9541-89a89d1b1fd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9b438835b824b4bad98b127f485cef8', 'request_id': 'req-c3c98758-9611-4e3e-9541-89a89d1b1fd9'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:33.586964 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-c3c98758-9611-4e3e-9541-89a89d1b1fd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9b438835b824b4bad98b127f485cef8', 'request_id': 'req-c3c98758-9611-4e3e-9541-89a89d1b1fd9'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:33.599050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-c3c98758-9611-4e3e-9541-89a89d1b1fd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9b438835b824b4bad98b127f485cef8', 'request_id': 'req-c3c98758-9611-4e3e-9541-89a89d1b1fd9'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:33.632562 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-c3c98758-9611-4e3e-9541-89a89d1b1fd9 admin admin] The token cache is being invalidate because project b9b438835b824b4bad98b127f485cef8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:53:33.632853 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-c3c98758-9611-4e3e-9541-89a89d1b1fd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:33.633761 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-c3c98758-9611-4e3e-9541-89a89d1b1fd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:33.636404 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 980/1966] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:53:33 2022] DELETE /identity/v3/projects/b9b438835b824b4bad98b127f485cef8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:33.641063 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a9f32-ff04-4473-acb3-96788ad1cb51 service neutron] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:33.657825 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a9f32-ff04-4473-acb3-96788ad1cb51 service neutron] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:33.801593 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160452b-f4c1-4d5e-a44f-66938a47fd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:33.802478 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160452b-f4c1-4d5e-a44f-66938a47fd05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:33.802768 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160452b-f4c1-4d5e-a44f-66938a47fd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:33.803043 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160452b-f4c1-4d5e-a44f-66938a47fd05 admin admin] PATH_INFO: `/v3/users/020405521d1b4ca8917258da260e7a91` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:33.804394 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160452b-f4c1-4d5e-a44f-66938a47fd05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=020405521d1b4ca8917258da260e7a91)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:33.806622 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160452b-f4c1-4d5e-a44f-66938a47fd05 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:33.817051 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:33.945634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-4160452b-f4c1-4d5e-a44f-66938a47fd05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '020405521d1b4ca8917258da260e7a91'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:33.946594 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-4160452b-f4c1-4d5e-a44f-66938a47fd05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '020405521d1b4ca8917258da260e7a91'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:33.957840 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-4160452b-f4c1-4d5e-a44f-66938a47fd05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '020405521d1b4ca8917258da260e7a91'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:34.022733 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-4160452b-f4c1-4d5e-a44f-66938a47fd05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '020405521d1b4ca8917258da260e7a91'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:34.067099 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-4160452b-f4c1-4d5e-a44f-66938a47fd05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '020405521d1b4ca8917258da260e7a91'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:34.088045 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 987/1967] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:53:33 2022] DELETE /identity/v3/users/020405521d1b4ca8917258da260e7a91 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:34.569538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c98758-9611-4e3e-9541-89a89d1b1fd9 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:34.574028 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-c3c98758-9611-4e3e-9541-89a89d1b1fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:34.599822 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c98758-9611-4e3e-9541-89a89d1b1fd9 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:34.702186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd81063-152c-4bc0-b3e9-cda63830f8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:34.702888 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd81063-152c-4bc0-b3e9-cda63830f8a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:34.703162 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd81063-152c-4bc0-b3e9-cda63830f8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:34.703431 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd81063-152c-4bc0-b3e9-cda63830f8a0 admin admin] PATH_INFO: `/v3/projects/85152632b16d44fbbca8a169552686cc` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:34.704749 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd81063-152c-4bc0-b3e9-cda63830f8a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85152632b16d44fbbca8a169552686cc)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:34.706624 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd81063-152c-4bc0-b3e9-cda63830f8a0 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:34.767644 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-ccd81063-152c-4bc0-b3e9-cda63830f8a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85152632b16d44fbbca8a169552686cc', 'request_id': 'req-ccd81063-152c-4bc0-b3e9-cda63830f8a0'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:34.778115 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-ccd81063-152c-4bc0-b3e9-cda63830f8a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85152632b16d44fbbca8a169552686cc', 'request_id': 'req-ccd81063-152c-4bc0-b3e9-cda63830f8a0'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:34.781305 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:34.790790 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-ccd81063-152c-4bc0-b3e9-cda63830f8a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85152632b16d44fbbca8a169552686cc', 'request_id': 'req-ccd81063-152c-4bc0-b3e9-cda63830f8a0'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:34.806015 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-ccd81063-152c-4bc0-b3e9-cda63830f8a0 admin admin] The token cache is being invalidate because project 85152632b16d44fbbca8a169552686cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:53:34.806315 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-ccd81063-152c-4bc0-b3e9-cda63830f8a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:34.807090 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-ccd81063-152c-4bc0-b3e9-cda63830f8a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:34.808692 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 981/1968] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:53:34 2022] DELETE /identity/v3/projects/85152632b16d44fbbca8a169552686cc => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:34.813689 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3fab6-46a4-49b2-9664-1eda257618c7 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:34.814311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3fab6-46a4-49b2-9664-1eda257618c7 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:34.814311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3fab6-46a4-49b2-9664-1eda257618c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:34.839240 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-7be3fab6-46a4-49b2-9664-1eda257618c7 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:34.840560 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-7be3fab6-46a4-49b2-9664-1eda257618c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:34.916438 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 988/1969] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:34.924754 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2ffa8-ee1e-4b65-8a82-402d4ad50c49 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:34.925036 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2ffa8-ee1e-4b65-8a82-402d4ad50c49 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:34.925314 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a2ffa8-ee1e-4b65-8a82-402d4ad50c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:34.948406 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-15a2ffa8-ee1e-4b65-8a82-402d4ad50c49 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:34.949796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-15a2ffa8-ee1e-4b65-8a82-402d4ad50c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:34.958918 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 982/1970] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:34.963710 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3fab6-46a4-49b2-9664-1eda257618c7 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:34.978237 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3fab6-46a4-49b2-9664-1eda257618c7 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:34.984300 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf682ab-f563-4fef-994c-7115f9f7a640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:34.985287 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf682ab-f563-4fef-994c-7115f9f7a640 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:34.985633 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf682ab-f563-4fef-994c-7115f9f7a640 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:34.986009 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf682ab-f563-4fef-994c-7115f9f7a640 admin admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:34.986957 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf682ab-f563-4fef-994c-7115f9f7a640 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:53:34.987335 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf682ab-f563-4fef-994c-7115f9f7a640 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:34.989571 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf682ab-f563-4fef-994c-7115f9f7a640 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:35.002751 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 989/1971] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:53:35.007199 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2ffa8-ee1e-4b65-8a82-402d4ad50c49 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:35.017164 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a2ffa8-ee1e-4b65-8a82-402d4ad50c49 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:35.022315 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948db8e-e554-4f5b-9411-962bc10b22e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:35.023097 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948db8e-e554-4f5b-9411-962bc10b22e1 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:35.023717 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948db8e-e554-4f5b-9411-962bc10b22e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:35.024003 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948db8e-e554-4f5b-9411-962bc10b22e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:35.024796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948db8e-e554-4f5b-9411-962bc10b22e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:35.027146 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948db8e-e554-4f5b-9411-962bc10b22e1 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:35.061789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 983/1972] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:53:35 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:53:35.065858 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf682ab-f563-4fef-994c-7115f9f7a640 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:35.081664 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf682ab-f563-4fef-994c-7115f9f7a640 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:35.172723 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f73ed9-74c2-4cbd-88d1-e14c3d982d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:35.173361 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f73ed9-74c2-4cbd-88d1-e14c3d982d91 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:35.173643 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f73ed9-74c2-4cbd-88d1-e14c3d982d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:35.173917 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f73ed9-74c2-4cbd-88d1-e14c3d982d91 admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:35.176429 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f73ed9-74c2-4cbd-88d1-e14c3d982d91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:35.178492 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f73ed9-74c2-4cbd-88d1-e14c3d982d91 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:35.204025 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 990/1973] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:53:35 2022] POST /identity/v3/users => generated 289 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:53:35.205357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948db8e-e554-4f5b-9411-962bc10b22e1 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:35.216322 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948db8e-e554-4f5b-9411-962bc10b22e1 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:35.225889 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6691a-c96c-4ad7-a760-c3cfcb1d69d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:35.226681 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6691a-c96c-4ad7-a760-c3cfcb1d69d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:35.226920 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6691a-c96c-4ad7-a760-c3cfcb1d69d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:35.227198 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6691a-c96c-4ad7-a760-c3cfcb1d69d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:35.228106 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6691a-c96c-4ad7-a760-c3cfcb1d69d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:35.231279 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6691a-c96c-4ad7-a760-c3cfcb1d69d4 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:35.244225 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 984/1974] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:53:35.247446 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f73ed9-74c2-4cbd-88d1-e14c3d982d91 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:35.254408 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:35.263637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f73ed9-74c2-4cbd-88d1-e14c3d982d91 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:35.279304 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4f61a6-2e7d-4842-85be-37a405f4df58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:35.280330 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f61a6-2e7d-4842-85be-37a405f4df58 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:35.280768 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f61a6-2e7d-4842-85be-37a405f4df58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:35.281180 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4f61a6-2e7d-4842-85be-37a405f4df58 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:35.282081 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f61a6-2e7d-4842-85be-37a405f4df58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:35.284447 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4f61a6-2e7d-4842-85be-37a405f4df58 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:35.299151 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 991/1975] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:53:35.303494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6691a-c96c-4ad7-a760-c3cfcb1d69d4 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:35.315802 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6691a-c96c-4ad7-a760-c3cfcb1d69d4 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:35.321713 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32da20-5dfe-4268-824a-aa3e14157550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:35.322455 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32da20-5dfe-4268-824a-aa3e14157550 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:35.322738 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32da20-5dfe-4268-824a-aa3e14157550 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:35.323573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32da20-5dfe-4268-824a-aa3e14157550 admin admin] PATH_INFO: `/v3/projects/4fad356dca2149998419bac739306b9e/users/2b19b86d1c5740588ac42f9d234c8ddc/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:35.343809 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32da20-5dfe-4268-824a-aa3e14157550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fad356dca2149998419bac739306b9e, user_id=2b19b86d1c5740588ac42f9d234c8ddc, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:35.347028 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32da20-5dfe-4268-824a-aa3e14157550 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:35.365654 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 985/1976] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:53:35 2022] PUT /identity/v3/projects/4fad356dca2149998419bac739306b9e/users/2b19b86d1c5740588ac42f9d234c8ddc/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:35.378813 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb838d-fd4d-43d9-bb5f-f24c4790d519 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:35.380031 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb838d-fd4d-43d9-bb5f-f24c4790d519 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:35.380446 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb838d-fd4d-43d9-bb5f-f24c4790d519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:35.424691 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-83cb838d-fd4d-43d9-bb5f-f24c4790d519 None None] MFA Rules not processed for user `2b19b86d1c5740588ac42f9d234c8ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:35.425966 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-83cb838d-fd4d-43d9-bb5f-f24c4790d519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:35.542368 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 992/1977] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:35.549745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32da20-5dfe-4268-824a-aa3e14157550 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:35.551925 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-1c32da20-5dfe-4268-824a-aa3e14157550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:35.618136 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32da20-5dfe-4268-824a-aa3e14157550 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:35.621885 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b00120-4231-467b-9d10-77da90cdd173 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:35.622563 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b00120-4231-467b-9d10-77da90cdd173 service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:35.622864 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b00120-4231-467b-9d10-77da90cdd173 service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:35.623130 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b00120-4231-467b-9d10-77da90cdd173 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:35.632963 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b00120-4231-467b-9d10-77da90cdd173 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:35.634426 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b00120-4231-467b-9d10-77da90cdd173 service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:35.644189 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 986/1978] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:53:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:53:45.531941 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=36 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:45.639465 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=58,keystone:DELETE=1,keystone:INSERT=2 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:48.696595 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb838d-fd4d-43d9-bb5f-f24c4790d519 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:48.770237 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb838d-fd4d-43d9-bb5f-f24c4790d519 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:48.775901 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedcac6-6844-4461-8d9a-6d4f6f1b3abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:48.776611 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedcac6-6844-4461-8d9a-6d4f6f1b3abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:48.776903 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedcac6-6844-4461-8d9a-6d4f6f1b3abc admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:48.778565 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedcac6-6844-4461-8d9a-6d4f6f1b3abc admin admin] PATH_INFO: `/v3/users/2b19b86d1c5740588ac42f9d234c8ddc` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:48.778565 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caedcac6-6844-4461-8d9a-6d4f6f1b3abc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b19b86d1c5740588ac42f9d234c8ddc)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:48.780637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caedcac6-6844-4461-8d9a-6d4f6f1b3abc admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:48.840452 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-caedcac6-6844-4461-8d9a-6d4f6f1b3abc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b19b86d1c5740588ac42f9d234c8ddc'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:48.841123 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-caedcac6-6844-4461-8d9a-6d4f6f1b3abc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b19b86d1c5740588ac42f9d234c8ddc'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:48.849373 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-caedcac6-6844-4461-8d9a-6d4f6f1b3abc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b19b86d1c5740588ac42f9d234c8ddc'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:48.862381 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-caedcac6-6844-4461-8d9a-6d4f6f1b3abc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b19b86d1c5740588ac42f9d234c8ddc'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:48.870562 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-caedcac6-6844-4461-8d9a-6d4f6f1b3abc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b19b86d1c5740588ac42f9d234c8ddc'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:48.878948 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 993/1979] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:53:48 2022] DELETE /identity/v3/users/2b19b86d1c5740588ac42f9d234c8ddc => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:48.884701 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fe866-e8fa-4a46-8f65-7f3bc0902436 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:48.885399 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fe866-e8fa-4a46-8f65-7f3bc0902436 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:48.885399 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fe866-e8fa-4a46-8f65-7f3bc0902436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:48.909405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-2d2fe866-e8fa-4a46-8f65-7f3bc0902436 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:48.910683 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-2d2fe866-e8fa-4a46-8f65-7f3bc0902436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:48.994257 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 987/1980] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:49.005341 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedcac6-6844-4461-8d9a-6d4f6f1b3abc admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:49.007506 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-caedcac6-6844-4461-8d9a-6d4f6f1b3abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:49.074623 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caedcac6-6844-4461-8d9a-6d4f6f1b3abc admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:49.078811 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce879a6f-f9b1-430b-9d95-5f6e97c9baeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:49.079527 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce879a6f-f9b1-430b-9d95-5f6e97c9baeb service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:49.080007 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce879a6f-f9b1-430b-9d95-5f6e97c9baeb service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:49.080352 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce879a6f-f9b1-430b-9d95-5f6e97c9baeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:49.092056 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce879a6f-f9b1-430b-9d95-5f6e97c9baeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:49.093623 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce879a6f-f9b1-430b-9d95-5f6e97c9baeb service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:49.114206 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 994/1981] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:53:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:53:49.407507 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2fe866-e8fa-4a46-8f65-7f3bc0902436 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:49.409008 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-2d2fe866-e8fa-4a46-8f65-7f3bc0902436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:49.424732 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2fe866-e8fa-4a46-8f65-7f3bc0902436 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:49.430652 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e91771-fb5f-467a-8684-ff87f52d69a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:49.431287 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e91771-fb5f-467a-8684-ff87f52d69a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:49.431575 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e91771-fb5f-467a-8684-ff87f52d69a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:49.431848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e91771-fb5f-467a-8684-ff87f52d69a7 admin admin] PATH_INFO: `/v3/projects/4fad356dca2149998419bac739306b9e` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:49.440704 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e91771-fb5f-467a-8684-ff87f52d69a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fad356dca2149998419bac739306b9e)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:49.442837 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e91771-fb5f-467a-8684-ff87f52d69a7 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:49.491963 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-45e91771-fb5f-467a-8684-ff87f52d69a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fad356dca2149998419bac739306b9e', 'request_id': 'req-45e91771-fb5f-467a-8684-ff87f52d69a7'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:49.501108 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-45e91771-fb5f-467a-8684-ff87f52d69a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fad356dca2149998419bac739306b9e', 'request_id': 'req-45e91771-fb5f-467a-8684-ff87f52d69a7'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:49.507817 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-45e91771-fb5f-467a-8684-ff87f52d69a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fad356dca2149998419bac739306b9e', 'request_id': 'req-45e91771-fb5f-467a-8684-ff87f52d69a7'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:49.519891 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-45e91771-fb5f-467a-8684-ff87f52d69a7 admin admin] The token cache is being invalidate because project 4fad356dca2149998419bac739306b9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:53:49.520236 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-45e91771-fb5f-467a-8684-ff87f52d69a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:49.520914 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-45e91771-fb5f-467a-8684-ff87f52d69a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:49.522552 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 988/1982] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:53:49 2022] DELETE /identity/v3/projects/4fad356dca2149998419bac739306b9e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:49.527716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1fef1-e854-45d8-93dc-20fa461f9f2f None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:49.528005 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1fef1-e854-45d8-93dc-20fa461f9f2f None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:49.528284 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1fef1-e854-45d8-93dc-20fa461f9f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:49.551486 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-b7a1fef1-e854-45d8-93dc-20fa461f9f2f None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:49.552874 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-b7a1fef1-e854-45d8-93dc-20fa461f9f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:49.582131 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:49.636406 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 995/1983] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:49.644606 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420a7b1-0924-4011-a73d-6743ea9fb8dc None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:49.644979 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420a7b1-0924-4011-a73d-6743ea9fb8dc None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:49.645320 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420a7b1-0924-4011-a73d-6743ea9fb8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:49.667202 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-d420a7b1-0924-4011-a73d-6743ea9fb8dc None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:49.668713 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-d420a7b1-0924-4011-a73d-6743ea9fb8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:49.682560 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 989/1984] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:49.687458 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1fef1-e854-45d8-93dc-20fa461f9f2f None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:49.698393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1fef1-e854-45d8-93dc-20fa461f9f2f None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:49.704176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991b342-8332-40b7-85ad-1d4a6534f1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:49.704824 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991b342-8332-40b7-85ad-1d4a6534f1eb admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:49.705137 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991b342-8332-40b7-85ad-1d4a6534f1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:49.705429 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991b342-8332-40b7-85ad-1d4a6534f1eb admin admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:49.706164 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991b342-8332-40b7-85ad-1d4a6534f1eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:53:49.706472 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991b342-8332-40b7-85ad-1d4a6534f1eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:49.708164 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991b342-8332-40b7-85ad-1d4a6534f1eb admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:49.725189 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 996/1985] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:53:49.726525 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420a7b1-0924-4011-a73d-6743ea9fb8dc None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:49.737281 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420a7b1-0924-4011-a73d-6743ea9fb8dc None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:49.743433 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdc6a8-2ab2-4d6e-bc2f-98bedc1f05b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:49.744384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdc6a8-2ab2-4d6e-bc2f-98bedc1f05b6 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:49.744747 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdc6a8-2ab2-4d6e-bc2f-98bedc1f05b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:49.745099 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdc6a8-2ab2-4d6e-bc2f-98bedc1f05b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:49.745888 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cdc6a8-2ab2-4d6e-bc2f-98bedc1f05b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:49.748041 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cdc6a8-2ab2-4d6e-bc2f-98bedc1f05b6 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:49.784998 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 990/1986] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:53:49 2022] POST /identity/v3/projects => generated 363 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:53:49.786541 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991b342-8332-40b7-85ad-1d4a6534f1eb admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:49.803397 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991b342-8332-40b7-85ad-1d4a6534f1eb admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:49.901016 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45881e-113c-4c6f-9fe3-d8b299448b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:49.902079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45881e-113c-4c6f-9fe3-d8b299448b57 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:49.902515 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45881e-113c-4c6f-9fe3-d8b299448b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:49.902797 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b45881e-113c-4c6f-9fe3-d8b299448b57 admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:49.903561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45881e-113c-4c6f-9fe3-d8b299448b57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:49.907139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b45881e-113c-4c6f-9fe3-d8b299448b57 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:49.933228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 997/1987] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:53:49 2022] POST /identity/v3/users => generated 282 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:53:49.935646 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdc6a8-2ab2-4d6e-bc2f-98bedc1f05b6 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:49.952967 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdc6a8-2ab2-4d6e-bc2f-98bedc1f05b6 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:49.959224 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1309e-62ff-4e9b-952d-ce1f9db09229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:49.960106 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1309e-62ff-4e9b-952d-ce1f9db09229 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:49.960491 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1309e-62ff-4e9b-952d-ce1f9db09229 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:49.960856 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1309e-62ff-4e9b-952d-ce1f9db09229 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:49.961773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1309e-62ff-4e9b-952d-ce1f9db09229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:49.963426 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1309e-62ff-4e9b-952d-ce1f9db09229 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:49.974898 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 991/1988] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:53:49.978995 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45881e-113c-4c6f-9fe3-d8b299448b57 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:49.991047 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b45881e-113c-4c6f-9fe3-d8b299448b57 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:49.995912 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2749baf5-6798-43cb-90c0-a19aa27df800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:49.996483 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749baf5-6798-43cb-90c0-a19aa27df800 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:49.996767 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749baf5-6798-43cb-90c0-a19aa27df800 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:49.997046 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749baf5-6798-43cb-90c0-a19aa27df800 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:49.997750 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749baf5-6798-43cb-90c0-a19aa27df800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:49.999431 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2749baf5-6798-43cb-90c0-a19aa27df800 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:50.012664 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 998/1989] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:53:50.016392 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1309e-62ff-4e9b-952d-ce1f9db09229 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:50.029799 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1309e-62ff-4e9b-952d-ce1f9db09229 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:50.035000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e49757-6290-47e3-8fe1-135ee3201ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:50.035795 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e49757-6290-47e3-8fe1-135ee3201ed3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:50.036085 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e49757-6290-47e3-8fe1-135ee3201ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:50.036364 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e49757-6290-47e3-8fe1-135ee3201ed3 admin admin] PATH_INFO: `/v3/projects/f81fdade2b60498fbfb91de2916e73f9/users/0bbb02e92c194d23be0276d13ae81f43/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:50.055378 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e49757-6290-47e3-8fe1-135ee3201ed3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f81fdade2b60498fbfb91de2916e73f9, user_id=0bbb02e92c194d23be0276d13ae81f43, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:50.058371 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e49757-6290-47e3-8fe1-135ee3201ed3 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:50.083595 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 992/1990] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:53:50 2022] PUT /identity/v3/projects/f81fdade2b60498fbfb91de2916e73f9/users/0bbb02e92c194d23be0276d13ae81f43/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:50.159791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83575547-fe17-44b4-a84e-49b03e2e738c None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:50.160193 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83575547-fe17-44b4-a84e-49b03e2e738c None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:50.160401 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83575547-fe17-44b4-a84e-49b03e2e738c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:50.195389 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-83575547-fe17-44b4-a84e-49b03e2e738c None None] MFA Rules not processed for user `0bbb02e92c194d23be0276d13ae81f43`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:50.196657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-83575547-fe17-44b4-a84e-49b03e2e738c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:50.284762 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 999/1991] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:50 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:50.296353 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e49757-6290-47e3-8fe1-135ee3201ed3 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:50.299098 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-a8e49757-6290-47e3-8fe1-135ee3201ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:50.324991 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:50.391076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e49757-6290-47e3-8fe1-135ee3201ed3 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:50.395709 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955cf765-7e54-4840-bcbe-bc57a5e3ffa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:50.396351 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cf765-7e54-4840-bcbe-bc57a5e3ffa3 service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:50.396641 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cf765-7e54-4840-bcbe-bc57a5e3ffa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:50.396926 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955cf765-7e54-4840-bcbe-bc57a5e3ffa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:50.407092 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955cf765-7e54-4840-bcbe-bc57a5e3ffa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:50.408555 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955cf765-7e54-4840-bcbe-bc57a5e3ffa3 service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:50.419075 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 993/1992] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:53:50 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:53:52.602785 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956ecc2-d7be-4943-9676-9ffe5f5410cb None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:52.603255 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956ecc2-d7be-4943-9676-9ffe5f5410cb None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:52.603335 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3956ecc2-d7be-4943-9676-9ffe5f5410cb None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:52.604769 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1000/1993] 10.222.0.39 () {54 vars in 921 bytes} [Tue Jul 26 04:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:53:52.633169 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094aaa9-b6d1-4a00-831f-156e18d3ef2d None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:52.633742 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094aaa9-b6d1-4a00-831f-156e18d3ef2d None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:52.633832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094aaa9-b6d1-4a00-831f-156e18d3ef2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:52.656794 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-b094aaa9-b6d1-4a00-831f-156e18d3ef2d None None] MFA Rules not processed for user `21dfe7b4d6524ec2885224d77395b00b`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:52.658075 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-b094aaa9-b6d1-4a00-831f-156e18d3ef2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:52.671734 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956ecc2-d7be-4943-9676-9ffe5f5410cb None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:52.673946 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-3956ecc2-d7be-4943-9676-9ffe5f5410cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:52.696219 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:52.735124 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 994/1994] 10.222.0.39 () {58 vars in 1018 bytes} [Tue Jul 26 04:53:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:52.746051 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3956ecc2-d7be-4943-9676-9ffe5f5410cb None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:52.747082 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094aaa9-b6d1-4a00-831f-156e18d3ef2d None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:52.748445 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-b094aaa9-b6d1-4a00-831f-156e18d3ef2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:52.751672 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf8a43-fec1-40ee-96a5-2a517da31502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:52.752219 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf8a43-fec1-40ee-96a5-2a517da31502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:52.752492 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf8a43-fec1-40ee-96a5-2a517da31502 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:52.752772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf8a43-fec1-40ee-96a5-2a517da31502 admin admin] PATH_INFO: `/v3/users/bc75a3d22654405990651c3f5d8f01e9` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:52.754090 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf8a43-fec1-40ee-96a5-2a517da31502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc75a3d22654405990651c3f5d8f01e9)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:52.756115 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf8a43-fec1-40ee-96a5-2a517da31502 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:52.762487 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094aaa9-b6d1-4a00-831f-156e18d3ef2d None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:52.772380 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd945d-2beb-43ff-a2be-6ab3f3be583f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21dfe7b4d6524ec2885224d77395b00b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:52.773026 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd945d-2beb-43ff-a2be-6ab3f3be583f service placement] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:52.773362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd945d-2beb-43ff-a2be-6ab3f3be583f service placement] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:52.773753 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd945d-2beb-43ff-a2be-6ab3f3be583f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:52.783012 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd945d-2beb-43ff-a2be-6ab3f3be583f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:52.784979 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebd945d-2beb-43ff-a2be-6ab3f3be583f service placement] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:52.798062 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 995/1995] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:53:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:53:52.812786 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-e0bf8a43-fec1-40ee-96a5-2a517da31502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc75a3d22654405990651c3f5d8f01e9'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:52.813452 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-e0bf8a43-fec1-40ee-96a5-2a517da31502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc75a3d22654405990651c3f5d8f01e9'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:52.821703 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-e0bf8a43-fec1-40ee-96a5-2a517da31502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc75a3d22654405990651c3f5d8f01e9'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:52.834374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-e0bf8a43-fec1-40ee-96a5-2a517da31502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc75a3d22654405990651c3f5d8f01e9'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:52.842735 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-e0bf8a43-fec1-40ee-96a5-2a517da31502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc75a3d22654405990651c3f5d8f01e9'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:52.849538 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1001/1996] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:53:52 2022] DELETE /identity/v3/users/bc75a3d22654405990651c3f5d8f01e9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:53.031507 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd945d-2beb-43ff-a2be-6ab3f3be583f service placement] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:53.044422 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd945d-2beb-43ff-a2be-6ab3f3be583f service placement] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:53.105440 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde0eeb-22d5-44b9-a225-df70dbd052a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:53.106033 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde0eeb-22d5-44b9-a225-df70dbd052a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:53.106330 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde0eeb-22d5-44b9-a225-df70dbd052a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:53.106584 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde0eeb-22d5-44b9-a225-df70dbd052a8 admin admin] PATH_INFO: `/v3/projects/c4ba838e0b174dcda55c682f656a35df` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:53.107730 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde0eeb-22d5-44b9-a225-df70dbd052a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4ba838e0b174dcda55c682f656a35df)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:53.109661 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde0eeb-22d5-44b9-a225-df70dbd052a8 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:53.157036 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:53.158690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2cde0eeb-22d5-44b9-a225-df70dbd052a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4ba838e0b174dcda55c682f656a35df', 'request_id': 'req-2cde0eeb-22d5-44b9-a225-df70dbd052a8'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:53.168431 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2cde0eeb-22d5-44b9-a225-df70dbd052a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4ba838e0b174dcda55c682f656a35df', 'request_id': 'req-2cde0eeb-22d5-44b9-a225-df70dbd052a8'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:53.174436 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2cde0eeb-22d5-44b9-a225-df70dbd052a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4ba838e0b174dcda55c682f656a35df', 'request_id': 'req-2cde0eeb-22d5-44b9-a225-df70dbd052a8'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:53.185779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2cde0eeb-22d5-44b9-a225-df70dbd052a8 admin admin] The token cache is being invalidate because project c4ba838e0b174dcda55c682f656a35df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:53:53.186106 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2cde0eeb-22d5-44b9-a225-df70dbd052a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:53.186748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2cde0eeb-22d5-44b9-a225-df70dbd052a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:53.188283 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 996/1997] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:53:53 2022] DELETE /identity/v3/projects/c4ba838e0b174dcda55c682f656a35df => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:53.193523 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50daff-8f1f-45de-9b45-f586166f6b09 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:53.193816 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50daff-8f1f-45de-9b45-f586166f6b09 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:53.194217 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50daff-8f1f-45de-9b45-f586166f6b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:53.215797 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-5e50daff-8f1f-45de-9b45-f586166f6b09 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:53.217026 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-5e50daff-8f1f-45de-9b45-f586166f6b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:53.292429 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1002/1998] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:53.300977 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d22ff-bc5e-44ff-894f-ef77f8b693f8 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:53.301263 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d22ff-bc5e-44ff-894f-ef77f8b693f8 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:53.301567 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d22ff-bc5e-44ff-894f-ef77f8b693f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:53.322970 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-6d0d22ff-bc5e-44ff-894f-ef77f8b693f8 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:53.324196 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-6d0d22ff-bc5e-44ff-894f-ef77f8b693f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:53.332197 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 997/1999] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:53.336875 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50daff-8f1f-45de-9b45-f586166f6b09 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:53.347536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50daff-8f1f-45de-9b45-f586166f6b09 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:53.353074 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79be890-8fbd-40e1-b0e3-4362d348353d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:53.353693 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79be890-8fbd-40e1-b0e3-4362d348353d admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:53.353994 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79be890-8fbd-40e1-b0e3-4362d348353d admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:53.354284 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79be890-8fbd-40e1-b0e3-4362d348353d admin admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:53.354970 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79be890-8fbd-40e1-b0e3-4362d348353d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:53:53.355277 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79be890-8fbd-40e1-b0e3-4362d348353d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:53.356986 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79be890-8fbd-40e1-b0e3-4362d348353d admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:53.374007 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1003/2000] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:53:53.375485 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d22ff-bc5e-44ff-894f-ef77f8b693f8 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:53.385419 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d22ff-bc5e-44ff-894f-ef77f8b693f8 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:53.390432 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9a2f7-df01-4aff-bcdb-67dcf60b7042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:53.391059 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9a2f7-df01-4aff-bcdb-67dcf60b7042 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:53.391333 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9a2f7-df01-4aff-bcdb-67dcf60b7042 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:53.391600 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9a2f7-df01-4aff-bcdb-67dcf60b7042 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:53.392277 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9a2f7-df01-4aff-bcdb-67dcf60b7042 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:53.394222 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9a2f7-df01-4aff-bcdb-67dcf60b7042 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:53.425108 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 998/2001] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:53:53 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:53:53.430176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79be890-8fbd-40e1-b0e3-4362d348353d admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:53.440366 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79be890-8fbd-40e1-b0e3-4362d348353d admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:53.461650 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:53.502950 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f36cff-d3d1-4215-85af-24dcc69b6da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:53.503561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f36cff-d3d1-4215-85af-24dcc69b6da2 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:53.503851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f36cff-d3d1-4215-85af-24dcc69b6da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:53.504123 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f36cff-d3d1-4215-85af-24dcc69b6da2 admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:53.504889 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f36cff-d3d1-4215-85af-24dcc69b6da2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:53.506962 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f36cff-d3d1-4215-85af-24dcc69b6da2 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:53.532851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1004/2002] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:53:53 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:53:53.538083 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9a2f7-df01-4aff-bcdb-67dcf60b7042 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:53.550942 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9a2f7-df01-4aff-bcdb-67dcf60b7042 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:53.556055 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe89f24-a6ea-4e20-91d2-546da6512e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:53.556703 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe89f24-a6ea-4e20-91d2-546da6512e9f admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:53.557115 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe89f24-a6ea-4e20-91d2-546da6512e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:53.557389 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe89f24-a6ea-4e20-91d2-546da6512e9f admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:53.558102 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe89f24-a6ea-4e20-91d2-546da6512e9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:53.559728 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe89f24-a6ea-4e20-91d2-546da6512e9f admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:53.574341 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 999/2003] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:53:53.576094 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f36cff-d3d1-4215-85af-24dcc69b6da2 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:53.586950 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f36cff-d3d1-4215-85af-24dcc69b6da2 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:53.596572 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50df50-0256-4e0d-8850-a13753126a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:53.597312 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50df50-0256-4e0d-8850-a13753126a63 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:53.597682 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50df50-0256-4e0d-8850-a13753126a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:53.598049 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50df50-0256-4e0d-8850-a13753126a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:53.598906 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50df50-0256-4e0d-8850-a13753126a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:53.600554 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50df50-0256-4e0d-8850-a13753126a63 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:53.617216 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1005/2004] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:53:53.621531 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe89f24-a6ea-4e20-91d2-546da6512e9f admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:53.632722 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe89f24-a6ea-4e20-91d2-546da6512e9f admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:53.638640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b8a50-71a1-4e4b-81f3-efa305b1ce87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:53.639318 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b8a50-71a1-4e4b-81f3-efa305b1ce87 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:53.639599 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b8a50-71a1-4e4b-81f3-efa305b1ce87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:53.639903 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b8a50-71a1-4e4b-81f3-efa305b1ce87 admin admin] PATH_INFO: `/v3/projects/7540c0d99e3c4eb9b0f8446b13a429f9/users/333d2a1ddddc4056af8453ac2be97b52/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:53.669063 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b8a50-71a1-4e4b-81f3-efa305b1ce87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7540c0d99e3c4eb9b0f8446b13a429f9, user_id=333d2a1ddddc4056af8453ac2be97b52, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:53.672268 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b8a50-71a1-4e4b-81f3-efa305b1ce87 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:53.694101 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1000/2005] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:53:53 2022] PUT /identity/v3/projects/7540c0d99e3c4eb9b0f8446b13a429f9/users/333d2a1ddddc4056af8453ac2be97b52/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:53.698917 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a1215-30b6-46ad-9265-3cce7dcb98b4 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:53.699210 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a1215-30b6-46ad-9265-3cce7dcb98b4 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:53.699495 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a1215-30b6-46ad-9265-3cce7dcb98b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:53.738479 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-fc0a1215-30b6-46ad-9265-3cce7dcb98b4 None None] MFA Rules not processed for user `333d2a1ddddc4056af8453ac2be97b52`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:53.739891 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-fc0a1215-30b6-46ad-9265-3cce7dcb98b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:53.820331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1006/2006] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:53:53.831617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b8a50-71a1-4e4b-81f3-efa305b1ce87 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:53.833611 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-605b8a50-71a1-4e4b-81f3-efa305b1ce87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:53.942461 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b8a50-71a1-4e4b-81f3-efa305b1ce87 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:53.949347 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a05f0-60b6-4ec5-8e06-0314407df73a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:53.950015 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a05f0-60b6-4ec5-8e06-0314407df73a service nova] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:53.950321 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a05f0-60b6-4ec5-8e06-0314407df73a service nova] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:53.950606 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a05f0-60b6-4ec5-8e06-0314407df73a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:53.962775 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a05f0-60b6-4ec5-8e06-0314407df73a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:53.964320 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a05f0-60b6-4ec5-8e06-0314407df73a service nova] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:53.977472 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1001/2007] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:53:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:53:59.384050 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a1215-30b6-46ad-9265-3cce7dcb98b4 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:59.451209 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a1215-30b6-46ad-9265-3cce7dcb98b4 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:59.456036 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9796b-cd80-4943-9f2a-d8fb48dc29a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:59.456804 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9796b-cd80-4943-9f2a-d8fb48dc29a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:59.457092 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9796b-cd80-4943-9f2a-d8fb48dc29a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:59.457369 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9796b-cd80-4943-9f2a-d8fb48dc29a6 admin admin] PATH_INFO: `/v3/users/333d2a1ddddc4056af8453ac2be97b52` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:59.458813 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb9796b-cd80-4943-9f2a-d8fb48dc29a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=333d2a1ddddc4056af8453ac2be97b52)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:59.460803 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb9796b-cd80-4943-9f2a-d8fb48dc29a6 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:59.504285 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:59.515318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-abb9796b-cd80-4943-9f2a-d8fb48dc29a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '333d2a1ddddc4056af8453ac2be97b52'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:59.515989 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-abb9796b-cd80-4943-9f2a-d8fb48dc29a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '333d2a1ddddc4056af8453ac2be97b52'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:59.523180 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-abb9796b-cd80-4943-9f2a-d8fb48dc29a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '333d2a1ddddc4056af8453ac2be97b52'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:59.535180 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-abb9796b-cd80-4943-9f2a-d8fb48dc29a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '333d2a1ddddc4056af8453ac2be97b52'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:59.542383 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-abb9796b-cd80-4943-9f2a-d8fb48dc29a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '333d2a1ddddc4056af8453ac2be97b52'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:53:59.549118 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1007/2008] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:53:59 2022] DELETE /identity/v3/users/333d2a1ddddc4056af8453ac2be97b52 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:53:59.554018 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeae631-0b42-4004-856a-baab39e3b5af None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:59.554501 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeae631-0b42-4004-856a-baab39e3b5af None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:59.554622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeae631-0b42-4004-856a-baab39e3b5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:59.576051 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-cfeae631-0b42-4004-856a-baab39e3b5af None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:53:59.577304 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-cfeae631-0b42-4004-856a-baab39e3b5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:59.634499 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:53:59.646443 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1002/2009] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:53:59.656299 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9796b-cd80-4943-9f2a-d8fb48dc29a6 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:53:59.658253 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-abb9796b-cd80-4943-9f2a-d8fb48dc29a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:53:59.731828 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9796b-cd80-4943-9f2a-d8fb48dc29a6 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:53:59.737266 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a34c9-bed1-4583-9d18-f074a98dae68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:53:59.738729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a34c9-bed1-4583-9d18-f074a98dae68 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:53:59.739396 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a34c9-bed1-4583-9d18-f074a98dae68 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:53:59.739943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a34c9-bed1-4583-9d18-f074a98dae68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:53:59.751784 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a34c9-bed1-4583-9d18-f074a98dae68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:53:59.753245 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a34c9-bed1-4583-9d18-f074a98dae68 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:53:59.764289 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1008/2010] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:53:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:54:00.142793 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeae631-0b42-4004-856a-baab39e3b5af None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:00.147086 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-cfeae631-0b42-4004-856a-baab39e3b5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:00.166637 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeae631-0b42-4004-856a-baab39e3b5af None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:00.173288 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36578b26-5850-4f22-84b1-73bcf5ebc4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:00.174135 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36578b26-5850-4f22-84b1-73bcf5ebc4d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:00.174406 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36578b26-5850-4f22-84b1-73bcf5ebc4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:00.174678 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36578b26-5850-4f22-84b1-73bcf5ebc4d6 admin admin] PATH_INFO: `/v3/projects/7540c0d99e3c4eb9b0f8446b13a429f9` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:00.175977 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36578b26-5850-4f22-84b1-73bcf5ebc4d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7540c0d99e3c4eb9b0f8446b13a429f9)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:00.178008 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36578b26-5850-4f22-84b1-73bcf5ebc4d6 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:00.226045 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-36578b26-5850-4f22-84b1-73bcf5ebc4d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7540c0d99e3c4eb9b0f8446b13a429f9', 'request_id': 'req-36578b26-5850-4f22-84b1-73bcf5ebc4d6'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:00.233937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-36578b26-5850-4f22-84b1-73bcf5ebc4d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7540c0d99e3c4eb9b0f8446b13a429f9', 'request_id': 'req-36578b26-5850-4f22-84b1-73bcf5ebc4d6'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:00.240212 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-36578b26-5850-4f22-84b1-73bcf5ebc4d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7540c0d99e3c4eb9b0f8446b13a429f9', 'request_id': 'req-36578b26-5850-4f22-84b1-73bcf5ebc4d6'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:00.252055 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-36578b26-5850-4f22-84b1-73bcf5ebc4d6 admin admin] The token cache is being invalidate because project 7540c0d99e3c4eb9b0f8446b13a429f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:54:00.252356 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-36578b26-5850-4f22-84b1-73bcf5ebc4d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:00.253070 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-36578b26-5850-4f22-84b1-73bcf5ebc4d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:00.254850 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1003/2011] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:54:00 2022] DELETE /identity/v3/projects/7540c0d99e3c4eb9b0f8446b13a429f9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:54:00.260133 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4061c7-161d-4aff-ac4b-083c5203146d None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:00.260422 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4061c7-161d-4aff-ac4b-083c5203146d None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:00.260715 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4061c7-161d-4aff-ac4b-083c5203146d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:00.281922 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-ca4061c7-161d-4aff-ac4b-083c5203146d None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:00.283420 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-ca4061c7-161d-4aff-ac4b-083c5203146d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:00.347722 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1009/2012] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:00.356883 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66105b8d-7b3f-445e-9526-cca9fcf9fd32 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:00.357172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66105b8d-7b3f-445e-9526-cca9fcf9fd32 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:00.357445 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66105b8d-7b3f-445e-9526-cca9fcf9fd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:00.380404 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-66105b8d-7b3f-445e-9526-cca9fcf9fd32 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:00.381663 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-66105b8d-7b3f-445e-9526-cca9fcf9fd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:00.390040 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1004/2013] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:00.394923 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4061c7-161d-4aff-ac4b-083c5203146d None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:00.406289 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4061c7-161d-4aff-ac4b-083c5203146d None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:00.411705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50a4cf-025e-48e0-88b2-1984a9d53aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:00.412762 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50a4cf-025e-48e0-88b2-1984a9d53aee admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:00.412762 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50a4cf-025e-48e0-88b2-1984a9d53aee admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:00.412991 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb50a4cf-025e-48e0-88b2-1984a9d53aee admin admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:00.413681 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb50a4cf-025e-48e0-88b2-1984a9d53aee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:54:00.414001 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb50a4cf-025e-48e0-88b2-1984a9d53aee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:00.415755 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb50a4cf-025e-48e0-88b2-1984a9d53aee admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:00.430129 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1010/2014] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:54:00.444929 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66105b8d-7b3f-445e-9526-cca9fcf9fd32 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:00.444929 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66105b8d-7b3f-445e-9526-cca9fcf9fd32 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:00.449679 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bd0d7-5ffc-4537-9778-31205671b97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:00.450415 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bd0d7-5ffc-4537-9778-31205671b97a admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:00.450649 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bd0d7-5ffc-4537-9778-31205671b97a admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:00.451034 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bd0d7-5ffc-4537-9778-31205671b97a admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:00.451587 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89bd0d7-5ffc-4537-9778-31205671b97a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:00.453505 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89bd0d7-5ffc-4537-9778-31205671b97a admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:00.483655 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1005/2015] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:54:00 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:54:00.488958 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50a4cf-025e-48e0-88b2-1984a9d53aee admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:00.505038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb50a4cf-025e-48e0-88b2-1984a9d53aee admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:00.552121 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:00.573121 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1f0ba-c029-4a8b-a682-f6107d5e3f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:00.573759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1f0ba-c029-4a8b-a682-f6107d5e3f64 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:00.574069 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1f0ba-c029-4a8b-a682-f6107d5e3f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:00.574390 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1f0ba-c029-4a8b-a682-f6107d5e3f64 admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:00.575110 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1f0ba-c029-4a8b-a682-f6107d5e3f64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:00.577070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1f0ba-c029-4a8b-a682-f6107d5e3f64 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:00.603067 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1011/2016] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:54:00 2022] POST /identity/v3/users => generated 283 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:54:00.604326 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bd0d7-5ffc-4537-9778-31205671b97a admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:00.615632 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bd0d7-5ffc-4537-9778-31205671b97a admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:00.620957 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0607eb-1eea-40b2-97bc-3337636c21e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:00.621509 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0607eb-1eea-40b2-97bc-3337636c21e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:00.621782 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0607eb-1eea-40b2-97bc-3337636c21e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:00.622164 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0607eb-1eea-40b2-97bc-3337636c21e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:00.622817 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0607eb-1eea-40b2-97bc-3337636c21e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:00.624400 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0607eb-1eea-40b2-97bc-3337636c21e4 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:00.635662 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1006/2017] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:54:00.641166 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1f0ba-c029-4a8b-a682-f6107d5e3f64 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:00.651434 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1f0ba-c029-4a8b-a682-f6107d5e3f64 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:00.656441 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83d9f8-c92b-46bc-9474-f5bbe935c084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:00.657062 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83d9f8-c92b-46bc-9474-f5bbe935c084 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:00.657337 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83d9f8-c92b-46bc-9474-f5bbe935c084 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:00.657729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83d9f8-c92b-46bc-9474-f5bbe935c084 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:00.658462 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a83d9f8-c92b-46bc-9474-f5bbe935c084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:00.660090 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a83d9f8-c92b-46bc-9474-f5bbe935c084 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:00.671370 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1012/2018] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:54:00.675831 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0607eb-1eea-40b2-97bc-3337636c21e4 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:00.686517 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0607eb-1eea-40b2-97bc-3337636c21e4 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:00.691610 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a5c1e-6070-4803-8e48-fb9baac9c72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:00.692295 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a5c1e-6070-4803-8e48-fb9baac9c72a admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:00.692572 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a5c1e-6070-4803-8e48-fb9baac9c72a admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:00.692846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a5c1e-6070-4803-8e48-fb9baac9c72a admin admin] PATH_INFO: `/v3/projects/21c0d030e5ae49f18bb10ca5bc0484b6/users/aaa8eb722f2940cba15112a41b7bec1f/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:00.711913 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a5c1e-6070-4803-8e48-fb9baac9c72a admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c0d030e5ae49f18bb10ca5bc0484b6, user_id=aaa8eb722f2940cba15112a41b7bec1f, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:00.714907 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a5c1e-6070-4803-8e48-fb9baac9c72a admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:00.729944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1007/2019] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:54:00 2022] PUT /identity/v3/projects/21c0d030e5ae49f18bb10ca5bc0484b6/users/aaa8eb722f2940cba15112a41b7bec1f/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:54:00.740884 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626136c-56ba-46c0-9ca2-d5772248f4a7 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:00.741148 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626136c-56ba-46c0-9ca2-d5772248f4a7 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:00.741444 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626136c-56ba-46c0-9ca2-d5772248f4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:00.782730 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-1626136c-56ba-46c0-9ca2-d5772248f4a7 None None] MFA Rules not processed for user `aaa8eb722f2940cba15112a41b7bec1f`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:00.783934 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-1626136c-56ba-46c0-9ca2-d5772248f4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:00.861246 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1013/2020] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:00 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:00.873155 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a5c1e-6070-4803-8e48-fb9baac9c72a admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:00.875113 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-211a5c1e-6070-4803-8e48-fb9baac9c72a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:00.943232 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a5c1e-6070-4803-8e48-fb9baac9c72a admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:00.947244 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd650ae-5a08-42ae-a350-e740780bbb8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:00.947922 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd650ae-5a08-42ae-a350-e740780bbb8d service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:00.948221 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd650ae-5a08-42ae-a350-e740780bbb8d service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:00.948542 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd650ae-5a08-42ae-a350-e740780bbb8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:00.957289 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd650ae-5a08-42ae-a350-e740780bbb8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:00.958727 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd650ae-5a08-42ae-a350-e740780bbb8d service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:00.967509 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1008/2021] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:54:00 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:54:04.238729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626136c-56ba-46c0-9ca2-d5772248f4a7 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:04.240256 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-1626136c-56ba-46c0-9ca2-d5772248f4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:04.317379 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626136c-56ba-46c0-9ca2-d5772248f4a7 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:04.321962 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407470b-7314-4634-b256-26aa3c3314ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:04.322633 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407470b-7314-4634-b256-26aa3c3314ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:04.322911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407470b-7314-4634-b256-26aa3c3314ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:04.323182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407470b-7314-4634-b256-26aa3c3314ec admin admin] PATH_INFO: `/v3/users/f4cc4de940574c74a287aeb6baad35df` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:04.324349 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407470b-7314-4634-b256-26aa3c3314ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4cc4de940574c74a287aeb6baad35df)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:04.326319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407470b-7314-4634-b256-26aa3c3314ec admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:04.375034 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-7407470b-7314-4634-b256-26aa3c3314ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4cc4de940574c74a287aeb6baad35df'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:04.375684 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-7407470b-7314-4634-b256-26aa3c3314ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4cc4de940574c74a287aeb6baad35df'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:04.379860 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:04.386218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-7407470b-7314-4634-b256-26aa3c3314ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4cc4de940574c74a287aeb6baad35df'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:04.404554 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-7407470b-7314-4634-b256-26aa3c3314ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4cc4de940574c74a287aeb6baad35df'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:04.412942 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-7407470b-7314-4634-b256-26aa3c3314ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4cc4de940574c74a287aeb6baad35df'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:04.419283 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1014/2022] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:54:04 2022] DELETE /identity/v3/users/f4cc4de940574c74a287aeb6baad35df => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:54:04.424106 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6596149-b973-4505-b4cc-99e4ad2fea0d None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:04.424596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6596149-b973-4505-b4cc-99e4ad2fea0d None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:04.424857 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6596149-b973-4505-b4cc-99e4ad2fea0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:04.445110 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-d6596149-b973-4505-b4cc-99e4ad2fea0d None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:04.446373 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-d6596149-b973-4505-b4cc-99e4ad2fea0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:04.459942 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:04.511076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1009/2023] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:04.521139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407470b-7314-4634-b256-26aa3c3314ec admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:04.522772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-7407470b-7314-4634-b256-26aa3c3314ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:04.581072 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407470b-7314-4634-b256-26aa3c3314ec admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:04.585036 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097b4de-3e67-4612-be90-4e43e7d687bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:04.585665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097b4de-3e67-4612-be90-4e43e7d687bf service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:04.585997 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097b4de-3e67-4612-be90-4e43e7d687bf service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:04.586305 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097b4de-3e67-4612-be90-4e43e7d687bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:04.596309 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097b4de-3e67-4612-be90-4e43e7d687bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:04.597812 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097b4de-3e67-4612-be90-4e43e7d687bf service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:04.608716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1015/2024] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:54:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:54:04.898985 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6596149-b973-4505-b4cc-99e4ad2fea0d None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:04.900494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-d6596149-b973-4505-b4cc-99e4ad2fea0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:04.913101 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6596149-b973-4505-b4cc-99e4ad2fea0d None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:04.917928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5886dd-0266-493d-bc8b-5cf668e783e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:04.918629 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5886dd-0266-493d-bc8b-5cf668e783e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:04.919122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5886dd-0266-493d-bc8b-5cf668e783e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:04.919402 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5886dd-0266-493d-bc8b-5cf668e783e3 admin admin] PATH_INFO: `/v3/projects/b5415a6c63dd4e278dd9acf2441c8366` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:04.920593 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5886dd-0266-493d-bc8b-5cf668e783e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5415a6c63dd4e278dd9acf2441c8366)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:04.922761 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5886dd-0266-493d-bc8b-5cf668e783e3 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:04.972553 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2b5886dd-0266-493d-bc8b-5cf668e783e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5415a6c63dd4e278dd9acf2441c8366', 'request_id': 'req-2b5886dd-0266-493d-bc8b-5cf668e783e3'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:04.982819 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2b5886dd-0266-493d-bc8b-5cf668e783e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5415a6c63dd4e278dd9acf2441c8366', 'request_id': 'req-2b5886dd-0266-493d-bc8b-5cf668e783e3'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:04.990312 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2b5886dd-0266-493d-bc8b-5cf668e783e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5415a6c63dd4e278dd9acf2441c8366', 'request_id': 'req-2b5886dd-0266-493d-bc8b-5cf668e783e3'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:05.004732 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2b5886dd-0266-493d-bc8b-5cf668e783e3 admin admin] The token cache is being invalidate because project b5415a6c63dd4e278dd9acf2441c8366 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:54:05.005019 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2b5886dd-0266-493d-bc8b-5cf668e783e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:05.005679 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2b5886dd-0266-493d-bc8b-5cf668e783e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:05.007264 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1010/2025] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:54:04 2022] DELETE /identity/v3/projects/b5415a6c63dd4e278dd9acf2441c8366 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:54:05.013032 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ee0f9-9a3a-4ae6-8dfc-f2a2532e343f None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:05.013446 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ee0f9-9a3a-4ae6-8dfc-f2a2532e343f None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:05.013801 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ee0f9-9a3a-4ae6-8dfc-f2a2532e343f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:05.034387 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-407ee0f9-9a3a-4ae6-8dfc-f2a2532e343f None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:05.035614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-407ee0f9-9a3a-4ae6-8dfc-f2a2532e343f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:05.102317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1016/2026] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:05.112975 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c7a11-c0c0-4238-91b2-3017ea42818a None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:05.113256 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c7a11-c0c0-4238-91b2-3017ea42818a None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:05.113530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c7a11-c0c0-4238-91b2-3017ea42818a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:05.134802 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-e73c7a11-c0c0-4238-91b2-3017ea42818a None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:05.136013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-e73c7a11-c0c0-4238-91b2-3017ea42818a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:05.144042 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1011/2027] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:54:05.148620 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ee0f9-9a3a-4ae6-8dfc-f2a2532e343f None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:05.158921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ee0f9-9a3a-4ae6-8dfc-f2a2532e343f None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:05.164092 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba970c6-490b-4ce9-9037-e85afa22f1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:05.164718 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba970c6-490b-4ce9-9037-e85afa22f1fd admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:05.165002 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba970c6-490b-4ce9-9037-e85afa22f1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:05.165279 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba970c6-490b-4ce9-9037-e85afa22f1fd admin admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:05.166005 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba970c6-490b-4ce9-9037-e85afa22f1fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:54:05.166330 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba970c6-490b-4ce9-9037-e85afa22f1fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:05.167960 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba970c6-490b-4ce9-9037-e85afa22f1fd admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:05.180474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1017/2028] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:54:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:54:05.185050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c7a11-c0c0-4238-91b2-3017ea42818a None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:05.195124 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c7a11-c0c0-4238-91b2-3017ea42818a None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:05.200779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12835830-dfa0-4677-a824-e3778675fe2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:05.201407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12835830-dfa0-4677-a824-e3778675fe2b admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:05.201686 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12835830-dfa0-4677-a824-e3778675fe2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:05.202070 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12835830-dfa0-4677-a824-e3778675fe2b admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:05.202750 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12835830-dfa0-4677-a824-e3778675fe2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:05.204783 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12835830-dfa0-4677-a824-e3778675fe2b admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:05.235754 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1012/2029] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:54:05 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:54:05.240436 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba970c6-490b-4ce9-9037-e85afa22f1fd admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:05.252841 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba970c6-490b-4ce9-9037-e85afa22f1fd admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:05.315405 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c06c1-2ef8-40a3-abea-5af2cabe0545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:05.316041 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c06c1-2ef8-40a3-abea-5af2cabe0545 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:05.316331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c06c1-2ef8-40a3-abea-5af2cabe0545 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:05.316606 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c06c1-2ef8-40a3-abea-5af2cabe0545 admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:05.317547 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c06c1-2ef8-40a3-abea-5af2cabe0545 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:05.319577 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c06c1-2ef8-40a3-abea-5af2cabe0545 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:05.328944 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:05.348990 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1018/2030] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:54:05 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:54:05.350185 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12835830-dfa0-4677-a824-e3778675fe2b admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:05.362034 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12835830-dfa0-4677-a824-e3778675fe2b admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:05.367842 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc532414-2daa-4065-b55b-735b2610b18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:05.367842 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc532414-2daa-4065-b55b-735b2610b18f admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:05.367842 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc532414-2daa-4065-b55b-735b2610b18f admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:05.368257 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc532414-2daa-4065-b55b-735b2610b18f admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:05.368758 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc532414-2daa-4065-b55b-735b2610b18f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:05.370557 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc532414-2daa-4065-b55b-735b2610b18f admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:05.382195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1013/2031] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:54:05.386427 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c06c1-2ef8-40a3-abea-5af2cabe0545 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:05.397333 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c06c1-2ef8-40a3-abea-5af2cabe0545 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:05.402306 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c479e-1a25-47c2-bec6-62307d4ca3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:05.402990 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c479e-1a25-47c2-bec6-62307d4ca3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:05.403276 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c479e-1a25-47c2-bec6-62307d4ca3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:05.403549 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c479e-1a25-47c2-bec6-62307d4ca3a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:05.404252 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c479e-1a25-47c2-bec6-62307d4ca3a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:05.405891 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c479e-1a25-47c2-bec6-62307d4ca3a2 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:05.419331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1019/2032] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:54:05.423714 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc532414-2daa-4065-b55b-735b2610b18f admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:05.435020 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc532414-2daa-4065-b55b-735b2610b18f admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:05.439939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5ef0c-b645-4774-9c51-f627dbf9dc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:05.440654 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5ef0c-b645-4774-9c51-f627dbf9dc0f admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:05.440967 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5ef0c-b645-4774-9c51-f627dbf9dc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:05.441246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5ef0c-b645-4774-9c51-f627dbf9dc0f admin admin] PATH_INFO: `/v3/projects/30f4f4490052474597b332fb9de3d20b/users/d6a1761858654a1a839142b9ac4d4f74/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:05.456803 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c5ef0c-b645-4774-9c51-f627dbf9dc0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=30f4f4490052474597b332fb9de3d20b, user_id=d6a1761858654a1a839142b9ac4d4f74, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:05.459591 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c5ef0c-b645-4774-9c51-f627dbf9dc0f admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:05.473819 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1014/2033] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:54:05 2022] PUT /identity/v3/projects/30f4f4490052474597b332fb9de3d20b/users/d6a1761858654a1a839142b9ac4d4f74/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:54:05.484500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd6e1f-f395-4e33-bf29-683e637af64a None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:05.484787 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd6e1f-f395-4e33-bf29-683e637af64a None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:05.485057 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd6e1f-f395-4e33-bf29-683e637af64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:05.522208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-edfd6e1f-f395-4e33-bf29-683e637af64a None None] MFA Rules not processed for user `d6a1761858654a1a839142b9ac4d4f74`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:05.524224 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-edfd6e1f-f395-4e33-bf29-683e637af64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:05.610241 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1020/2034] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:05.623144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5ef0c-b645-4774-9c51-f627dbf9dc0f admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:05.625121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-31c5ef0c-b645-4774-9c51-f627dbf9dc0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:05.676670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:05.697696 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5ef0c-b645-4774-9c51-f627dbf9dc0f admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:05.701481 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34e559-b28e-4a8d-847d-d185cfba2850 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:05.702141 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34e559-b28e-4a8d-847d-d185cfba2850 service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:05.702419 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34e559-b28e-4a8d-847d-d185cfba2850 service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:05.702685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34e559-b28e-4a8d-847d-d185cfba2850 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:05.711985 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34e559-b28e-4a8d-847d-d185cfba2850 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:05.713451 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34e559-b28e-4a8d-847d-d185cfba2850 service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:05.726327 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1015/2035] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:54:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:54:05.752576 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd6e1f-f395-4e33-bf29-683e637af64a None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:05.835625 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd6e1f-f395-4e33-bf29-683e637af64a None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:05.841574 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685c585-6ba6-4ebb-b2b3-7d7e7bf986a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:05.842305 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685c585-6ba6-4ebb-b2b3-7d7e7bf986a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:05.842589 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685c585-6ba6-4ebb-b2b3-7d7e7bf986a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:05.842866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685c585-6ba6-4ebb-b2b3-7d7e7bf986a5 admin admin] PATH_INFO: `/v3/users/d6a1761858654a1a839142b9ac4d4f74` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:05.844053 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685c585-6ba6-4ebb-b2b3-7d7e7bf986a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6a1761858654a1a839142b9ac4d4f74)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:05.846472 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685c585-6ba6-4ebb-b2b3-7d7e7bf986a5 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:05.904407 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-f685c585-6ba6-4ebb-b2b3-7d7e7bf986a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6a1761858654a1a839142b9ac4d4f74'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:05.905078 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-f685c585-6ba6-4ebb-b2b3-7d7e7bf986a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6a1761858654a1a839142b9ac4d4f74'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:05.918248 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-f685c585-6ba6-4ebb-b2b3-7d7e7bf986a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6a1761858654a1a839142b9ac4d4f74'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:05.936863 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:05.938425 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-f685c585-6ba6-4ebb-b2b3-7d7e7bf986a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6a1761858654a1a839142b9ac4d4f74'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:05.951255 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-f685c585-6ba6-4ebb-b2b3-7d7e7bf986a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6a1761858654a1a839142b9ac4d4f74'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:05.959369 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1021/2036] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:54:05 2022] DELETE /identity/v3/users/d6a1761858654a1a839142b9ac4d4f74 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:54:05.963725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a4b93-1a53-4951-b836-99562a20210c None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:05.964015 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a4b93-1a53-4951-b836-99562a20210c None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:05.964289 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a4b93-1a53-4951-b836-99562a20210c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:05.990452 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-672a4b93-1a53-4951-b836-99562a20210c None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:05.991841 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-672a4b93-1a53-4951-b836-99562a20210c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:06.106780 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1016/2037] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:06.118072 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685c585-6ba6-4ebb-b2b3-7d7e7bf986a5 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:06.119769 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-f685c585-6ba6-4ebb-b2b3-7d7e7bf986a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:06.190269 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685c585-6ba6-4ebb-b2b3-7d7e7bf986a5 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:06.194263 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31a0dc-df2b-4686-ac6d-c8161fd5603b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:06.195015 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31a0dc-df2b-4686-ac6d-c8161fd5603b service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:06.195370 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31a0dc-df2b-4686-ac6d-c8161fd5603b service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:06.195721 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31a0dc-df2b-4686-ac6d-c8161fd5603b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:06.206531 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31a0dc-df2b-4686-ac6d-c8161fd5603b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:06.208186 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31a0dc-df2b-4686-ac6d-c8161fd5603b service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:06.220603 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1022/2038] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:54:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:54:06.518315 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a4b93-1a53-4951-b836-99562a20210c None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:06.520100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-672a4b93-1a53-4951-b836-99562a20210c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:06.535958 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a4b93-1a53-4951-b836-99562a20210c None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:06.542311 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc498c-7af9-45a8-b75f-5cd07a4d7d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:06.543049 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc498c-7af9-45a8-b75f-5cd07a4d7d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:06.543267 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc498c-7af9-45a8-b75f-5cd07a4d7d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:06.543553 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc498c-7af9-45a8-b75f-5cd07a4d7d83 admin admin] PATH_INFO: `/v3/projects/30f4f4490052474597b332fb9de3d20b` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:06.544907 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc498c-7af9-45a8-b75f-5cd07a4d7d83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30f4f4490052474597b332fb9de3d20b)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:06.546903 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc498c-7af9-45a8-b75f-5cd07a4d7d83 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:06.599537 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-46dc498c-7af9-45a8-b75f-5cd07a4d7d83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30f4f4490052474597b332fb9de3d20b', 'request_id': 'req-46dc498c-7af9-45a8-b75f-5cd07a4d7d83'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:06.608371 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-46dc498c-7af9-45a8-b75f-5cd07a4d7d83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30f4f4490052474597b332fb9de3d20b', 'request_id': 'req-46dc498c-7af9-45a8-b75f-5cd07a4d7d83'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:06.614890 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-46dc498c-7af9-45a8-b75f-5cd07a4d7d83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30f4f4490052474597b332fb9de3d20b', 'request_id': 'req-46dc498c-7af9-45a8-b75f-5cd07a4d7d83'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:06.628256 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-46dc498c-7af9-45a8-b75f-5cd07a4d7d83 admin admin] The token cache is being invalidate because project 30f4f4490052474597b332fb9de3d20b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:54:06.628676 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-46dc498c-7af9-45a8-b75f-5cd07a4d7d83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:06.629534 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-46dc498c-7af9-45a8-b75f-5cd07a4d7d83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:06.631789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1017/2039] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:54:06 2022] DELETE /identity/v3/projects/30f4f4490052474597b332fb9de3d20b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:54:06.637241 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a7038-e30c-45ea-a469-6438c60474bc None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:06.637802 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a7038-e30c-45ea-a469-6438c60474bc None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:06.637802 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a7038-e30c-45ea-a469-6438c60474bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:06.659246 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-4f9a7038-e30c-45ea-a469-6438c60474bc None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:06.660468 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-4f9a7038-e30c-45ea-a469-6438c60474bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:06.721417 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1023/2040] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:06.729491 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed2cbc-8710-481d-a1a2-8802bc25e3df None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:06.729779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed2cbc-8710-481d-a1a2-8802bc25e3df None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:06.730100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed2cbc-8710-481d-a1a2-8802bc25e3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:06.750644 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-f6ed2cbc-8710-481d-a1a2-8802bc25e3df None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:06.751838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-f6ed2cbc-8710-481d-a1a2-8802bc25e3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:06.760087 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1018/2041] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:06.764828 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a7038-e30c-45ea-a469-6438c60474bc None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:06.775074 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a7038-e30c-45ea-a469-6438c60474bc None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:06.779958 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb33cf8-9a8c-410e-a85c-cc3a5d0ae12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:06.780629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb33cf8-9a8c-410e-a85c-cc3a5d0ae12c admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:06.780912 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb33cf8-9a8c-410e-a85c-cc3a5d0ae12c admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:06.781183 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb33cf8-9a8c-410e-a85c-cc3a5d0ae12c admin admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:06.781892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb33cf8-9a8c-410e-a85c-cc3a5d0ae12c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:54:06.782233 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb33cf8-9a8c-410e-a85c-cc3a5d0ae12c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:06.783874 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb33cf8-9a8c-410e-a85c-cc3a5d0ae12c admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:06.796631 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1024/2042] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:54:06.801404 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed2cbc-8710-481d-a1a2-8802bc25e3df None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:06.811384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed2cbc-8710-481d-a1a2-8802bc25e3df None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:06.817336 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9a1dd-12ae-4ee0-aef9-207af16f9f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:06.818116 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9a1dd-12ae-4ee0-aef9-207af16f9f32 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:06.818396 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9a1dd-12ae-4ee0-aef9-207af16f9f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:06.818670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9a1dd-12ae-4ee0-aef9-207af16f9f32 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:06.819361 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9a1dd-12ae-4ee0-aef9-207af16f9f32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:06.821293 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9a1dd-12ae-4ee0-aef9-207af16f9f32 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:06.851217 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1019/2043] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:54:06 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:54:06.855695 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb33cf8-9a8c-410e-a85c-cc3a5d0ae12c admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:06.867368 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb33cf8-9a8c-410e-a85c-cc3a5d0ae12c admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:06.932839 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8f862-d678-45bb-829c-e56ec2f7e281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:06.933505 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8f862-d678-45bb-829c-e56ec2f7e281 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:06.933778 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8f862-d678-45bb-829c-e56ec2f7e281 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:06.934077 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8f862-d678-45bb-829c-e56ec2f7e281 admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:06.934753 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8f862-d678-45bb-829c-e56ec2f7e281 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:06.937264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c8f862-d678-45bb-829c-e56ec2f7e281 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:06.962939 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1025/2044] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:54:06 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:54:06.967237 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9a1dd-12ae-4ee0-aef9-207af16f9f32 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:06.978504 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9a1dd-12ae-4ee0-aef9-207af16f9f32 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:06.983357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222b86a-638e-435d-9f75-051b7d4c7190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:06.983969 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222b86a-638e-435d-9f75-051b7d4c7190 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:06.984251 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222b86a-638e-435d-9f75-051b7d4c7190 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:06.984527 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222b86a-638e-435d-9f75-051b7d4c7190 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:06.985229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222b86a-638e-435d-9f75-051b7d4c7190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:06.986878 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222b86a-638e-435d-9f75-051b7d4c7190 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:06.998631 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1020/2045] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:54:07.002876 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8f862-d678-45bb-829c-e56ec2f7e281 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:07.014584 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c8f862-d678-45bb-829c-e56ec2f7e281 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:07.019819 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a59d9-198e-47d5-90f2-e7c62b52a34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:07.020559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a59d9-198e-47d5-90f2-e7c62b52a34d admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:07.020839 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a59d9-198e-47d5-90f2-e7c62b52a34d admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:07.021129 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a59d9-198e-47d5-90f2-e7c62b52a34d admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:07.022067 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a59d9-198e-47d5-90f2-e7c62b52a34d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:07.023726 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a59d9-198e-47d5-90f2-e7c62b52a34d admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:07.025268 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:07.036775 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1026/2046] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:54:07.041247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222b86a-638e-435d-9f75-051b7d4c7190 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:07.051876 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222b86a-638e-435d-9f75-051b7d4c7190 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:07.056891 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8166d-1726-479d-a2c9-c16a2fc7184f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:07.057567 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8166d-1726-479d-a2c9-c16a2fc7184f admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:07.057848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8166d-1726-479d-a2c9-c16a2fc7184f admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:07.058165 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8166d-1726-479d-a2c9-c16a2fc7184f admin admin] PATH_INFO: `/v3/projects/8e6f8d5eb0ae4c479a4f6df4a4eb8d4e/users/b1977b61158e47729cd8602e9593ff5c/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:07.074374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8166d-1726-479d-a2c9-c16a2fc7184f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e6f8d5eb0ae4c479a4f6df4a4eb8d4e, user_id=b1977b61158e47729cd8602e9593ff5c, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:07.077200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8166d-1726-479d-a2c9-c16a2fc7184f admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:07.095556 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1021/2047] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:54:07 2022] PUT /identity/v3/projects/8e6f8d5eb0ae4c479a4f6df4a4eb8d4e/users/b1977b61158e47729cd8602e9593ff5c/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:54:07.101098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79176789-6e51-409f-af81-ce05780c89b6 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:07.101388 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79176789-6e51-409f-af81-ce05780c89b6 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:07.101661 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79176789-6e51-409f-af81-ce05780c89b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:07.126545 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-79176789-6e51-409f-af81-ce05780c89b6 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:07.127789 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-79176789-6e51-409f-af81-ce05780c89b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:07.207345 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1027/2048] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:07.217492 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8166d-1726-479d-a2c9-c16a2fc7184f admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:07.219336 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-afc8166d-1726-479d-a2c9-c16a2fc7184f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:07.225133 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:07.292874 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8166d-1726-479d-a2c9-c16a2fc7184f admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:07.296984 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b9a77-e62d-455f-93f0-237b7029ebbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:07.297626 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b9a77-e62d-455f-93f0-237b7029ebbc service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:07.297936 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b9a77-e62d-455f-93f0-237b7029ebbc service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:07.298232 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b9a77-e62d-455f-93f0-237b7029ebbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:07.308204 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b9a77-e62d-455f-93f0-237b7029ebbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:07.309647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b9a77-e62d-455f-93f0-237b7029ebbc service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:07.319724 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1022/2049] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:54:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:54:07.983386 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a318df3-304b-48e9-a449-2d4448ece9a7 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:07.983909 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a318df3-304b-48e9-a449-2d4448ece9a7 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:07.983909 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a318df3-304b-48e9-a449-2d4448ece9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:08.016443 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-6a318df3-304b-48e9-a449-2d4448ece9a7 None None] MFA Rules not processed for user `b1977b61158e47729cd8602e9593ff5c`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:08.017877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-6a318df3-304b-48e9-a449-2d4448ece9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:08.095695 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1028/2050] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:08.107830 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b9a77-e62d-455f-93f0-237b7029ebbc service neutron] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:08.109325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-147b9a77-e62d-455f-93f0-237b7029ebbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:08.174355 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b9a77-e62d-455f-93f0-237b7029ebbc service neutron] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:08.178440 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3aba5-ca03-45dc-b454-70e74e06ae88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:08.178854 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3aba5-ca03-45dc-b454-70e74e06ae88 service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:08.179134 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3aba5-ca03-45dc-b454-70e74e06ae88 service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:08.179410 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3aba5-ca03-45dc-b454-70e74e06ae88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:08.189479 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f3aba5-ca03-45dc-b454-70e74e06ae88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:08.191163 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f3aba5-ca03-45dc-b454-70e74e06ae88 service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:08.202496 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1023/2051] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:54:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:54:09.704657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a318df3-304b-48e9-a449-2d4448ece9a7 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:09.706254 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-6a318df3-304b-48e9-a449-2d4448ece9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:09.720244 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a318df3-304b-48e9-a449-2d4448ece9a7 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:09.724982 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c994a-80e2-4a77-a9b1-9242877dab10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:09.725634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c994a-80e2-4a77-a9b1-9242877dab10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:09.726178 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c994a-80e2-4a77-a9b1-9242877dab10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:09.726454 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c994a-80e2-4a77-a9b1-9242877dab10 admin admin] PATH_INFO: `/v3/users/581f486fd7604503a44f1267c79a8fae` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:09.727812 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c994a-80e2-4a77-a9b1-9242877dab10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=581f486fd7604503a44f1267c79a8fae)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:09.729765 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c994a-80e2-4a77-a9b1-9242877dab10 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:09.749606 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f54b0-9400-4a8b-b4b4-f839ea424257 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:09.750176 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f54b0-9400-4a8b-b4b4-f839ea424257 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:09.750176 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f54b0-9400-4a8b-b4b4-f839ea424257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:09.770795 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-062f54b0-9400-4a8b-b4b4-f839ea424257 None None] MFA Rules not processed for user `b1977b61158e47729cd8602e9593ff5c`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:09.772118 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-062f54b0-9400-4a8b-b4b4-f839ea424257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:09.781618 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1024/2052] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:09.784504 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-595c994a-80e2-4a77-a9b1-9242877dab10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '581f486fd7604503a44f1267c79a8fae'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:09.785151 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-595c994a-80e2-4a77-a9b1-9242877dab10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '581f486fd7604503a44f1267c79a8fae'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:09.796529 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-595c994a-80e2-4a77-a9b1-9242877dab10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '581f486fd7604503a44f1267c79a8fae'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:09.812926 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f54b0-9400-4a8b-b4b4-f839ea424257 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:09.814680 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-062f54b0-9400-4a8b-b4b4-f839ea424257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:09.816038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-595c994a-80e2-4a77-a9b1-9242877dab10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '581f486fd7604503a44f1267c79a8fae'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:09.824465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-595c994a-80e2-4a77-a9b1-9242877dab10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '581f486fd7604503a44f1267c79a8fae'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:09.826092 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:09.831707 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f54b0-9400-4a8b-b4b4-f839ea424257 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:09.832119 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1029/2053] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:54:09 2022] DELETE /identity/v3/users/581f486fd7604503a44f1267c79a8fae => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:54:09.837317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247e09b-840f-4db8-be46-b396e32f1ba1 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:09.837774 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247e09b-840f-4db8-be46-b396e32f1ba1 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:09.838095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0247e09b-840f-4db8-be46-b396e32f1ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:09.866027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-0247e09b-840f-4db8-be46-b396e32f1ba1 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:09.867248 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-0247e09b-840f-4db8-be46-b396e32f1ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:09.901513 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a72d32-9a41-4fce-827a-8971682949dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:09.902215 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a72d32-9a41-4fce-827a-8971682949dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:09.902508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a72d32-9a41-4fce-827a-8971682949dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:09.902767 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a72d32-9a41-4fce-827a-8971682949dd admin admin] PATH_INFO: `/v3/users/aaa8eb722f2940cba15112a41b7bec1f` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:09.903963 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a72d32-9a41-4fce-827a-8971682949dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaa8eb722f2940cba15112a41b7bec1f)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:09.905927 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a72d32-9a41-4fce-827a-8971682949dd admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:09.946092 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1030/2054] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:54:09.956850 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247e09b-840f-4db8-be46-b396e32f1ba1 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:09.958339 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-0247e09b-840f-4db8-be46-b396e32f1ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:09.980611 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:09.985197 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-a8a72d32-9a41-4fce-827a-8971682949dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaa8eb722f2940cba15112a41b7bec1f'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:09.999691 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-a8a72d32-9a41-4fce-827a-8971682949dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaa8eb722f2940cba15112a41b7bec1f'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:10.027963 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-a8a72d32-9a41-4fce-827a-8971682949dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaa8eb722f2940cba15112a41b7bec1f'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:10.038381 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-a8a72d32-9a41-4fce-827a-8971682949dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaa8eb722f2940cba15112a41b7bec1f'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:10.039869 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-a8a72d32-9a41-4fce-827a-8971682949dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaa8eb722f2940cba15112a41b7bec1f'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:10.046725 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0247e09b-840f-4db8-be46-b396e32f1ba1 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:10.053841 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1025/2055] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:54:09 2022] DELETE /identity/v3/users/aaa8eb722f2940cba15112a41b7bec1f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:54:10.054216 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ae526-9b49-48f6-9c92-7ac17143eae2 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:10.054562 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ae526-9b49-48f6-9c92-7ac17143eae2 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:10.054838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ae526-9b49-48f6-9c92-7ac17143eae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:10.075348 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-707ae526-9b49-48f6-9c92-7ac17143eae2 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:10.076308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-707ae526-9b49-48f6-9c92-7ac17143eae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:10.112439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69f8f3-bc7f-4b52-9728-b0d93044488c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:10.113639 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69f8f3-bc7f-4b52-9728-b0d93044488c service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:10.114170 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69f8f3-bc7f-4b52-9728-b0d93044488c service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:10.114871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69f8f3-bc7f-4b52-9728-b0d93044488c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:10.116811 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-da69f8f3-bc7f-4b52-9728-b0d93044488c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:10.147486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1026/2056] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:10.164364 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ae526-9b49-48f6-9c92-7ac17143eae2 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:10.166439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-707ae526-9b49-48f6-9c92-7ac17143eae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:10.181894 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ae526-9b49-48f6-9c92-7ac17143eae2 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:10.187774 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f33ba-410b-4698-a5aa-e47ea3da6b1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:10.188480 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f33ba-410b-4698-a5aa-e47ea3da6b1e service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:10.188965 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f33ba-410b-4698-a5aa-e47ea3da6b1e service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:10.189128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f33ba-410b-4698-a5aa-e47ea3da6b1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:10.199467 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69f8f3-bc7f-4b52-9728-b0d93044488c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:10.203174 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69f8f3-bc7f-4b52-9728-b0d93044488c service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:10.205206 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f33ba-410b-4698-a5aa-e47ea3da6b1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:10.207002 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f33ba-410b-4698-a5aa-e47ea3da6b1e service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:10.214538 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1031/2057] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:54:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:54:10.221841 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1027/2058] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:54:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:54:10.673599 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69f8f3-bc7f-4b52-9728-b0d93044488c service neutron] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:10.675882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-da69f8f3-bc7f-4b52-9728-b0d93044488c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:10.693741 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:10.749655 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f33ba-410b-4698-a5aa-e47ea3da6b1e service neutron] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:10.751515 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-fe9f33ba-410b-4698-a5aa-e47ea3da6b1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:10.772223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69f8f3-bc7f-4b52-9728-b0d93044488c service neutron] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:10.780421 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072c444-0a89-4966-8f62-d51ec35ec41f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:10.781597 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072c444-0a89-4966-8f62-d51ec35ec41f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:10.788888 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f33ba-410b-4698-a5aa-e47ea3da6b1e service neutron] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:10.794736 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072c444-0a89-4966-8f62-d51ec35ec41f admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:10.795390 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072c444-0a89-4966-8f62-d51ec35ec41f admin admin] PATH_INFO: `/v3/projects/7372ad4e3f724ad280b5b11fb595568f` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:10.796737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e1686-39a2-4fe5-af5b-ff0504aa4557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:10.797932 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e1686-39a2-4fe5-af5b-ff0504aa4557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:10.798274 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e1686-39a2-4fe5-af5b-ff0504aa4557 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:10.798563 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e1686-39a2-4fe5-af5b-ff0504aa4557 admin admin] PATH_INFO: `/v3/projects/21c0d030e5ae49f18bb10ca5bc0484b6` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:10.800031 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e1686-39a2-4fe5-af5b-ff0504aa4557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21c0d030e5ae49f18bb10ca5bc0484b6)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:10.802306 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7e1686-39a2-4fe5-af5b-ff0504aa4557 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:10.809672 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072c444-0a89-4966-8f62-d51ec35ec41f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7372ad4e3f724ad280b5b11fb595568f)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:10.813923 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072c444-0a89-4966-8f62-d51ec35ec41f admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:10.916463 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-3072c444-0a89-4966-8f62-d51ec35ec41f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7372ad4e3f724ad280b5b11fb595568f', 'request_id': 'req-3072c444-0a89-4966-8f62-d51ec35ec41f'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:10.925929 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-bf7e1686-39a2-4fe5-af5b-ff0504aa4557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21c0d030e5ae49f18bb10ca5bc0484b6', 'request_id': 'req-bf7e1686-39a2-4fe5-af5b-ff0504aa4557'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:10.934458 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-3072c444-0a89-4966-8f62-d51ec35ec41f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7372ad4e3f724ad280b5b11fb595568f', 'request_id': 'req-3072c444-0a89-4966-8f62-d51ec35ec41f'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:10.943635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-bf7e1686-39a2-4fe5-af5b-ff0504aa4557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21c0d030e5ae49f18bb10ca5bc0484b6', 'request_id': 'req-bf7e1686-39a2-4fe5-af5b-ff0504aa4557'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:10.955403 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-3072c444-0a89-4966-8f62-d51ec35ec41f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7372ad4e3f724ad280b5b11fb595568f', 'request_id': 'req-3072c444-0a89-4966-8f62-d51ec35ec41f'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:10.961942 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-bf7e1686-39a2-4fe5-af5b-ff0504aa4557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21c0d030e5ae49f18bb10ca5bc0484b6', 'request_id': 'req-bf7e1686-39a2-4fe5-af5b-ff0504aa4557'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:10.979081 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-3072c444-0a89-4966-8f62-d51ec35ec41f admin admin] The token cache is being invalidate because project 7372ad4e3f724ad280b5b11fb595568f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:54:10.981201 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-3072c444-0a89-4966-8f62-d51ec35ec41f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:10.981965 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-3072c444-0a89-4966-8f62-d51ec35ec41f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:10.983814 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1032/2059] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:54:10 2022] DELETE /identity/v3/projects/7372ad4e3f724ad280b5b11fb595568f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:54:10.991255 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-bf7e1686-39a2-4fe5-af5b-ff0504aa4557 admin admin] The token cache is being invalidate because project 21c0d030e5ae49f18bb10ca5bc0484b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:54:10.991563 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-bf7e1686-39a2-4fe5-af5b-ff0504aa4557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:10.992283 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-bf7e1686-39a2-4fe5-af5b-ff0504aa4557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:10.994443 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1028/2060] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:54:10 2022] DELETE /identity/v3/projects/21c0d030e5ae49f18bb10ca5bc0484b6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:54:10.999562 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf131e8-af47-417d-b159-7ad8b0a0f198 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:10.999852 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf131e8-af47-417d-b159-7ad8b0a0f198 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:11.000162 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf131e8-af47-417d-b159-7ad8b0a0f198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:11.023430 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-6cf131e8-af47-417d-b159-7ad8b0a0f198 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:11.024727 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-6cf131e8-af47-417d-b159-7ad8b0a0f198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:11.135389 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1033/2061] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:11.137438 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1bf9d-50b5-4814-a9b5-99543fb1b15d None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:11.137791 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1bf9d-50b5-4814-a9b5-99543fb1b15d None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:11.138133 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1bf9d-50b5-4814-a9b5-99543fb1b15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:11.160007 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-52b1bf9d-50b5-4814-a9b5-99543fb1b15d None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:11.161309 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-52b1bf9d-50b5-4814-a9b5-99543fb1b15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:11.170000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1029/2062] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:11.178987 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf131e8-af47-417d-b159-7ad8b0a0f198 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:11.192758 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf131e8-af47-417d-b159-7ad8b0a0f198 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:11.199874 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb62a75-7fb5-45de-a993-9481a30d296c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:11.200820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb62a75-7fb5-45de-a993-9481a30d296c admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:11.201328 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb62a75-7fb5-45de-a993-9481a30d296c admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:11.201905 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb62a75-7fb5-45de-a993-9481a30d296c admin admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:11.203091 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb62a75-7fb5-45de-a993-9481a30d296c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:54:11.203491 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb62a75-7fb5-45de-a993-9481a30d296c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:11.205419 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb62a75-7fb5-45de-a993-9481a30d296c admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:11.219499 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1034/2063] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:54:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:54:11.223988 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1bf9d-50b5-4814-a9b5-99543fb1b15d None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:11.234353 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1bf9d-50b5-4814-a9b5-99543fb1b15d None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:11.241288 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c47db8-b1ac-4641-9d69-2ba280102a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:11.242212 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c47db8-b1ac-4641-9d69-2ba280102a1a admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:11.242610 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c47db8-b1ac-4641-9d69-2ba280102a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:11.242968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c47db8-b1ac-4641-9d69-2ba280102a1a admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:11.243912 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c47db8-b1ac-4641-9d69-2ba280102a1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:11.246488 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c47db8-b1ac-4641-9d69-2ba280102a1a admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:11.280833 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1030/2064] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:54:11 2022] POST /identity/v3/projects => generated 405 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:54:11.284597 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb62a75-7fb5-45de-a993-9481a30d296c admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:11.297193 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb62a75-7fb5-45de-a993-9481a30d296c admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:11.359148 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97cfea-5e18-4307-a3cc-25b3c190acd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:11.359783 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97cfea-5e18-4307-a3cc-25b3c190acd2 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:11.360146 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97cfea-5e18-4307-a3cc-25b3c190acd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:11.360518 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97cfea-5e18-4307-a3cc-25b3c190acd2 admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:11.361213 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97cfea-5e18-4307-a3cc-25b3c190acd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:11.364194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97cfea-5e18-4307-a3cc-25b3c190acd2 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:11.387642 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1035/2065] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:54:11 2022] POST /identity/v3/users => generated 303 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:54:11.392231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c47db8-b1ac-4641-9d69-2ba280102a1a admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:11.398107 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:11.403911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c47db8-b1ac-4641-9d69-2ba280102a1a admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:11.412760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc0220-45e3-4a20-a075-a058ee20d134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:11.413494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc0220-45e3-4a20-a075-a058ee20d134 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:11.414061 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc0220-45e3-4a20-a075-a058ee20d134 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:11.414544 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc0220-45e3-4a20-a075-a058ee20d134 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:11.415760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc0220-45e3-4a20-a075-a058ee20d134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:11.417700 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cc0220-45e3-4a20-a075-a058ee20d134 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:11.429151 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1031/2066] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:54:11.433741 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97cfea-5e18-4307-a3cc-25b3c190acd2 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:11.445562 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:11.449914 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97cfea-5e18-4307-a3cc-25b3c190acd2 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:11.456545 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09336d7-bea2-45db-85f1-85a1a190fdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:11.457439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09336d7-bea2-45db-85f1-85a1a190fdbb admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:11.457928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09336d7-bea2-45db-85f1-85a1a190fdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:11.458236 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09336d7-bea2-45db-85f1-85a1a190fdbb admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:11.459145 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09336d7-bea2-45db-85f1-85a1a190fdbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:11.460811 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09336d7-bea2-45db-85f1-85a1a190fdbb admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:11.473879 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1036/2067] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:54:11.478479 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc0220-45e3-4a20-a075-a058ee20d134 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:11.489608 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc0220-45e3-4a20-a075-a058ee20d134 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:11.494983 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae893f-b28d-48e3-91a7-ef7fce79e14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:11.495649 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae893f-b28d-48e3-91a7-ef7fce79e14a admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:11.495899 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae893f-b28d-48e3-91a7-ef7fce79e14a admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:11.496204 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae893f-b28d-48e3-91a7-ef7fce79e14a admin admin] PATH_INFO: `/v3/projects/72def94eb6ef426a890d142fd771a9b2/users/8214a33867724919a97fa8197a8a6595/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:11.512753 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae893f-b28d-48e3-91a7-ef7fce79e14a admin admin] RBAC: Authorizing `identity:create_grant(project_id=72def94eb6ef426a890d142fd771a9b2, user_id=8214a33867724919a97fa8197a8a6595, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:11.515149 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae893f-b28d-48e3-91a7-ef7fce79e14a admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:11.530441 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1032/2068] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:54:11 2022] PUT /identity/v3/projects/72def94eb6ef426a890d142fd771a9b2/users/8214a33867724919a97fa8197a8a6595/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:54:11.542521 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e716f2-8b5b-43b3-b23b-a257e9c1a79f None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:11.542837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e716f2-8b5b-43b3-b23b-a257e9c1a79f None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:11.543106 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e716f2-8b5b-43b3-b23b-a257e9c1a79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:11.575572 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-96e716f2-8b5b-43b3-b23b-a257e9c1a79f None None] MFA Rules not processed for user `8214a33867724919a97fa8197a8a6595`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:11.576888 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-96e716f2-8b5b-43b3-b23b-a257e9c1a79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:11.645651 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1037/2069] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:11 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:11.650753 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae893f-b28d-48e3-91a7-ef7fce79e14a admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:11.735646 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae893f-b28d-48e3-91a7-ef7fce79e14a admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:11.740984 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924b21f-357b-4fdb-a686-cd0f92dad367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:11.741649 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924b21f-357b-4fdb-a686-cd0f92dad367 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:11.741936 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924b21f-357b-4fdb-a686-cd0f92dad367 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:11.742238 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924b21f-357b-4fdb-a686-cd0f92dad367 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:11.742914 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924b21f-357b-4fdb-a686-cd0f92dad367 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:11.744834 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924b21f-357b-4fdb-a686-cd0f92dad367 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:11.795714 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1033/2070] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:54:11 2022] POST /identity/v3/projects => generated 405 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:54:11.796566 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e716f2-8b5b-43b3-b23b-a257e9c1a79f None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:11.816591 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e716f2-8b5b-43b3-b23b-a257e9c1a79f None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:11.905244 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d2488-0d91-437d-a29b-8d40c64ac393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:11.906505 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d2488-0d91-437d-a29b-8d40c64ac393 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:11.907030 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d2488-0d91-437d-a29b-8d40c64ac393 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:11.907533 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d2488-0d91-437d-a29b-8d40c64ac393 admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:11.908306 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d2488-0d91-437d-a29b-8d40c64ac393 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:11.910899 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d2488-0d91-437d-a29b-8d40c64ac393 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:11.935413 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1038/2071] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:54:11 2022] POST /identity/v3/users => generated 309 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:54:11.939796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924b21f-357b-4fdb-a686-cd0f92dad367 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:11.951574 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924b21f-357b-4fdb-a686-cd0f92dad367 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:11.957079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80126f94-126f-4347-8c91-a7b1aeb0ba08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:11.958207 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80126f94-126f-4347-8c91-a7b1aeb0ba08 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:11.958522 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80126f94-126f-4347-8c91-a7b1aeb0ba08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:11.958794 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80126f94-126f-4347-8c91-a7b1aeb0ba08 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:11.959524 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80126f94-126f-4347-8c91-a7b1aeb0ba08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:11.961177 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80126f94-126f-4347-8c91-a7b1aeb0ba08 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:11.974577 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1034/2072] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:54:11.979131 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d2488-0d91-437d-a29b-8d40c64ac393 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:11.994948 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d2488-0d91-437d-a29b-8d40c64ac393 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:12.001136 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccfaaa-b8f3-4dff-b90c-c3cb46447374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:12.001842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccfaaa-b8f3-4dff-b90c-c3cb46447374 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:12.002270 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccfaaa-b8f3-4dff-b90c-c3cb46447374 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:12.002585 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ccfaaa-b8f3-4dff-b90c-c3cb46447374 admin admin] PATH_INFO: `/v3/projects/de19f16bc1514360945c68d92559fdc2/users/a269ed0335174164a896f8ab09b9716a/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:12.021430 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ccfaaa-b8f3-4dff-b90c-c3cb46447374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de19f16bc1514360945c68d92559fdc2, user_id=a269ed0335174164a896f8ab09b9716a, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:12.026087 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ccfaaa-b8f3-4dff-b90c-c3cb46447374 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:12.051743 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1039/2073] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:54:11 2022] PUT /identity/v3/projects/de19f16bc1514360945c68d92559fdc2/users/a269ed0335174164a896f8ab09b9716a/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:54:12.055884 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80126f94-126f-4347-8c91-a7b1aeb0ba08 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:12.066709 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80126f94-126f-4347-8c91-a7b1aeb0ba08 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:12.163368 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387745e7-015b-4777-8884-a89808c08303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:12.164340 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387745e7-015b-4777-8884-a89808c08303 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:12.164461 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387745e7-015b-4777-8884-a89808c08303 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:12.164897 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387745e7-015b-4777-8884-a89808c08303 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:12.166337 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387745e7-015b-4777-8884-a89808c08303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:12.168168 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387745e7-015b-4777-8884-a89808c08303 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:12.186308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1035/2074] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:54:12.190020 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccfaaa-b8f3-4dff-b90c-c3cb46447374 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:12.204813 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ccfaaa-b8f3-4dff-b90c-c3cb46447374 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:12.213375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717dcff-fb4b-4efe-a247-e7062a206af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:12.214118 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717dcff-fb4b-4efe-a247-e7062a206af2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:12.214396 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717dcff-fb4b-4efe-a247-e7062a206af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:12.214668 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717dcff-fb4b-4efe-a247-e7062a206af2 admin admin] PATH_INFO: `/v3/projects/de19f16bc1514360945c68d92559fdc2/users/a269ed0335174164a896f8ab09b9716a/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:12.216667 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5717dcff-fb4b-4efe-a247-e7062a206af2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de19f16bc1514360945c68d92559fdc2, user_id=a269ed0335174164a896f8ab09b9716a, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:12.219399 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5717dcff-fb4b-4efe-a247-e7062a206af2 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:12.230875 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1040/2075] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:54:12 2022] PUT /identity/v3/projects/de19f16bc1514360945c68d92559fdc2/users/a269ed0335174164a896f8ab09b9716a/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:54:12.242549 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a79c4-1a90-4fb1-ba62-0bfd473a1427 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:12.242549 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a79c4-1a90-4fb1-ba62-0bfd473a1427 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:12.242848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a79c4-1a90-4fb1-ba62-0bfd473a1427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:12.274836 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-7a2a79c4-1a90-4fb1-ba62-0bfd473a1427 None None] MFA Rules not processed for user `a269ed0335174164a896f8ab09b9716a`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:12.276095 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-7a2a79c4-1a90-4fb1-ba62-0bfd473a1427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:12.306602 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:12.357781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1036/2076] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:12 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:12.370507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717dcff-fb4b-4efe-a247-e7062a206af2 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:12.372376 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-5717dcff-fb4b-4efe-a247-e7062a206af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:12.416164 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:12.439994 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717dcff-fb4b-4efe-a247-e7062a206af2 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:12.444468 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ae62c-7f5a-4085-a6f1-15851a377150 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:12.445112 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ae62c-7f5a-4085-a6f1-15851a377150 service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:12.445393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ae62c-7f5a-4085-a6f1-15851a377150 service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:12.445666 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ae62c-7f5a-4085-a6f1-15851a377150 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:12.456044 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ae62c-7f5a-4085-a6f1-15851a377150 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:12.457513 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ae62c-7f5a-4085-a6f1-15851a377150 service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:12.468259 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1041/2077] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:54:12 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:54:12.638239 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a79c4-1a90-4fb1-ba62-0bfd473a1427 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:12.720548 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a79c4-1a90-4fb1-ba62-0bfd473a1427 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:12.730491 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674100e-535a-4c7e-94e3-500b05bb5942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:12.731170 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674100e-535a-4c7e-94e3-500b05bb5942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:12.731455 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674100e-535a-4c7e-94e3-500b05bb5942 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:12.731878 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674100e-535a-4c7e-94e3-500b05bb5942 admin admin] PATH_INFO: `/v3/users/8214a33867724919a97fa8197a8a6595` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:12.733131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674100e-535a-4c7e-94e3-500b05bb5942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8214a33867724919a97fa8197a8a6595)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:12.735182 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674100e-535a-4c7e-94e3-500b05bb5942 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:12.812427 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-7674100e-535a-4c7e-94e3-500b05bb5942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8214a33867724919a97fa8197a8a6595'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:12.821220 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-7674100e-535a-4c7e-94e3-500b05bb5942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8214a33867724919a97fa8197a8a6595'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:12.839649 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-7674100e-535a-4c7e-94e3-500b05bb5942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8214a33867724919a97fa8197a8a6595'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:12.846674 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-7674100e-535a-4c7e-94e3-500b05bb5942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8214a33867724919a97fa8197a8a6595'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:12.847413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-7674100e-535a-4c7e-94e3-500b05bb5942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8214a33867724919a97fa8197a8a6595'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:12.854261 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1037/2078] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:54:12 2022] DELETE /identity/v3/users/8214a33867724919a97fa8197a8a6595 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:54:12.859232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c3c6b-ecd1-431b-b2cb-8b4dd35e5c5d None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:12.859727 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c3c6b-ecd1-431b-b2cb-8b4dd35e5c5d None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:12.859967 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c3c6b-ecd1-431b-b2cb-8b4dd35e5c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:12.882450 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-f97c3c6b-ecd1-431b-b2cb-8b4dd35e5c5d None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:12.883696 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-f97c3c6b-ecd1-431b-b2cb-8b4dd35e5c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:12.967351 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1042/2079] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:12.978046 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674100e-535a-4c7e-94e3-500b05bb5942 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:12.979529 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-7674100e-535a-4c7e-94e3-500b05bb5942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:13.030374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:13.047527 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674100e-535a-4c7e-94e3-500b05bb5942 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:13.051930 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15651e-984e-4c90-ad6d-15f7ac4d2f80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:13.052726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15651e-984e-4c90-ad6d-15f7ac4d2f80 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:13.053009 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15651e-984e-4c90-ad6d-15f7ac4d2f80 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:13.053386 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15651e-984e-4c90-ad6d-15f7ac4d2f80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:13.068005 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15651e-984e-4c90-ad6d-15f7ac4d2f80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:13.070060 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15651e-984e-4c90-ad6d-15f7ac4d2f80 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:13.081838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1038/2080] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:54:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:54:13.518914 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c3c6b-ecd1-431b-b2cb-8b4dd35e5c5d None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:13.520449 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-f97c3c6b-ecd1-431b-b2cb-8b4dd35e5c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:13.541399 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c3c6b-ecd1-431b-b2cb-8b4dd35e5c5d None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:13.552291 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9dfb19-e7aa-4ac1-beed-0b256c119734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:13.552999 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9dfb19-e7aa-4ac1-beed-0b256c119734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:13.553271 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9dfb19-e7aa-4ac1-beed-0b256c119734 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:13.553571 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9dfb19-e7aa-4ac1-beed-0b256c119734 admin admin] PATH_INFO: `/v3/projects/72def94eb6ef426a890d142fd771a9b2` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:13.554970 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9dfb19-e7aa-4ac1-beed-0b256c119734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72def94eb6ef426a890d142fd771a9b2)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:13.556982 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9dfb19-e7aa-4ac1-beed-0b256c119734 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:13.618978 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-da9dfb19-e7aa-4ac1-beed-0b256c119734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72def94eb6ef426a890d142fd771a9b2', 'request_id': 'req-da9dfb19-e7aa-4ac1-beed-0b256c119734'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:13.627917 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-da9dfb19-e7aa-4ac1-beed-0b256c119734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72def94eb6ef426a890d142fd771a9b2', 'request_id': 'req-da9dfb19-e7aa-4ac1-beed-0b256c119734'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:13.634866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-da9dfb19-e7aa-4ac1-beed-0b256c119734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72def94eb6ef426a890d142fd771a9b2', 'request_id': 'req-da9dfb19-e7aa-4ac1-beed-0b256c119734'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:13.649503 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-da9dfb19-e7aa-4ac1-beed-0b256c119734 admin admin] The token cache is being invalidate because project 72def94eb6ef426a890d142fd771a9b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:54:13.650272 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-da9dfb19-e7aa-4ac1-beed-0b256c119734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:13.651462 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-da9dfb19-e7aa-4ac1-beed-0b256c119734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:13.653937 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1043/2081] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:54:13 2022] DELETE /identity/v3/projects/72def94eb6ef426a890d142fd771a9b2 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:54:13.657840 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15651e-984e-4c90-ad6d-15f7ac4d2f80 service neutron] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:13.668155 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15651e-984e-4c90-ad6d-15f7ac4d2f80 service neutron] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:13.730733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97516481-2686-46e6-8c69-0ff54cb880d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:13.731400 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97516481-2686-46e6-8c69-0ff54cb880d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:13.731679 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97516481-2686-46e6-8c69-0ff54cb880d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:13.732036 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97516481-2686-46e6-8c69-0ff54cb880d7 admin admin] PATH_INFO: `/v3/users/a269ed0335174164a896f8ab09b9716a` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:13.733163 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97516481-2686-46e6-8c69-0ff54cb880d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a269ed0335174164a896f8ab09b9716a)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:13.735470 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97516481-2686-46e6-8c69-0ff54cb880d7 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:13.788145 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-97516481-2686-46e6-8c69-0ff54cb880d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a269ed0335174164a896f8ab09b9716a'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:13.798634 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-97516481-2686-46e6-8c69-0ff54cb880d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a269ed0335174164a896f8ab09b9716a'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:13.815304 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-97516481-2686-46e6-8c69-0ff54cb880d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a269ed0335174164a896f8ab09b9716a'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:13.824398 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-97516481-2686-46e6-8c69-0ff54cb880d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a269ed0335174164a896f8ab09b9716a'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:13.825265 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-97516481-2686-46e6-8c69-0ff54cb880d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a269ed0335174164a896f8ab09b9716a'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:13.834119 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1039/2082] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:54:13 2022] DELETE /identity/v3/users/a269ed0335174164a896f8ab09b9716a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:54:14.215978 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9dfb19-e7aa-4ac1-beed-0b256c119734 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:14.217759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-da9dfb19-e7aa-4ac1-beed-0b256c119734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:14.231768 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9dfb19-e7aa-4ac1-beed-0b256c119734 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:14.305103 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8b578-f044-43bd-a2ff-e5f1212f601a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:14.305800 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8b578-f044-43bd-a2ff-e5f1212f601a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:14.306116 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8b578-f044-43bd-a2ff-e5f1212f601a admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:14.306395 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8b578-f044-43bd-a2ff-e5f1212f601a admin admin] PATH_INFO: `/v3/projects/de19f16bc1514360945c68d92559fdc2` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:14.307634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8b578-f044-43bd-a2ff-e5f1212f601a admin admin] RBAC: Authorizing `identity:delete_project(project_id=de19f16bc1514360945c68d92559fdc2)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:14.309696 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8b578-f044-43bd-a2ff-e5f1212f601a admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:14.312204 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:14.365648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-c3c8b578-f044-43bd-a2ff-e5f1212f601a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de19f16bc1514360945c68d92559fdc2', 'request_id': 'req-c3c8b578-f044-43bd-a2ff-e5f1212f601a'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:14.377030 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-c3c8b578-f044-43bd-a2ff-e5f1212f601a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de19f16bc1514360945c68d92559fdc2', 'request_id': 'req-c3c8b578-f044-43bd-a2ff-e5f1212f601a'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:14.385603 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-c3c8b578-f044-43bd-a2ff-e5f1212f601a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de19f16bc1514360945c68d92559fdc2', 'request_id': 'req-c3c8b578-f044-43bd-a2ff-e5f1212f601a'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:14.399074 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-c3c8b578-f044-43bd-a2ff-e5f1212f601a admin admin] The token cache is being invalidate because project de19f16bc1514360945c68d92559fdc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:54:14.399371 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-c3c8b578-f044-43bd-a2ff-e5f1212f601a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:14.400126 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-c3c8b578-f044-43bd-a2ff-e5f1212f601a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:14.401847 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1044/2083] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:54:14 2022] DELETE /identity/v3/projects/de19f16bc1514360945c68d92559fdc2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:54:14.407941 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba3046-728d-4f08-8fde-b2151a8581a0 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:14.408230 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba3046-728d-4f08-8fde-b2151a8581a0 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:14.408506 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba3046-728d-4f08-8fde-b2151a8581a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:14.435693 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-8aba3046-728d-4f08-8fde-b2151a8581a0 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:14.437505 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-8aba3046-728d-4f08-8fde-b2151a8581a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:14.507294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1040/2084] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:14.515349 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91eff2-b9b6-4bff-bf31-c0e1fabeed27 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:14.515638 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91eff2-b9b6-4bff-bf31-c0e1fabeed27 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:14.516627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91eff2-b9b6-4bff-bf31-c0e1fabeed27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:14.539518 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-ad91eff2-b9b6-4bff-bf31-c0e1fabeed27 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:14.541334 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-ad91eff2-b9b6-4bff-bf31-c0e1fabeed27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:14.554293 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1045/2085] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:14.559737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba3046-728d-4f08-8fde-b2151a8581a0 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:14.566665 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:14.571406 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba3046-728d-4f08-8fde-b2151a8581a0 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:14.579869 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10ef32-4851-403d-a287-4abee6b3e190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:14.581630 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10ef32-4851-403d-a287-4abee6b3e190 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:14.581916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10ef32-4851-403d-a287-4abee6b3e190 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:14.582238 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10ef32-4851-403d-a287-4abee6b3e190 admin admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:14.583409 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10ef32-4851-403d-a287-4abee6b3e190 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:54:14.583841 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10ef32-4851-403d-a287-4abee6b3e190 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:14.585501 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10ef32-4851-403d-a287-4abee6b3e190 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:14.599736 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1041/2086] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:54:14.608273 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91eff2-b9b6-4bff-bf31-c0e1fabeed27 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:14.618515 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91eff2-b9b6-4bff-bf31-c0e1fabeed27 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:14.623168 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8df60-cd4c-4037-82d8-2356e471239a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:14.623791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8df60-cd4c-4037-82d8-2356e471239a admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:14.624074 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8df60-cd4c-4037-82d8-2356e471239a admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:14.624346 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8df60-cd4c-4037-82d8-2356e471239a admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:14.625024 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8df60-cd4c-4037-82d8-2356e471239a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:14.627023 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8df60-cd4c-4037-82d8-2356e471239a admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:14.659513 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1046/2087] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:54:14 2022] POST /identity/v3/projects => generated 355 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:54:14.663910 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10ef32-4851-403d-a287-4abee6b3e190 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:14.675740 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10ef32-4851-403d-a287-4abee6b3e190 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:14.748927 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d35e35-a8f1-4b1d-9daf-bf64416eae5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:14.749571 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d35e35-a8f1-4b1d-9daf-bf64416eae5f admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:14.749849 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d35e35-a8f1-4b1d-9daf-bf64416eae5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:14.750157 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d35e35-a8f1-4b1d-9daf-bf64416eae5f admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:14.751036 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d35e35-a8f1-4b1d-9daf-bf64416eae5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:14.753106 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d35e35-a8f1-4b1d-9daf-bf64416eae5f admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:14.778284 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1042/2088] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:54:14 2022] POST /identity/v3/users => generated 278 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:54:14.782903 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8df60-cd4c-4037-82d8-2356e471239a admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:14.795392 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8df60-cd4c-4037-82d8-2356e471239a admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:14.800734 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b71299-25f6-45e7-90a8-1dddc170ff9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:14.801378 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b71299-25f6-45e7-90a8-1dddc170ff9d admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:14.801724 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b71299-25f6-45e7-90a8-1dddc170ff9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:14.802022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b71299-25f6-45e7-90a8-1dddc170ff9d admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:14.802750 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b71299-25f6-45e7-90a8-1dddc170ff9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:14.804388 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b71299-25f6-45e7-90a8-1dddc170ff9d admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:14.815313 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1047/2089] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:54:14.819514 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d35e35-a8f1-4b1d-9daf-bf64416eae5f admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:14.830709 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d35e35-a8f1-4b1d-9daf-bf64416eae5f admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:14.836763 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48202be-9b7a-4272-9d53-b97e14ed81b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:14.837558 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48202be-9b7a-4272-9d53-b97e14ed81b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:14.837864 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48202be-9b7a-4272-9d53-b97e14ed81b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:14.838177 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48202be-9b7a-4272-9d53-b97e14ed81b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:14.838943 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48202be-9b7a-4272-9d53-b97e14ed81b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:14.840717 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48202be-9b7a-4272-9d53-b97e14ed81b5 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:14.854286 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1043/2090] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:54:14.859659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b71299-25f6-45e7-90a8-1dddc170ff9d admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:14.871687 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b71299-25f6-45e7-90a8-1dddc170ff9d admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:14.876952 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ec8ae-986d-4dca-b497-f6a51f192707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:14.877630 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ec8ae-986d-4dca-b497-f6a51f192707 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:14.877911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ec8ae-986d-4dca-b497-f6a51f192707 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:14.878227 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ec8ae-986d-4dca-b497-f6a51f192707 admin admin] PATH_INFO: `/v3/projects/56aa103ab2ad44578818043ce53b85be/users/167ff07f36a24d1b9cef3c7dc91ec337/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:14.894684 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ec8ae-986d-4dca-b497-f6a51f192707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56aa103ab2ad44578818043ce53b85be, user_id=167ff07f36a24d1b9cef3c7dc91ec337, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:14.897458 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ec8ae-986d-4dca-b497-f6a51f192707 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:14.913153 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1048/2091] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:54:14 2022] PUT /identity/v3/projects/56aa103ab2ad44578818043ce53b85be/users/167ff07f36a24d1b9cef3c7dc91ec337/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:54:14.925120 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7a4ba-96aa-40ba-92e5-320c7c1c3f1d None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:14.925389 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7a4ba-96aa-40ba-92e5-320c7c1c3f1d None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:14.925670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf7a4ba-96aa-40ba-92e5-320c7c1c3f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:14.958180 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-6cf7a4ba-96aa-40ba-92e5-320c7c1c3f1d None None] MFA Rules not processed for user `167ff07f36a24d1b9cef3c7dc91ec337`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:14.959422 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-6cf7a4ba-96aa-40ba-92e5-320c7c1c3f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:15.035515 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1044/2092] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:14 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:15.037039 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ec8ae-986d-4dca-b497-f6a51f192707 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:15.123206 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ec8ae-986d-4dca-b497-f6a51f192707 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:15.131323 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fa7de-592a-4481-a1a7-521371906c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:15.132074 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fa7de-592a-4481-a1a7-521371906c45 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:15.132422 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fa7de-592a-4481-a1a7-521371906c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:15.132788 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80fa7de-592a-4481-a1a7-521371906c45 admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:15.133851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80fa7de-592a-4481-a1a7-521371906c45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:15.136228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80fa7de-592a-4481-a1a7-521371906c45 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:15.175050 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1049/2093] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:54:15 2022] POST /identity/v3/projects => generated 357 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:54:15.176700 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7a4ba-96aa-40ba-92e5-320c7c1c3f1d None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:15.196086 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf7a4ba-96aa-40ba-92e5-320c7c1c3f1d None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:15.280658 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3162c3-7e6b-42e3-97f4-d987350d32cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:15.281316 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3162c3-7e6b-42e3-97f4-d987350d32cd admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:15.281596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3162c3-7e6b-42e3-97f4-d987350d32cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:15.281938 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3162c3-7e6b-42e3-97f4-d987350d32cd admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:15.282612 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3162c3-7e6b-42e3-97f4-d987350d32cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:15.284664 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3162c3-7e6b-42e3-97f4-d987350d32cd admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:15.293651 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:15.314232 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1045/2094] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:54:15 2022] POST /identity/v3/users => generated 285 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:54:15.315862 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fa7de-592a-4481-a1a7-521371906c45 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:15.327192 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80fa7de-592a-4481-a1a7-521371906c45 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:15.332987 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068870e5-d4e9-4755-9b5c-6e4c63f8efbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:15.333698 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068870e5-d4e9-4755-9b5c-6e4c63f8efbd admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:15.334072 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068870e5-d4e9-4755-9b5c-6e4c63f8efbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:15.334408 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068870e5-d4e9-4755-9b5c-6e4c63f8efbd admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:15.335175 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068870e5-d4e9-4755-9b5c-6e4c63f8efbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:15.336869 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068870e5-d4e9-4755-9b5c-6e4c63f8efbd admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:15.349096 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1050/2095] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:54:15.353046 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3162c3-7e6b-42e3-97f4-d987350d32cd admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:15.364081 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3162c3-7e6b-42e3-97f4-d987350d32cd admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:15.369533 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0b791-0fbe-48ff-8f44-44179dbf982f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:15.370480 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0b791-0fbe-48ff-8f44-44179dbf982f admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:15.370762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0b791-0fbe-48ff-8f44-44179dbf982f admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:15.371062 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0b791-0fbe-48ff-8f44-44179dbf982f admin admin] PATH_INFO: `/v3/projects/86df722915df4e1493f78cd5aa70dcc5/users/45b9892ee508410f8c34ad0d70c6239b/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:15.388105 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0b791-0fbe-48ff-8f44-44179dbf982f admin admin] RBAC: Authorizing `identity:create_grant(project_id=86df722915df4e1493f78cd5aa70dcc5, user_id=45b9892ee508410f8c34ad0d70c6239b, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:15.390817 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e0b791-0fbe-48ff-8f44-44179dbf982f admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:15.406439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1046/2096] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:54:15 2022] PUT /identity/v3/projects/86df722915df4e1493f78cd5aa70dcc5/users/45b9892ee508410f8c34ad0d70c6239b/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:54:15.410598 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068870e5-d4e9-4755-9b5c-6e4c63f8efbd admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:15.416846 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:15.426945 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068870e5-d4e9-4755-9b5c-6e4c63f8efbd admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:15.490163 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b664c7-5133-4ad4-a94a-8626943a999b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:15.490800 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b664c7-5133-4ad4-a94a-8626943a999b admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:15.491081 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b664c7-5133-4ad4-a94a-8626943a999b admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:15.491356 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b664c7-5133-4ad4-a94a-8626943a999b admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:15.492068 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b664c7-5133-4ad4-a94a-8626943a999b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:15.493749 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b664c7-5133-4ad4-a94a-8626943a999b admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:15.505818 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1051/2097] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:54:15.510358 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0b791-0fbe-48ff-8f44-44179dbf982f admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:15.525596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0b791-0fbe-48ff-8f44-44179dbf982f admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:15.531689 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74dcbb5-5723-40c5-8b5f-4e7d0485f968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:15.532513 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dcbb5-5723-40c5-8b5f-4e7d0485f968 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:15.532798 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dcbb5-5723-40c5-8b5f-4e7d0485f968 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:15.533077 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74dcbb5-5723-40c5-8b5f-4e7d0485f968 admin admin] PATH_INFO: `/v3/projects/86df722915df4e1493f78cd5aa70dcc5/users/45b9892ee508410f8c34ad0d70c6239b/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:15.535592 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74dcbb5-5723-40c5-8b5f-4e7d0485f968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86df722915df4e1493f78cd5aa70dcc5, user_id=45b9892ee508410f8c34ad0d70c6239b, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:15.538518 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74dcbb5-5723-40c5-8b5f-4e7d0485f968 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:15.554312 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1047/2098] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:54:15 2022] PUT /identity/v3/projects/86df722915df4e1493f78cd5aa70dcc5/users/45b9892ee508410f8c34ad0d70c6239b/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:54:15.562097 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106ebf8-2e47-465c-8103-502ce2870b37 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:15.562386 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106ebf8-2e47-465c-8103-502ce2870b37 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:15.562693 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106ebf8-2e47-465c-8103-502ce2870b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:15.599767 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-6106ebf8-2e47-465c-8103-502ce2870b37 None None] MFA Rules not processed for user `45b9892ee508410f8c34ad0d70c6239b`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:15.600995 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-6106ebf8-2e47-465c-8103-502ce2870b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:15.698615 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1052/2099] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:15 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:15.710438 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74dcbb5-5723-40c5-8b5f-4e7d0485f968 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:15.712328 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-a74dcbb5-5723-40c5-8b5f-4e7d0485f968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:15.802031 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74dcbb5-5723-40c5-8b5f-4e7d0485f968 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:15.806169 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891a786-fbb4-4a6f-9ac9-19aa4d50e1f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:15.806902 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891a786-fbb4-4a6f-9ac9-19aa4d50e1f3 service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:15.807266 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891a786-fbb4-4a6f-9ac9-19aa4d50e1f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:15.807742 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891a786-fbb4-4a6f-9ac9-19aa4d50e1f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:15.824990 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891a786-fbb4-4a6f-9ac9-19aa4d50e1f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:15.826573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891a786-fbb4-4a6f-9ac9-19aa4d50e1f3 service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:15.841422 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1048/2100] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:54:15 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:54:15.920698 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106ebf8-2e47-465c-8103-502ce2870b37 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:15.931532 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106ebf8-2e47-465c-8103-502ce2870b37 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:15.935668 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41386f81-f197-4929-b737-a2b329f12596 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:15.936297 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41386f81-f197-4929-b737-a2b329f12596 service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:15.936574 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41386f81-f197-4929-b737-a2b329f12596 service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:15.936844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41386f81-f197-4929-b737-a2b329f12596 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:15.998726 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41386f81-f197-4929-b737-a2b329f12596 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:16.000194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41386f81-f197-4929-b737-a2b329f12596 service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:16.009646 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1053/2101] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:54:15 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:54:25.832482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:INSERT=5,keystone:SELECT=43 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:26.005337 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=90 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:27.644454 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891a786-fbb4-4a6f-9ac9-19aa4d50e1f3 service cinder] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:27.646263 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-4891a786-fbb4-4a6f-9ac9-19aa4d50e1f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:27.715644 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891a786-fbb4-4a6f-9ac9-19aa4d50e1f3 service cinder] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:27.720776 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7e255-c3a4-4641-9e9a-1a306baa0151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:27.721527 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7e255-c3a4-4641-9e9a-1a306baa0151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:27.721789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7e255-c3a4-4641-9e9a-1a306baa0151 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:27.722095 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7e255-c3a4-4641-9e9a-1a306baa0151 admin admin] PATH_INFO: `/v3/users/0bbb02e92c194d23be0276d13ae81f43` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:27.723343 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef7e255-c3a4-4641-9e9a-1a306baa0151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bbb02e92c194d23be0276d13ae81f43)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:27.725329 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef7e255-c3a4-4641-9e9a-1a306baa0151 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:27.776431 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-6ef7e255-c3a4-4641-9e9a-1a306baa0151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bbb02e92c194d23be0276d13ae81f43'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:27.785699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-6ef7e255-c3a4-4641-9e9a-1a306baa0151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bbb02e92c194d23be0276d13ae81f43'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:27.798535 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-6ef7e255-c3a4-4641-9e9a-1a306baa0151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bbb02e92c194d23be0276d13ae81f43'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:27.805903 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-6ef7e255-c3a4-4641-9e9a-1a306baa0151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bbb02e92c194d23be0276d13ae81f43'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:27.806541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-6ef7e255-c3a4-4641-9e9a-1a306baa0151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bbb02e92c194d23be0276d13ae81f43'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:27.812800 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1049/2102] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:54:27 2022] DELETE /identity/v3/users/0bbb02e92c194d23be0276d13ae81f43 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:54:27.817560 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2ae69-151f-4d4d-b92f-3a9fb8eddc04 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:27.818056 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2ae69-151f-4d4d-b92f-3a9fb8eddc04 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:27.818147 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2ae69-151f-4d4d-b92f-3a9fb8eddc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:27.838867 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-cbc2ae69-151f-4d4d-b92f-3a9fb8eddc04 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:27.840133 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-cbc2ae69-151f-4d4d-b92f-3a9fb8eddc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:27.904231 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1054/2103] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:27.914394 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7e255-c3a4-4641-9e9a-1a306baa0151 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:27.915980 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-6ef7e255-c3a4-4641-9e9a-1a306baa0151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:27.977945 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7e255-c3a4-4641-9e9a-1a306baa0151 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:27.982440 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f8d2d-3d57-4e3f-9cb5-1faac209501f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:27.983111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f8d2d-3d57-4e3f-9cb5-1faac209501f service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:27.983391 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f8d2d-3d57-4e3f-9cb5-1faac209501f service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:27.983664 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f8d2d-3d57-4e3f-9cb5-1faac209501f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:27.994635 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f8d2d-3d57-4e3f-9cb5-1faac209501f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:27.996116 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f8d2d-3d57-4e3f-9cb5-1faac209501f service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:28.006229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1050/2104] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:54:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:54:28.311889 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2ae69-151f-4d4d-b92f-3a9fb8eddc04 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:28.324489 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-cbc2ae69-151f-4d4d-b92f-3a9fb8eddc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:28.325783 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2ae69-151f-4d4d-b92f-3a9fb8eddc04 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:28.331291 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ebd3f1-6e1b-43e0-9a7d-ad1dce3f7e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:28.332947 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebd3f1-6e1b-43e0-9a7d-ad1dce3f7e34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:28.333224 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebd3f1-6e1b-43e0-9a7d-ad1dce3f7e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:28.334047 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebd3f1-6e1b-43e0-9a7d-ad1dce3f7e34 admin admin] PATH_INFO: `/v3/projects/f81fdade2b60498fbfb91de2916e73f9` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:28.335166 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ebd3f1-6e1b-43e0-9a7d-ad1dce3f7e34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f81fdade2b60498fbfb91de2916e73f9)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:28.337136 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ebd3f1-6e1b-43e0-9a7d-ad1dce3f7e34 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:28.402360 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-02ebd3f1-6e1b-43e0-9a7d-ad1dce3f7e34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f81fdade2b60498fbfb91de2916e73f9', 'request_id': 'req-02ebd3f1-6e1b-43e0-9a7d-ad1dce3f7e34'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:28.415609 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-02ebd3f1-6e1b-43e0-9a7d-ad1dce3f7e34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f81fdade2b60498fbfb91de2916e73f9', 'request_id': 'req-02ebd3f1-6e1b-43e0-9a7d-ad1dce3f7e34'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:28.426360 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-02ebd3f1-6e1b-43e0-9a7d-ad1dce3f7e34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f81fdade2b60498fbfb91de2916e73f9', 'request_id': 'req-02ebd3f1-6e1b-43e0-9a7d-ad1dce3f7e34'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:28.445778 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-02ebd3f1-6e1b-43e0-9a7d-ad1dce3f7e34 admin admin] The token cache is being invalidate because project f81fdade2b60498fbfb91de2916e73f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:54:28.446262 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-02ebd3f1-6e1b-43e0-9a7d-ad1dce3f7e34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:28.447122 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-02ebd3f1-6e1b-43e0-9a7d-ad1dce3f7e34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:28.454051 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1055/2105] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:54:28 2022] DELETE /identity/v3/projects/f81fdade2b60498fbfb91de2916e73f9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:54:28.458429 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a6779-e441-4ad5-8946-1da78b9b4023 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:28.459200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a6779-e441-4ad5-8946-1da78b9b4023 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:28.459735 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a6779-e441-4ad5-8946-1da78b9b4023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:28.483813 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-3b2a6779-e441-4ad5-8946-1da78b9b4023 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:28.485393 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-3b2a6779-e441-4ad5-8946-1da78b9b4023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:28.517194 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:28.592946 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1051/2106] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:28.600049 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54d151-db16-42ff-b080-306583756584 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:28.600338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54d151-db16-42ff-b080-306583756584 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:28.600635 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54d151-db16-42ff-b080-306583756584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:28.635993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-0a54d151-db16-42ff-b080-306583756584 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:28.637292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-0a54d151-db16-42ff-b080-306583756584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:28.646284 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1056/2107] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:28.650948 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a6779-e441-4ad5-8946-1da78b9b4023 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:28.661878 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a6779-e441-4ad5-8946-1da78b9b4023 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:28.669523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbccf4-4273-4c64-8a6f-d34403bf655e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:28.670308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbccf4-4273-4c64-8a6f-d34403bf655e admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:28.671010 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbccf4-4273-4c64-8a6f-d34403bf655e admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:28.671010 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbccf4-4273-4c64-8a6f-d34403bf655e admin admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:28.671653 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbccf4-4273-4c64-8a6f-d34403bf655e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:54:28.671960 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbccf4-4273-4c64-8a6f-d34403bf655e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:28.673786 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abbccf4-4273-4c64-8a6f-d34403bf655e admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:28.687554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1052/2108] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:54:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:54:28.691864 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54d151-db16-42ff-b080-306583756584 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:28.702493 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54d151-db16-42ff-b080-306583756584 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:28.716083 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8cde9a-c798-4dcf-ac18-5f253d6cd06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:28.716873 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cde9a-c798-4dcf-ac18-5f253d6cd06b admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:28.717224 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cde9a-c798-4dcf-ac18-5f253d6cd06b admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:28.717619 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8cde9a-c798-4dcf-ac18-5f253d6cd06b admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:28.718349 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8cde9a-c798-4dcf-ac18-5f253d6cd06b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:28.720615 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8cde9a-c798-4dcf-ac18-5f253d6cd06b admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:28.753427 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1057/2109] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:54:28 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:54:28.758941 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbccf4-4273-4c64-8a6f-d34403bf655e admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:28.769880 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abbccf4-4273-4c64-8a6f-d34403bf655e admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:28.851127 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecf041-1304-4f09-bfc5-bd0d83927e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:28.851696 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecf041-1304-4f09-bfc5-bd0d83927e5f admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:28.851985 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecf041-1304-4f09-bfc5-bd0d83927e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:28.852295 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecf041-1304-4f09-bfc5-bd0d83927e5f admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:28.853025 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ecf041-1304-4f09-bfc5-bd0d83927e5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:28.855411 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ecf041-1304-4f09-bfc5-bd0d83927e5f admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:28.878703 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1053/2110] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:54:28 2022] POST /identity/v3/users => generated 286 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:54:28.883347 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8cde9a-c798-4dcf-ac18-5f253d6cd06b admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:28.894559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8cde9a-c798-4dcf-ac18-5f253d6cd06b admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:28.899564 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c5107-9aaa-440e-9a2d-138dc98fd71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:28.900188 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c5107-9aaa-440e-9a2d-138dc98fd71f admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:28.900463 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c5107-9aaa-440e-9a2d-138dc98fd71f admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:28.900789 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c5107-9aaa-440e-9a2d-138dc98fd71f admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:28.901438 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c5107-9aaa-440e-9a2d-138dc98fd71f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:28.903148 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c5107-9aaa-440e-9a2d-138dc98fd71f admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:28.919844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1058/2111] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:54:28.923536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecf041-1304-4f09-bfc5-bd0d83927e5f admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:28.934760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecf041-1304-4f09-bfc5-bd0d83927e5f admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:28.940424 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894d72b-01d1-4504-a7a8-66493a0d65c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:28.941364 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894d72b-01d1-4504-a7a8-66493a0d65c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:28.941784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894d72b-01d1-4504-a7a8-66493a0d65c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:28.942238 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894d72b-01d1-4504-a7a8-66493a0d65c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:28.943318 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894d72b-01d1-4504-a7a8-66493a0d65c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:28.945946 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894d72b-01d1-4504-a7a8-66493a0d65c7 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:28.960143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1054/2112] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:54:28.964669 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c5107-9aaa-440e-9a2d-138dc98fd71f admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:28.977867 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c5107-9aaa-440e-9a2d-138dc98fd71f admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:28.983796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d957270-78d4-4584-ad89-ea91ad5b6e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:28.984498 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d957270-78d4-4584-ad89-ea91ad5b6e0e admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:28.984774 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d957270-78d4-4584-ad89-ea91ad5b6e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:28.985046 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d957270-78d4-4584-ad89-ea91ad5b6e0e admin admin] PATH_INFO: `/v3/projects/24f9078971b74c5a9e5f15d5c452a35a/users/191be93273d842a5a5b9db7bdbf3e95b/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:29.002444 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d957270-78d4-4584-ad89-ea91ad5b6e0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=24f9078971b74c5a9e5f15d5c452a35a, user_id=191be93273d842a5a5b9db7bdbf3e95b, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:29.005388 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d957270-78d4-4584-ad89-ea91ad5b6e0e admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:29.019350 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1059/2113] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:54:28 2022] PUT /identity/v3/projects/24f9078971b74c5a9e5f15d5c452a35a/users/191be93273d842a5a5b9db7bdbf3e95b/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:54:29.024869 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d505726-b85c-4318-9574-22c3240b9ae3 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:29.025314 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d505726-b85c-4318-9574-22c3240b9ae3 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:29.025692 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d505726-b85c-4318-9574-22c3240b9ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:29.051896 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-1d505726-b85c-4318-9574-22c3240b9ae3 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:29.053139 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-1d505726-b85c-4318-9574-22c3240b9ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:29.120935 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1055/2114] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:29.131606 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d957270-78d4-4584-ad89-ea91ad5b6e0e admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:29.133739 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-7d957270-78d4-4584-ad89-ea91ad5b6e0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:29.164296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:29.204860 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d957270-78d4-4584-ad89-ea91ad5b6e0e admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:29.208645 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca9e20-2103-433b-85ea-006b1aa73f01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:29.209267 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca9e20-2103-433b-85ea-006b1aa73f01 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:29.209564 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca9e20-2103-433b-85ea-006b1aa73f01 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:29.209843 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca9e20-2103-433b-85ea-006b1aa73f01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:29.219607 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca9e20-2103-433b-85ea-006b1aa73f01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:29.221082 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca9e20-2103-433b-85ea-006b1aa73f01 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:29.231301 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1060/2115] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:54:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:54:33.066429 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d505726-b85c-4318-9574-22c3240b9ae3 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:33.069439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-1d505726-b85c-4318-9574-22c3240b9ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:33.083543 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d505726-b85c-4318-9574-22c3240b9ae3 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:33.091452 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58ac27-ac5c-435c-ba99-663a6c9c6307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:33.092417 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58ac27-ac5c-435c-ba99-663a6c9c6307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:33.092795 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58ac27-ac5c-435c-ba99-663a6c9c6307 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:33.093257 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58ac27-ac5c-435c-ba99-663a6c9c6307 admin admin] PATH_INFO: `/v3/users/167ff07f36a24d1b9cef3c7dc91ec337` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:33.095399 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58ac27-ac5c-435c-ba99-663a6c9c6307 admin admin] RBAC: Authorizing `identity:delete_user(user_id=167ff07f36a24d1b9cef3c7dc91ec337)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:33.099238 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58ac27-ac5c-435c-ba99-663a6c9c6307 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:33.130231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:33.172887 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-cc58ac27-ac5c-435c-ba99-663a6c9c6307 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '167ff07f36a24d1b9cef3c7dc91ec337'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:33.183661 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-cc58ac27-ac5c-435c-ba99-663a6c9c6307 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '167ff07f36a24d1b9cef3c7dc91ec337'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:33.202696 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-cc58ac27-ac5c-435c-ba99-663a6c9c6307 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '167ff07f36a24d1b9cef3c7dc91ec337'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:33.210884 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-cc58ac27-ac5c-435c-ba99-663a6c9c6307 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '167ff07f36a24d1b9cef3c7dc91ec337'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:33.212074 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-cc58ac27-ac5c-435c-ba99-663a6c9c6307 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '167ff07f36a24d1b9cef3c7dc91ec337'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:33.220218 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1056/2116] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:54:33 2022] DELETE /identity/v3/users/167ff07f36a24d1b9cef3c7dc91ec337 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:54:33.225055 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648f2be-dd6f-439b-9293-5fbb65bb9eaf None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:33.225953 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648f2be-dd6f-439b-9293-5fbb65bb9eaf None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:33.225953 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648f2be-dd6f-439b-9293-5fbb65bb9eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:33.264844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-f648f2be-dd6f-439b-9293-5fbb65bb9eaf None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:33.266539 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-f648f2be-dd6f-439b-9293-5fbb65bb9eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:33.397736 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1061/2117] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:54:33.411044 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58ac27-ac5c-435c-ba99-663a6c9c6307 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:33.412673 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-cc58ac27-ac5c-435c-ba99-663a6c9c6307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:33.590149 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58ac27-ac5c-435c-ba99-663a6c9c6307 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:33.605091 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949135e-b374-48ee-b3bc-fc958bac3474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:33.606464 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949135e-b374-48ee-b3bc-fc958bac3474 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:33.606464 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949135e-b374-48ee-b3bc-fc958bac3474 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:33.606464 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949135e-b374-48ee-b3bc-fc958bac3474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:33.633033 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949135e-b374-48ee-b3bc-fc958bac3474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:33.634738 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4949135e-b374-48ee-b3bc-fc958bac3474 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:33.678138 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1057/2118] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:54:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:54:34.175433 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648f2be-dd6f-439b-9293-5fbb65bb9eaf None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:34.177230 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-f648f2be-dd6f-439b-9293-5fbb65bb9eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:34.194353 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648f2be-dd6f-439b-9293-5fbb65bb9eaf None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:34.210613 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f8438-5e30-4400-9c79-9b5a32bf437e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:34.211788 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f8438-5e30-4400-9c79-9b5a32bf437e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:34.212382 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f8438-5e30-4400-9c79-9b5a32bf437e admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:34.212804 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f8438-5e30-4400-9c79-9b5a32bf437e admin admin] PATH_INFO: `/v3/projects/56aa103ab2ad44578818043ce53b85be` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:34.214661 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f8438-5e30-4400-9c79-9b5a32bf437e admin admin] RBAC: Authorizing `identity:delete_project(project_id=56aa103ab2ad44578818043ce53b85be)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:34.217488 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f8438-5e30-4400-9c79-9b5a32bf437e admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:34.326443 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-497f8438-5e30-4400-9c79-9b5a32bf437e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56aa103ab2ad44578818043ce53b85be', 'request_id': 'req-497f8438-5e30-4400-9c79-9b5a32bf437e'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:34.343669 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-497f8438-5e30-4400-9c79-9b5a32bf437e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56aa103ab2ad44578818043ce53b85be', 'request_id': 'req-497f8438-5e30-4400-9c79-9b5a32bf437e'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:34.358873 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-497f8438-5e30-4400-9c79-9b5a32bf437e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56aa103ab2ad44578818043ce53b85be', 'request_id': 'req-497f8438-5e30-4400-9c79-9b5a32bf437e'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:34.404282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-497f8438-5e30-4400-9c79-9b5a32bf437e admin admin] The token cache is being invalidate because project 56aa103ab2ad44578818043ce53b85be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:54:34.404622 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-497f8438-5e30-4400-9c79-9b5a32bf437e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:34.405710 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-497f8438-5e30-4400-9c79-9b5a32bf437e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:34.408563 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1062/2119] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:54:34 2022] DELETE /identity/v3/projects/56aa103ab2ad44578818043ce53b85be => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:54:34.414408 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949135e-b374-48ee-b3bc-fc958bac3474 service neutron] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:34.426245 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949135e-b374-48ee-b3bc-fc958bac3474 service neutron] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:34.579556 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde5ebc-8b7a-47c6-bee8-a71a09c0163d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:34.580621 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde5ebc-8b7a-47c6-bee8-a71a09c0163d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:34.581994 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde5ebc-8b7a-47c6-bee8-a71a09c0163d admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:34.582601 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde5ebc-8b7a-47c6-bee8-a71a09c0163d admin admin] PATH_INFO: `/v3/users/45b9892ee508410f8c34ad0d70c6239b` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:34.584750 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde5ebc-8b7a-47c6-bee8-a71a09c0163d admin admin] RBAC: Authorizing `identity:delete_user(user_id=45b9892ee508410f8c34ad0d70c6239b)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:34.587914 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde5ebc-8b7a-47c6-bee8-a71a09c0163d admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:34.683374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:34.686855 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-dbde5ebc-8b7a-47c6-bee8-a71a09c0163d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45b9892ee508410f8c34ad0d70c6239b'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:34.704112 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-dbde5ebc-8b7a-47c6-bee8-a71a09c0163d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45b9892ee508410f8c34ad0d70c6239b'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:34.744344 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-dbde5ebc-8b7a-47c6-bee8-a71a09c0163d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45b9892ee508410f8c34ad0d70c6239b'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:34.780902 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-dbde5ebc-8b7a-47c6-bee8-a71a09c0163d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45b9892ee508410f8c34ad0d70c6239b'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:34.781701 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-dbde5ebc-8b7a-47c6-bee8-a71a09c0163d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45b9892ee508410f8c34ad0d70c6239b'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:34.801049 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1058/2120] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:54:34 2022] DELETE /identity/v3/users/45b9892ee508410f8c34ad0d70c6239b => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:54:34.938154 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb2346-b30b-4ba0-8ca9-20d81ff53c17 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:34.938361 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb2346-b30b-4ba0-8ca9-20d81ff53c17 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:34.942019 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb2346-b30b-4ba0-8ca9-20d81ff53c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:35.019060 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-48cb2346-b30b-4ba0-8ca9-20d81ff53c17 None None] MFA Rules not processed for user `191be93273d842a5a5b9db7bdbf3e95b`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:35.022586 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-48cb2346-b30b-4ba0-8ca9-20d81ff53c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:35.084633 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:35.155675 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1063/2121] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:35.159916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde5ebc-8b7a-47c6-bee8-a71a09c0163d admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:35.161666 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-dbde5ebc-8b7a-47c6-bee8-a71a09c0163d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:35.296337 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde5ebc-8b7a-47c6-bee8-a71a09c0163d admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:35.303770 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31819de4-3e35-43d8-9117-81a13463069f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:35.304562 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31819de4-3e35-43d8-9117-81a13463069f admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:35.304801 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31819de4-3e35-43d8-9117-81a13463069f admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:35.305127 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31819de4-3e35-43d8-9117-81a13463069f admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:35.307022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31819de4-3e35-43d8-9117-81a13463069f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:35.308995 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31819de4-3e35-43d8-9117-81a13463069f admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:35.356366 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1059/2122] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:54:35 2022] POST /identity/v3/projects => generated 371 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:54:35.361632 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb2346-b30b-4ba0-8ca9-20d81ff53c17 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:35.384339 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb2346-b30b-4ba0-8ca9-20d81ff53c17 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:35.443928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31819de4-3e35-43d8-9117-81a13463069f admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:35.449550 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-31819de4-3e35-43d8-9117-81a13463069f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:35.604012 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b21a95-8fac-469f-bae5-295f371039e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:35.604941 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b21a95-8fac-469f-bae5-295f371039e5 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:35.605229 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b21a95-8fac-469f-bae5-295f371039e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:35.605500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b21a95-8fac-469f-bae5-295f371039e5 admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:35.607297 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b21a95-8fac-469f-bae5-295f371039e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:35.610834 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b21a95-8fac-469f-bae5-295f371039e5 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:35.614364 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31819de4-3e35-43d8-9117-81a13463069f admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:35.635962 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa53fa0-26ae-4459-8e61-5b830b831fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:35.637096 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa53fa0-26ae-4459-8e61-5b830b831fc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:35.637456 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa53fa0-26ae-4459-8e61-5b830b831fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:35.637921 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa53fa0-26ae-4459-8e61-5b830b831fc5 admin admin] PATH_INFO: `/v3/projects/86df722915df4e1493f78cd5aa70dcc5` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:35.641288 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa53fa0-26ae-4459-8e61-5b830b831fc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86df722915df4e1493f78cd5aa70dcc5)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:35.654966 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa53fa0-26ae-4459-8e61-5b830b831fc5 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:35.666102 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1064/2123] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:54:35 2022] POST /identity/v3/users => generated 292 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:54:35.669936 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b21a95-8fac-469f-bae5-295f371039e5 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:35.682799 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b21a95-8fac-469f-bae5-295f371039e5 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:35.690762 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041089d9-96f7-4f66-a9f7-548ed202fb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:35.691466 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041089d9-96f7-4f66-a9f7-548ed202fb8f admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:35.691755 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041089d9-96f7-4f66-a9f7-548ed202fb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:35.692246 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041089d9-96f7-4f66-a9f7-548ed202fb8f admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:35.693382 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041089d9-96f7-4f66-a9f7-548ed202fb8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:35.695740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041089d9-96f7-4f66-a9f7-548ed202fb8f admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:35.725737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1065/2124] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:54:35.730024 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041089d9-96f7-4f66-a9f7-548ed202fb8f admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:35.746759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041089d9-96f7-4f66-a9f7-548ed202fb8f admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:35.759581 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8fa53fa0-26ae-4459-8e61-5b830b831fc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86df722915df4e1493f78cd5aa70dcc5', 'request_id': 'req-8fa53fa0-26ae-4459-8e61-5b830b831fc5'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:35.759581 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:35.779657 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8fa53fa0-26ae-4459-8e61-5b830b831fc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86df722915df4e1493f78cd5aa70dcc5', 'request_id': 'req-8fa53fa0-26ae-4459-8e61-5b830b831fc5'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:35.791810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8fa53fa0-26ae-4459-8e61-5b830b831fc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86df722915df4e1493f78cd5aa70dcc5', 'request_id': 'req-8fa53fa0-26ae-4459-8e61-5b830b831fc5'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:35.809572 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8fa53fa0-26ae-4459-8e61-5b830b831fc5 admin admin] The token cache is being invalidate because project 86df722915df4e1493f78cd5aa70dcc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:54:35.809572 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8fa53fa0-26ae-4459-8e61-5b830b831fc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:35.810008 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8fa53fa0-26ae-4459-8e61-5b830b831fc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:35.825217 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1060/2125] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:54:35 2022] DELETE /identity/v3/projects/86df722915df4e1493f78cd5aa70dcc5 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:54:35.832474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec43c6-e15c-4403-85eb-63c6f62ea5cd None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:35.832846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec43c6-e15c-4403-85eb-63c6f62ea5cd None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:35.833132 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec43c6-e15c-4403-85eb-63c6f62ea5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:35.872961 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-22ec43c6-e15c-4403-85eb-63c6f62ea5cd None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:35.888939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-22ec43c6-e15c-4403-85eb-63c6f62ea5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:35.899859 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bddb22-bf2d-47a6-9b47-6b63e01a5590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:35.900625 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bddb22-bf2d-47a6-9b47-6b63e01a5590 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:35.900937 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bddb22-bf2d-47a6-9b47-6b63e01a5590 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:35.901210 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bddb22-bf2d-47a6-9b47-6b63e01a5590 admin admin] PATH_INFO: `/v3/projects/a9b731b431304f3f9983b28ab23968b4/users/dcee48bc50cc4e5fb0a87a6c45d9b94b/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:35.921033 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1061/2126] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:54:35.933667 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6993dae-0e39-44c1-bada-44f6034dd1b2 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:35.933949 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6993dae-0e39-44c1-bada-44f6034dd1b2 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:35.934346 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6993dae-0e39-44c1-bada-44f6034dd1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:35.957069 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bddb22-bf2d-47a6-9b47-6b63e01a5590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9b731b431304f3f9983b28ab23968b4, user_id=dcee48bc50cc4e5fb0a87a6c45d9b94b, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:35.967294 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bddb22-bf2d-47a6-9b47-6b63e01a5590 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:35.982553 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-a6993dae-0e39-44c1-bada-44f6034dd1b2 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:35.982553 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-a6993dae-0e39-44c1-bada-44f6034dd1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:36.006545 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1066/2127] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:54:35 2022] PUT /identity/v3/projects/a9b731b431304f3f9983b28ab23968b4/users/dcee48bc50cc4e5fb0a87a6c45d9b94b/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:54:36.007075 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1062/2128] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:36.010407 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bddb22-bf2d-47a6-9b47-6b63e01a5590 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:36.011922 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6993dae-0e39-44c1-bada-44f6034dd1b2 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:36.013946 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-69bddb22-bf2d-47a6-9b47-6b63e01a5590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:36.037190 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6993dae-0e39-44c1-bada-44f6034dd1b2 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:36.095044 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:36.178486 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bddb22-bf2d-47a6-9b47-6b63e01a5590 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:36.198591 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc2e5f-5530-432a-aeb2-ee8a15ec0d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:36.199406 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc2e5f-5530-432a-aeb2-ee8a15ec0d04 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:36.199763 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc2e5f-5530-432a-aeb2-ee8a15ec0d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:36.201321 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc2e5f-5530-432a-aeb2-ee8a15ec0d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:36.202780 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc2e5f-5530-432a-aeb2-ee8a15ec0d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:36.206109 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc2e5f-5530-432a-aeb2-ee8a15ec0d04 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:36.230280 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1067/2129] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:54:36.234259 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc2e5f-5530-432a-aeb2-ee8a15ec0d04 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:36.235804 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14012d69-beb0-4dea-a497-f2a900c06b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:36.236466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14012d69-beb0-4dea-a497-f2a900c06b08 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:36.236744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14012d69-beb0-4dea-a497-f2a900c06b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:36.237076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14012d69-beb0-4dea-a497-f2a900c06b08 admin admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:36.238280 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14012d69-beb0-4dea-a497-f2a900c06b08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:54:36.238539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14012d69-beb0-4dea-a497-f2a900c06b08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:36.242534 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14012d69-beb0-4dea-a497-f2a900c06b08 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:36.245754 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc2e5f-5530-432a-aeb2-ee8a15ec0d04 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:36.251208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ec563-4506-47c9-9a12-55547893edff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:36.252190 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ec563-4506-47c9-9a12-55547893edff admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:36.252373 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ec563-4506-47c9-9a12-55547893edff admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:36.252769 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ec563-4506-47c9-9a12-55547893edff admin admin] PATH_INFO: `/v3/projects/a9b731b431304f3f9983b28ab23968b4/users/dcee48bc50cc4e5fb0a87a6c45d9b94b/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:36.255430 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ec563-4506-47c9-9a12-55547893edff admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9b731b431304f3f9983b28ab23968b4, user_id=dcee48bc50cc4e5fb0a87a6c45d9b94b, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:36.259370 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ec563-4506-47c9-9a12-55547893edff admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:36.287764 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1063/2130] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:54:36.291588 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14012d69-beb0-4dea-a497-f2a900c06b08 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:36.293237 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1068/2131] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:54:36 2022] PUT /identity/v3/projects/a9b731b431304f3f9983b28ab23968b4/users/dcee48bc50cc4e5fb0a87a6c45d9b94b/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:54:36.339795 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14012d69-beb0-4dea-a497-f2a900c06b08 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:36.429493 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d519456-7fb9-43d3-952c-80dff1fe4853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:36.430191 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d519456-7fb9-43d3-952c-80dff1fe4853 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:36.430745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d519456-7fb9-43d3-952c-80dff1fe4853 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:36.430860 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d519456-7fb9-43d3-952c-80dff1fe4853 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:36.431470 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d519456-7fb9-43d3-952c-80dff1fe4853 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:36.439990 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d519456-7fb9-43d3-952c-80dff1fe4853 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:36.516566 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ec563-4506-47c9-9a12-55547893edff admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:36.528099 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1064/2132] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:54:36 2022] POST /identity/v3/projects => generated 365 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:54:36.536942 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ec563-4506-47c9-9a12-55547893edff admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:36.654539 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413624bd-4ee8-4e98-aa13-8a6a06eecf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:36.655494 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413624bd-4ee8-4e98-aa13-8a6a06eecf69 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:36.656240 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413624bd-4ee8-4e98-aa13-8a6a06eecf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:36.656586 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413624bd-4ee8-4e98-aa13-8a6a06eecf69 admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:36.657615 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413624bd-4ee8-4e98-aa13-8a6a06eecf69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:36.668209 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413624bd-4ee8-4e98-aa13-8a6a06eecf69 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:36.710277 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1069/2133] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:54:36 2022] POST /identity/v3/users => generated 283 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:54:36.714328 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d519456-7fb9-43d3-952c-80dff1fe4853 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:36.731067 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d519456-7fb9-43d3-952c-80dff1fe4853 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:36.736706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107ba94-3294-4353-9a21-18f14cb15e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:36.737350 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107ba94-3294-4353-9a21-18f14cb15e92 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:36.737717 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107ba94-3294-4353-9a21-18f14cb15e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:36.738445 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107ba94-3294-4353-9a21-18f14cb15e92 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:36.739442 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107ba94-3294-4353-9a21-18f14cb15e92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:36.741426 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1107ba94-3294-4353-9a21-18f14cb15e92 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:36.753551 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1065/2134] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:54:36.759488 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413624bd-4ee8-4e98-aa13-8a6a06eecf69 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:36.776825 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413624bd-4ee8-4e98-aa13-8a6a06eecf69 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:36.783492 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b174e-fc2e-4150-a48f-23cd5701a1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:36.784160 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b174e-fc2e-4150-a48f-23cd5701a1a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:36.784440 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b174e-fc2e-4150-a48f-23cd5701a1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:36.784712 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b174e-fc2e-4150-a48f-23cd5701a1a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:36.785414 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b174e-fc2e-4150-a48f-23cd5701a1a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:36.787225 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b174e-fc2e-4150-a48f-23cd5701a1a5 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:36.803448 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1070/2135] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:54:36.804787 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107ba94-3294-4353-9a21-18f14cb15e92 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:36.827455 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107ba94-3294-4353-9a21-18f14cb15e92 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:36.835668 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8822ea1-9b8d-4ddc-bb10-a7abdef71b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:36.837325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8822ea1-9b8d-4ddc-bb10-a7abdef71b1c admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:36.837795 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8822ea1-9b8d-4ddc-bb10-a7abdef71b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:36.838375 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8822ea1-9b8d-4ddc-bb10-a7abdef71b1c admin admin] PATH_INFO: `/v3/projects/2943ef4bb947492394cf9670ae6f1337/users/8ee037fbf7b34fce8be2b7ee8fb5dd02/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:36.859527 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8822ea1-9b8d-4ddc-bb10-a7abdef71b1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2943ef4bb947492394cf9670ae6f1337, user_id=8ee037fbf7b34fce8be2b7ee8fb5dd02, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:36.863774 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8822ea1-9b8d-4ddc-bb10-a7abdef71b1c admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:36.900909 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1066/2136] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:54:36 2022] PUT /identity/v3/projects/2943ef4bb947492394cf9670ae6f1337/users/8ee037fbf7b34fce8be2b7ee8fb5dd02/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:54:36.912972 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcc130-9fbc-47c0-8e3a-8322b1cd6e74 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:36.913795 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcc130-9fbc-47c0-8e3a-8322b1cd6e74 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:36.914465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcc130-9fbc-47c0-8e3a-8322b1cd6e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:36.959348 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-c4fcc130-9fbc-47c0-8e3a-8322b1cd6e74 None None] MFA Rules not processed for user `8ee037fbf7b34fce8be2b7ee8fb5dd02`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:36.961278 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-c4fcc130-9fbc-47c0-8e3a-8322b1cd6e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:37.102556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1071/2137] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:54:37.103735 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8822ea1-9b8d-4ddc-bb10-a7abdef71b1c admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:37.122601 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:37.190021 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f62475-8822-468f-82b0-0aa7aa1fe27b None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:37.190626 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f62475-8822-468f-82b0-0aa7aa1fe27b None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:37.191081 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f62475-8822-468f-82b0-0aa7aa1fe27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:37.202105 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8822ea1-9b8d-4ddc-bb10-a7abdef71b1c admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:37.215880 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c70c34-3239-469a-8a9a-4810681af3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:37.218168 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c70c34-3239-469a-8a9a-4810681af3cf admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:37.218583 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c70c34-3239-469a-8a9a-4810681af3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:37.219529 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c70c34-3239-469a-8a9a-4810681af3cf admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:37.220446 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c70c34-3239-469a-8a9a-4810681af3cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:37.225655 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c70c34-3239-469a-8a9a-4810681af3cf admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:37.237654 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-27f62475-8822-468f-82b0-0aa7aa1fe27b None None] MFA Rules not processed for user `c3274391c65b4eeab0fcf22ca4f8b791`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:37.243856 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-27f62475-8822-468f-82b0-0aa7aa1fe27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:37.301746 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1067/2138] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:54:37 2022] POST /identity/v3/projects => generated 365 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:54:37.305292 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c70c34-3239-469a-8a9a-4810681af3cf admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:37.339222 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:37.438734 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1072/2139] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:37.441750 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c70c34-3239-469a-8a9a-4810681af3cf admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:37.449750 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b00de-e90d-4bbc-b161-847f40aee3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:37.450792 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b00de-e90d-4bbc-b161-847f40aee3bc admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:37.455374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b00de-e90d-4bbc-b161-847f40aee3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:37.455738 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753b00de-e90d-4bbc-b161-847f40aee3bc admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:37.457205 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b00de-e90d-4bbc-b161-847f40aee3bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:37.459421 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753b00de-e90d-4bbc-b161-847f40aee3bc admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:37.500055 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1068/2140] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:54:37 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:54:37.504019 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f62475-8822-468f-82b0-0aa7aa1fe27b None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:37.527358 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f62475-8822-468f-82b0-0aa7aa1fe27b None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:37.543588 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d156b-4ae5-4564-a850-5c09ecee3683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:37.544244 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d156b-4ae5-4564-a850-5c09ecee3683 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:37.544528 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d156b-4ae5-4564-a850-5c09ecee3683 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:37.545405 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d156b-4ae5-4564-a850-5c09ecee3683 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:37.546605 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d156b-4ae5-4564-a850-5c09ecee3683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:37.549337 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d156b-4ae5-4564-a850-5c09ecee3683 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:37.600982 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1073/2141] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:54:37.605596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b00de-e90d-4bbc-b161-847f40aee3bc admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:37.625208 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753b00de-e90d-4bbc-b161-847f40aee3bc admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:37.656362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89eeee1-28f8-4036-92ce-8933a9825f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:37.664367 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89eeee1-28f8-4036-92ce-8933a9825f13 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:37.665651 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89eeee1-28f8-4036-92ce-8933a9825f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:37.666064 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89eeee1-28f8-4036-92ce-8933a9825f13 admin admin] PATH_INFO: `/v3/projects/f7f79dea9eae482b804248a8d0752018/users/473685770b1e454cb988c7165db35deb/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:37.706207 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89eeee1-28f8-4036-92ce-8933a9825f13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7f79dea9eae482b804248a8d0752018, user_id=473685770b1e454cb988c7165db35deb, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:37.709810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89eeee1-28f8-4036-92ce-8933a9825f13 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:37.728332 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1069/2142] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:54:37 2022] PUT /identity/v3/projects/f7f79dea9eae482b804248a8d0752018/users/473685770b1e454cb988c7165db35deb/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:54:37.734345 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d156b-4ae5-4564-a850-5c09ecee3683 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:37.753598 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d156b-4ae5-4564-a850-5c09ecee3683 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:37.948144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2e20e-3185-4336-b157-a20b9d514a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:37.950030 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2e20e-3185-4336-b157-a20b9d514a05 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:37.950472 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2e20e-3185-4336-b157-a20b9d514a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:37.951819 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2e20e-3185-4336-b157-a20b9d514a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:37.955185 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e2e20e-3185-4336-b157-a20b9d514a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:37.960943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e2e20e-3185-4336-b157-a20b9d514a05 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:37.988742 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89eeee1-28f8-4036-92ce-8933a9825f13 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:37.993036 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1074/2143] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:54:38.000462 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89eeee1-28f8-4036-92ce-8933a9825f13 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:38.006260 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0933ed-aae2-438c-a7cf-59833caf110b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:38.006881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0933ed-aae2-438c-a7cf-59833caf110b admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:38.007158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0933ed-aae2-438c-a7cf-59833caf110b admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:38.007431 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0933ed-aae2-438c-a7cf-59833caf110b admin admin] PATH_INFO: `/v3/projects/f7f79dea9eae482b804248a8d0752018/users/473685770b1e454cb988c7165db35deb/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:38.009431 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0933ed-aae2-438c-a7cf-59833caf110b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7f79dea9eae482b804248a8d0752018, user_id=473685770b1e454cb988c7165db35deb, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:38.012125 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0933ed-aae2-438c-a7cf-59833caf110b admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:38.035728 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1070/2144] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:54:37 2022] PUT /identity/v3/projects/f7f79dea9eae482b804248a8d0752018/users/473685770b1e454cb988c7165db35deb/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:54:38.040515 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c94ea-c5e0-4620-bb6e-76d35c6b647e None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:38.041217 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c94ea-c5e0-4620-bb6e-76d35c6b647e None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:38.041637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c94ea-c5e0-4620-bb6e-76d35c6b647e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:38.124002 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-729c94ea-c5e0-4620-bb6e-76d35c6b647e None None] MFA Rules not processed for user `473685770b1e454cb988c7165db35deb`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:38.125601 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-729c94ea-c5e0-4620-bb6e-76d35c6b647e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:38.221504 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1075/2145] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:38 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:38.234062 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0933ed-aae2-438c-a7cf-59833caf110b admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:38.236218 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-9a0933ed-aae2-438c-a7cf-59833caf110b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:38.342223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:38.354138 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0933ed-aae2-438c-a7cf-59833caf110b admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:38.368114 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7d4c3-f813-4045-b3cc-4549a4324e9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:38.368783 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7d4c3-f813-4045-b3cc-4549a4324e9f service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:38.369061 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7d4c3-f813-4045-b3cc-4549a4324e9f service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:38.369333 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7d4c3-f813-4045-b3cc-4549a4324e9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:38.390709 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7d4c3-f813-4045-b3cc-4549a4324e9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:38.393294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7d4c3-f813-4045-b3cc-4549a4324e9f service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:38.411219 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1071/2146] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:54:38 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:54:38.591283 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c94ea-c5e0-4620-bb6e-76d35c6b647e None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:38.603369 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c94ea-c5e0-4620-bb6e-76d35c6b647e None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:38.617104 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe393c-ebee-44d6-a6ca-51ca646bda73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:38.617929 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe393c-ebee-44d6-a6ca-51ca646bda73 service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:38.618325 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe393c-ebee-44d6-a6ca-51ca646bda73 service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:38.618489 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe393c-ebee-44d6-a6ca-51ca646bda73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:38.703517 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:38.724193 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe393c-ebee-44d6-a6ca-51ca646bda73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:38.728021 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe393c-ebee-44d6-a6ca-51ca646bda73 service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:38.740921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1076/2147] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:54:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:54:44.552652 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fde95-50a0-456f-822b-b7ea0d9d0b9f None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:44.553200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fde95-50a0-456f-822b-b7ea0d9d0b9f None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:44.553200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1fde95-50a0-456f-822b-b7ea0d9d0b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:44.587498 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-aa1fde95-50a0-456f-822b-b7ea0d9d0b9f None None] MFA Rules not processed for user `dcee48bc50cc4e5fb0a87a6c45d9b94b`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:44.588836 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-aa1fde95-50a0-456f-822b-b7ea0d9d0b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:44.688421 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1072/2148] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:44 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:44.706692 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe393c-ebee-44d6-a6ca-51ca646bda73 service cinder] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:44.709202 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-6ebe393c-ebee-44d6-a6ca-51ca646bda73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:44.827787 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe393c-ebee-44d6-a6ca-51ca646bda73 service cinder] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:44.841398 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5fc8f-dbdd-4178-9d1c-c7126889c982 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:44.842455 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5fc8f-dbdd-4178-9d1c-c7126889c982 service nova] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:44.843083 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5fc8f-dbdd-4178-9d1c-c7126889c982 service nova] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:44.843590 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5fc8f-dbdd-4178-9d1c-c7126889c982 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:44.845847 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-a7b5fc8f-dbdd-4178-9d1c-c7126889c982 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:44.946993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5fc8f-dbdd-4178-9d1c-c7126889c982 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:44.948678 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5fc8f-dbdd-4178-9d1c-c7126889c982 service nova] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:44.961165 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1077/2149] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:54:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:54:44.995643 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fde95-50a0-456f-822b-b7ea0d9d0b9f None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:45.099793 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1fde95-50a0-456f-822b-b7ea0d9d0b9f None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:45.107417 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cf6ce-0aa8-4f1d-9e67-e457c658f087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:45.108285 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cf6ce-0aa8-4f1d-9e67-e457c658f087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:45.108832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cf6ce-0aa8-4f1d-9e67-e457c658f087 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:45.109234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cf6ce-0aa8-4f1d-9e67-e457c658f087 admin admin] PATH_INFO: `/v3/users/8ee037fbf7b34fce8be2b7ee8fb5dd02` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:45.111375 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752cf6ce-0aa8-4f1d-9e67-e457c658f087 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ee037fbf7b34fce8be2b7ee8fb5dd02)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:45.114993 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752cf6ce-0aa8-4f1d-9e67-e457c658f087 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:45.192587 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-752cf6ce-0aa8-4f1d-9e67-e457c658f087 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ee037fbf7b34fce8be2b7ee8fb5dd02'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:45.205760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-752cf6ce-0aa8-4f1d-9e67-e457c658f087 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ee037fbf7b34fce8be2b7ee8fb5dd02'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:45.228184 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-752cf6ce-0aa8-4f1d-9e67-e457c658f087 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ee037fbf7b34fce8be2b7ee8fb5dd02'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:45.236622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:45.241428 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-752cf6ce-0aa8-4f1d-9e67-e457c658f087 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ee037fbf7b34fce8be2b7ee8fb5dd02'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:45.243839 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-752cf6ce-0aa8-4f1d-9e67-e457c658f087 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ee037fbf7b34fce8be2b7ee8fb5dd02'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:45.261049 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1073/2150] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:54:44 2022] DELETE /identity/v3/users/8ee037fbf7b34fce8be2b7ee8fb5dd02 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:54:45.265728 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705e331-f9a6-496d-8c3c-b673b325ef31 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:45.266123 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705e331-f9a6-496d-8c3c-b673b325ef31 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:45.266410 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705e331-f9a6-496d-8c3c-b673b325ef31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:45.312758 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-4705e331-f9a6-496d-8c3c-b673b325ef31 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:45.315646 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-4705e331-f9a6-496d-8c3c-b673b325ef31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:45.427728 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1078/2151] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:45.447050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cf6ce-0aa8-4f1d-9e67-e457c658f087 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:45.449092 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-752cf6ce-0aa8-4f1d-9e67-e457c658f087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:45.538315 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cf6ce-0aa8-4f1d-9e67-e457c658f087 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:45.542354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb29d7-242c-48bd-b291-ee18186827a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:45.543082 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb29d7-242c-48bd-b291-ee18186827a9 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:45.543424 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb29d7-242c-48bd-b291-ee18186827a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:45.543785 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb29d7-242c-48bd-b291-ee18186827a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:45.555388 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb29d7-242c-48bd-b291-ee18186827a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:45.557005 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb29d7-242c-48bd-b291-ee18186827a9 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:45.571385 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1074/2152] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:54:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:54:46.386226 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705e331-f9a6-496d-8c3c-b673b325ef31 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:46.391500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-4705e331-f9a6-496d-8c3c-b673b325ef31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:46.411525 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705e331-f9a6-496d-8c3c-b673b325ef31 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:46.428768 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86849d94-a0cd-4ec1-967a-0ce807518aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:46.429705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86849d94-a0cd-4ec1-967a-0ce807518aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:46.430091 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86849d94-a0cd-4ec1-967a-0ce807518aee admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:46.430446 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86849d94-a0cd-4ec1-967a-0ce807518aee admin admin] PATH_INFO: `/v3/projects/2943ef4bb947492394cf9670ae6f1337` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:46.432509 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86849d94-a0cd-4ec1-967a-0ce807518aee admin admin] RBAC: Authorizing `identity:delete_project(project_id=2943ef4bb947492394cf9670ae6f1337)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:46.436689 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86849d94-a0cd-4ec1-967a-0ce807518aee admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:46.484065 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:46.559137 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-86849d94-a0cd-4ec1-967a-0ce807518aee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2943ef4bb947492394cf9670ae6f1337', 'request_id': 'req-86849d94-a0cd-4ec1-967a-0ce807518aee'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:46.572084 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-86849d94-a0cd-4ec1-967a-0ce807518aee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2943ef4bb947492394cf9670ae6f1337', 'request_id': 'req-86849d94-a0cd-4ec1-967a-0ce807518aee'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:46.580506 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-86849d94-a0cd-4ec1-967a-0ce807518aee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2943ef4bb947492394cf9670ae6f1337', 'request_id': 'req-86849d94-a0cd-4ec1-967a-0ce807518aee'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:46.604153 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-86849d94-a0cd-4ec1-967a-0ce807518aee admin admin] The token cache is being invalidate because project 2943ef4bb947492394cf9670ae6f1337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:54:46.607261 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-86849d94-a0cd-4ec1-967a-0ce807518aee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:46.610150 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-86849d94-a0cd-4ec1-967a-0ce807518aee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:46.615807 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1079/2153] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:54:46 2022] DELETE /identity/v3/projects/2943ef4bb947492394cf9670ae6f1337 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:54:46.619577 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb29d7-242c-48bd-b291-ee18186827a9 service neutron] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:46.636396 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb29d7-242c-48bd-b291-ee18186827a9 service neutron] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:46.722938 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8ae60-d19b-4931-a294-0c624074cc90 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:46.723306 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8ae60-d19b-4931-a294-0c624074cc90 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:46.723649 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8ae60-d19b-4931-a294-0c624074cc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:46.763469 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-66c8ae60-d19b-4931-a294-0c624074cc90 None None] MFA Rules not processed for user `191be93273d842a5a5b9db7bdbf3e95b`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:46.764857 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-66c8ae60-d19b-4931-a294-0c624074cc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:46.791486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f49eca-34e6-4a7c-9092-3cbd9c2eef95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:46.792254 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f49eca-34e6-4a7c-9092-3cbd9c2eef95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:46.792620 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f49eca-34e6-4a7c-9092-3cbd9c2eef95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:46.793000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f49eca-34e6-4a7c-9092-3cbd9c2eef95 admin admin] PATH_INFO: `/v3/users/473685770b1e454cb988c7165db35deb` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:46.795661 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f49eca-34e6-4a7c-9092-3cbd9c2eef95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=473685770b1e454cb988c7165db35deb)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:46.797763 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f49eca-34e6-4a7c-9092-3cbd9c2eef95 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:46.907121 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1080/2154] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:46.930932 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-11f49eca-34e6-4a7c-9092-3cbd9c2eef95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '473685770b1e454cb988c7165db35deb'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:46.947786 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-11f49eca-34e6-4a7c-9092-3cbd9c2eef95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '473685770b1e454cb988c7165db35deb'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:46.973210 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-11f49eca-34e6-4a7c-9092-3cbd9c2eef95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '473685770b1e454cb988c7165db35deb'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:46.990260 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-11f49eca-34e6-4a7c-9092-3cbd9c2eef95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '473685770b1e454cb988c7165db35deb'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:46.994425 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-11f49eca-34e6-4a7c-9092-3cbd9c2eef95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '473685770b1e454cb988c7165db35deb'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:47.005460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1075/2155] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:54:46 2022] DELETE /identity/v3/users/473685770b1e454cb988c7165db35deb => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:54:48.186514 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8ae60-d19b-4931-a294-0c624074cc90 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:48.189695 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-66c8ae60-d19b-4931-a294-0c624074cc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:48.224566 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8ae60-d19b-4931-a294-0c624074cc90 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:48.370667 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c3c846-0a98-47ed-b47a-5058c75a4b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:48.371355 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3c846-0a98-47ed-b47a-5058c75a4b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:48.371634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3c846-0a98-47ed-b47a-5058c75a4b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:48.371908 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c3c846-0a98-47ed-b47a-5058c75a4b5f admin admin] PATH_INFO: `/v3/projects/f7f79dea9eae482b804248a8d0752018` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:48.373229 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c3c846-0a98-47ed-b47a-5058c75a4b5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7f79dea9eae482b804248a8d0752018)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:48.376876 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c3c846-0a98-47ed-b47a-5058c75a4b5f admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:48.498903 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-84c3c846-0a98-47ed-b47a-5058c75a4b5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7f79dea9eae482b804248a8d0752018', 'request_id': 'req-84c3c846-0a98-47ed-b47a-5058c75a4b5f'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:48.507023 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:48.530223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-84c3c846-0a98-47ed-b47a-5058c75a4b5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7f79dea9eae482b804248a8d0752018', 'request_id': 'req-84c3c846-0a98-47ed-b47a-5058c75a4b5f'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:48.543699 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-84c3c846-0a98-47ed-b47a-5058c75a4b5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7f79dea9eae482b804248a8d0752018', 'request_id': 'req-84c3c846-0a98-47ed-b47a-5058c75a4b5f'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:48.571473 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-84c3c846-0a98-47ed-b47a-5058c75a4b5f admin admin] The token cache is being invalidate because project f7f79dea9eae482b804248a8d0752018 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:54:48.571789 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-84c3c846-0a98-47ed-b47a-5058c75a4b5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:48.574447 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-84c3c846-0a98-47ed-b47a-5058c75a4b5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:54:48.576531 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1081/2156] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:54:48 2022] DELETE /identity/v3/projects/f7f79dea9eae482b804248a8d0752018 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:54:48.583672 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c870d1-06f0-4a24-b8f1-b9dcf35842aa None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:48.584703 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c870d1-06f0-4a24-b8f1-b9dcf35842aa None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:48.585125 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c870d1-06f0-4a24-b8f1-b9dcf35842aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:48.624333 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-f2c870d1-06f0-4a24-b8f1-b9dcf35842aa None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:48.626758 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-f2c870d1-06f0-4a24-b8f1-b9dcf35842aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:48.657520 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:48.796138 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1076/2157] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:48.804592 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736ecb1-dede-4708-90e8-2f9d1c0234f7 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:48.804966 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736ecb1-dede-4708-90e8-2f9d1c0234f7 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:48.805169 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736ecb1-dede-4708-90e8-2f9d1c0234f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:48.868207 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-c736ecb1-dede-4708-90e8-2f9d1c0234f7 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:48.870495 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-c736ecb1-dede-4708-90e8-2f9d1c0234f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:48.897365 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1082/2158] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:48.903080 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c870d1-06f0-4a24-b8f1-b9dcf35842aa None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:48.974866 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c870d1-06f0-4a24-b8f1-b9dcf35842aa None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:48.974866 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f05cf8-8676-46fa-b5ff-89b54ec47ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:48.974866 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f05cf8-8676-46fa-b5ff-89b54ec47ddb admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:48.974866 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f05cf8-8676-46fa-b5ff-89b54ec47ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:48.975313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f05cf8-8676-46fa-b5ff-89b54ec47ddb admin admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:48.995607 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f05cf8-8676-46fa-b5ff-89b54ec47ddb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:54:48.996215 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f05cf8-8676-46fa-b5ff-89b54ec47ddb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:48.998886 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f05cf8-8676-46fa-b5ff-89b54ec47ddb admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:49.032765 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1077/2159] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:54:49.034497 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736ecb1-dede-4708-90e8-2f9d1c0234f7 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:49.048407 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736ecb1-dede-4708-90e8-2f9d1c0234f7 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:49.061964 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5fa0c-129d-4556-80c8-f48b245a7cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:49.064133 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5fa0c-129d-4556-80c8-f48b245a7cde admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:49.064339 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5fa0c-129d-4556-80c8-f48b245a7cde admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:49.064601 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5fa0c-129d-4556-80c8-f48b245a7cde admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:49.065297 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5fa0c-129d-4556-80c8-f48b245a7cde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:49.072846 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5fa0c-129d-4556-80c8-f48b245a7cde admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:49.126484 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f05cf8-8676-46fa-b5ff-89b54ec47ddb admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:49.130868 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1083/2160] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:54:49 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:54:49.137592 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f05cf8-8676-46fa-b5ff-89b54ec47ddb admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:49.237104 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980fae4-5d87-43eb-bd89-6ad89f5b959d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:49.239223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980fae4-5d87-43eb-bd89-6ad89f5b959d admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:49.239367 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980fae4-5d87-43eb-bd89-6ad89f5b959d admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:49.239645 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980fae4-5d87-43eb-bd89-6ad89f5b959d admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:49.243550 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980fae4-5d87-43eb-bd89-6ad89f5b959d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:49.246362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980fae4-5d87-43eb-bd89-6ad89f5b959d admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:49.291797 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1078/2161] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:54:49 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:54:49.295760 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5fa0c-129d-4556-80c8-f48b245a7cde admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:49.310799 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5fa0c-129d-4556-80c8-f48b245a7cde admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:49.321032 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fa27b-a806-4b7a-84f8-c021fc2c38b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:49.323612 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fa27b-a806-4b7a-84f8-c021fc2c38b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:49.324397 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fa27b-a806-4b7a-84f8-c021fc2c38b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:49.325125 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fa27b-a806-4b7a-84f8-c021fc2c38b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:49.326084 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0fa27b-a806-4b7a-84f8-c021fc2c38b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:49.327795 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0fa27b-a806-4b7a-84f8-c021fc2c38b6 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:49.345272 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1084/2162] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:54:49.348886 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4125f4-e89b-4116-9936-de96c323ec40 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:49.349409 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4125f4-e89b-4116-9936-de96c323ec40 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:49.349561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fa27b-a806-4b7a-84f8-c021fc2c38b6 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:49.350126 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4125f4-e89b-4116-9936-de96c323ec40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:49.371164 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fa27b-a806-4b7a-84f8-c021fc2c38b6 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:49.377173 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a89f3-f485-4104-9332-aadd1ad4a28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:49.378014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a89f3-f485-4104-9332-aadd1ad4a28c admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:49.378398 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a89f3-f485-4104-9332-aadd1ad4a28c admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:49.378840 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a89f3-f485-4104-9332-aadd1ad4a28c admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:49.379615 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a89f3-f485-4104-9332-aadd1ad4a28c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:49.381360 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-7d4125f4-e89b-4116-9936-de96c323ec40 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:49.381950 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a89f3-f485-4104-9332-aadd1ad4a28c admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:49.385596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-7d4125f4-e89b-4116-9936-de96c323ec40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:49.400248 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1085/2163] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:54:49.402388 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1079/2164] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Jul 26 04:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:54:49.405836 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a89f3-f485-4104-9332-aadd1ad4a28c admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:49.420312 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a89f3-f485-4104-9332-aadd1ad4a28c admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:49.426457 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b256e-c0f2-4d2e-a825-ef7f6c41a27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:49.427712 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b256e-c0f2-4d2e-a825-ef7f6c41a27b admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:49.428171 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b256e-c0f2-4d2e-a825-ef7f6c41a27b admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:49.429509 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b256e-c0f2-4d2e-a825-ef7f6c41a27b admin admin] PATH_INFO: `/v3/projects/b35235e4f1c044f2ba2f07fd1afa2c29/users/5c50c1b90c7e44c4be4bce2fb1e81ccc/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:49.431535 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4125f4-e89b-4116-9936-de96c323ec40 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:49.433027 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-7d4125f4-e89b-4116-9936-de96c323ec40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:49.447146 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b256e-c0f2-4d2e-a825-ef7f6c41a27b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b35235e4f1c044f2ba2f07fd1afa2c29, user_id=5c50c1b90c7e44c4be4bce2fb1e81ccc, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:49.449838 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b256e-c0f2-4d2e-a825-ef7f6c41a27b admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:49.469230 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1086/2165] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:54:49 2022] PUT /identity/v3/projects/b35235e4f1c044f2ba2f07fd1afa2c29/users/5c50c1b90c7e44c4be4bce2fb1e81ccc/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:54:49.475338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4737b5a-465b-4c78-af86-03f2e900e43e None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:49.475908 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4737b5a-465b-4c78-af86-03f2e900e43e None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:49.476471 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4737b5a-465b-4c78-af86-03f2e900e43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:49.518324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-e4737b5a-465b-4c78-af86-03f2e900e43e None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:49.521464 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-e4737b5a-465b-4c78-af86-03f2e900e43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:49.536652 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4125f4-e89b-4116-9936-de96c323ec40 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:49.569621 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:49.622496 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8a8c6-a55b-42e9-a502-b97ef35ca41e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:49.623253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8a8c6-a55b-42e9-a502-b97ef35ca41e service nova] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:49.623430 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8a8c6-a55b-42e9-a502-b97ef35ca41e service nova] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:49.623706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8a8c6-a55b-42e9-a502-b97ef35ca41e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:49.631074 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1087/2166] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:54:49.637944 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4737b5a-465b-4c78-af86-03f2e900e43e None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:49.642954 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-e4737b5a-465b-4c78-af86-03f2e900e43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:49.644310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a8a8c6-a55b-42e9-a502-b97ef35ca41e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:49.647370 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a8a8c6-a55b-42e9-a502-b97ef35ca41e service nova] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:49.658199 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1080/2167] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:54:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:54:49.706953 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4737b5a-465b-4c78-af86-03f2e900e43e None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:49.711294 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53487550-6741-4536-acbe-f15f1f39644f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:49.711930 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53487550-6741-4536-acbe-f15f1f39644f service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:49.712207 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53487550-6741-4536-acbe-f15f1f39644f service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:49.712473 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53487550-6741-4536-acbe-f15f1f39644f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:49.724483 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53487550-6741-4536-acbe-f15f1f39644f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:49.726027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53487550-6741-4536-acbe-f15f1f39644f service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:49.741800 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1088/2168] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:54:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:54:50.520330 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ec605-7f3e-4302-b1e8-e473fe56410c None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:50.520672 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ec605-7f3e-4302-b1e8-e473fe56410c None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:50.520932 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ec605-7f3e-4302-b1e8-e473fe56410c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:50.550647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-984ec605-7f3e-4302-b1e8-e473fe56410c None None] MFA Rules not processed for user `5c50c1b90c7e44c4be4bce2fb1e81ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:50.551810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-984ec605-7f3e-4302-b1e8-e473fe56410c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:50.632643 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1081/2169] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:50.637226 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53487550-6741-4536-acbe-f15f1f39644f service neutron] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:50.648189 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53487550-6741-4536-acbe-f15f1f39644f service neutron] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:50.656325 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57fd66-3b24-426c-a267-894060b215b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:50.657136 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57fd66-3b24-426c-a267-894060b215b3 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:50.658287 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57fd66-3b24-426c-a267-894060b215b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:50.658620 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57fd66-3b24-426c-a267-894060b215b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:50.659356 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57fd66-3b24-426c-a267-894060b215b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:50.661376 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57fd66-3b24-426c-a267-894060b215b3 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:50.666517 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:50.700066 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1089/2170] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:54:50 2022] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:54:50.701527 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ec605-7f3e-4302-b1e8-e473fe56410c None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:50.713354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ec605-7f3e-4302-b1e8-e473fe56410c None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:50.784752 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ee90f-a27e-4c94-a907-85dc28ddaa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:50.785621 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ee90f-a27e-4c94-a907-85dc28ddaa2b admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:50.785902 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ee90f-a27e-4c94-a907-85dc28ddaa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:50.786241 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513ee90f-a27e-4c94-a907-85dc28ddaa2b admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:50.786963 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ee90f-a27e-4c94-a907-85dc28ddaa2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:50.788952 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513ee90f-a27e-4c94-a907-85dc28ddaa2b admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:50.813534 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1082/2171] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:54:50 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:54:50.817815 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57fd66-3b24-426c-a267-894060b215b3 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:50.828825 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57fd66-3b24-426c-a267-894060b215b3 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:50.834502 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750eee36-0ae2-4302-ac9c-9e133f21cc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:50.835145 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750eee36-0ae2-4302-ac9c-9e133f21cc79 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:50.835423 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750eee36-0ae2-4302-ac9c-9e133f21cc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:50.835698 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750eee36-0ae2-4302-ac9c-9e133f21cc79 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:50.836404 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750eee36-0ae2-4302-ac9c-9e133f21cc79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:50.838067 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750eee36-0ae2-4302-ac9c-9e133f21cc79 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:50.848853 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1090/2172] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:54:50.853385 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ee90f-a27e-4c94-a907-85dc28ddaa2b admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:50.865034 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513ee90f-a27e-4c94-a907-85dc28ddaa2b admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:50.870467 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328c31c-f058-45a5-bd17-e2b535b55edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:50.871208 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328c31c-f058-45a5-bd17-e2b535b55edc admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:50.871486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328c31c-f058-45a5-bd17-e2b535b55edc admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:50.871761 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328c31c-f058-45a5-bd17-e2b535b55edc admin admin] PATH_INFO: `/v3/projects/fa34b3bff27140a0ac5b179a86c5b28a/users/6eb0611780a54582a814d0945c48326f/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:50.890292 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328c31c-f058-45a5-bd17-e2b535b55edc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa34b3bff27140a0ac5b179a86c5b28a, user_id=6eb0611780a54582a814d0945c48326f, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:50.893173 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328c31c-f058-45a5-bd17-e2b535b55edc admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:50.913764 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1083/2173] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:54:50 2022] PUT /identity/v3/projects/fa34b3bff27140a0ac5b179a86c5b28a/users/6eb0611780a54582a814d0945c48326f/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:54:50.914779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750eee36-0ae2-4302-ac9c-9e133f21cc79 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:50.926508 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750eee36-0ae2-4302-ac9c-9e133f21cc79 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:51.017149 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1b3dd-af4f-4f67-a420-a1fd504a2ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:51.017794 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1b3dd-af4f-4f67-a420-a1fd504a2ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:51.018109 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1b3dd-af4f-4f67-a420-a1fd504a2ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:51.018381 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1b3dd-af4f-4f67-a420-a1fd504a2ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:51.019095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1b3dd-af4f-4f67-a420-a1fd504a2ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:51.020789 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df1b3dd-af4f-4f67-a420-a1fd504a2ac9 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:51.040771 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1091/2174] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:54:51.042538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328c31c-f058-45a5-bd17-e2b535b55edc admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:51.050358 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:51.054994 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328c31c-f058-45a5-bd17-e2b535b55edc admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:51.062685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b723808-888b-4272-b33d-2dfd1d5bdddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:51.063467 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b723808-888b-4272-b33d-2dfd1d5bdddb admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:51.064185 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b723808-888b-4272-b33d-2dfd1d5bdddb admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:51.064535 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b723808-888b-4272-b33d-2dfd1d5bdddb admin admin] PATH_INFO: `/v3/projects/fa34b3bff27140a0ac5b179a86c5b28a/users/6eb0611780a54582a814d0945c48326f/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:51.066664 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b723808-888b-4272-b33d-2dfd1d5bdddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa34b3bff27140a0ac5b179a86c5b28a, user_id=6eb0611780a54582a814d0945c48326f, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:51.069795 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b723808-888b-4272-b33d-2dfd1d5bdddb admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:51.088818 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1084/2175] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:54:51 2022] PUT /identity/v3/projects/fa34b3bff27140a0ac5b179a86c5b28a/users/6eb0611780a54582a814d0945c48326f/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:54:51.920537 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf5b78-5e85-4515-87cb-faadd8a43256 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:51.921209 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf5b78-5e85-4515-87cb-faadd8a43256 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:51.921351 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf5b78-5e85-4515-87cb-faadd8a43256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:51.965132 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-6ecf5b78-5e85-4515-87cb-faadd8a43256 None None] MFA Rules not processed for user `6eb0611780a54582a814d0945c48326f`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:51.966900 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-6ecf5b78-5e85-4515-87cb-faadd8a43256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:52.058726 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1092/2176] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:51 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:52.069494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169383af-2641-44f3-adb0-6d79ada9e5d6 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:52.070374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169383af-2641-44f3-adb0-6d79ada9e5d6 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:52.070651 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169383af-2641-44f3-adb0-6d79ada9e5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:52.095892 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-169383af-2641-44f3-adb0-6d79ada9e5d6 None None] MFA Rules not processed for user `5c50c1b90c7e44c4be4bce2fb1e81ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:52.097448 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-169383af-2641-44f3-adb0-6d79ada9e5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:52.172086 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1085/2177] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:52.184042 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf5b78-5e85-4515-87cb-faadd8a43256 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:52.245999 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:54:52.274051 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf5b78-5e85-4515-87cb-faadd8a43256 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:52.277686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdd466-c697-48c9-ad1a-c1526ef3c2b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:52.278363 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdd466-c697-48c9-ad1a-c1526ef3c2b9 service nova] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:52.279335 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdd466-c697-48c9-ad1a-c1526ef3c2b9 service nova] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:52.279335 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdd466-c697-48c9-ad1a-c1526ef3c2b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:52.288909 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdd466-c697-48c9-ad1a-c1526ef3c2b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:52.290617 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdd466-c697-48c9-ad1a-c1526ef3c2b9 service nova] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:52.300395 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1093/2178] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:54:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:54:56.271570 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e5bf2-4e58-414f-9bf8-98970bb28cf0 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:56.272156 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e5bf2-4e58-414f-9bf8-98970bb28cf0 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:56.272576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e5bf2-4e58-414f-9bf8-98970bb28cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:56.295048 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-342e5bf2-4e58-414f-9bf8-98970bb28cf0 None None] MFA Rules not processed for user `8b912bfd686648fa9aae1dca24c78697`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:56.297045 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-342e5bf2-4e58-414f-9bf8-98970bb28cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:56.416163 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1086/2179] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:54:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:56.730593 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bff270-050d-48ca-bd3f-2beb790116f1 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:56.731180 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bff270-050d-48ca-bd3f-2beb790116f1 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:56.731388 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bff270-050d-48ca-bd3f-2beb790116f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:56.765317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-a0bff270-050d-48ca-bd3f-2beb790116f1 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:54:56.765317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-a0bff270-050d-48ca-bd3f-2beb790116f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:54:56.851502 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1094/2180] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Jul 26 04:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:54:57.008030 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e5bf2-4e58-414f-9bf8-98970bb28cf0 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:54:57.031393 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e5bf2-4e58-414f-9bf8-98970bb28cf0 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:54:57.040885 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95972e0f-2872-4a74-8854-e5d812f0c0ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:54:57.041607 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95972e0f-2872-4a74-8854-e5d812f0c0ce service nova] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:54:57.042076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95972e0f-2872-4a74-8854-e5d812f0c0ce service nova] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:54:57.042355 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95972e0f-2872-4a74-8854-e5d812f0c0ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:54:57.053529 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95972e0f-2872-4a74-8854-e5d812f0c0ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:54:57.058127 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95972e0f-2872-4a74-8854-e5d812f0c0ce service nova] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:54:57.071243 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1087/2181] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:54:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:55:01.247981 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb83c38-0a87-4db2-810c-6d6a4530209f None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:01.248428 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb83c38-0a87-4db2-810c-6d6a4530209f None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:01.248524 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb83c38-0a87-4db2-810c-6d6a4530209f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:01.273241 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-3bb83c38-0a87-4db2-810c-6d6a4530209f None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:55:01.274500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-3bb83c38-0a87-4db2-810c-6d6a4530209f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:01.284527 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1095/2182] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Jul 26 04:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:55:01.541121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95972e0f-2872-4a74-8854-e5d812f0c0ce service nova] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:01.543237 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-95972e0f-2872-4a74-8854-e5d812f0c0ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:01.559786 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95972e0f-2872-4a74-8854-e5d812f0c0ce service nova] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:01.568123 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5993888-4a68-4144-9ae6-b5dcb78e9dc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:01.568364 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5993888-4a68-4144-9ae6-b5dcb78e9dc6 service nova] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:01.568606 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5993888-4a68-4144-9ae6-b5dcb78e9dc6 service nova] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:01.568885 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5993888-4a68-4144-9ae6-b5dcb78e9dc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:01.578640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5993888-4a68-4144-9ae6-b5dcb78e9dc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:01.580243 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5993888-4a68-4144-9ae6-b5dcb78e9dc6 service nova] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:01.590398 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1088/2183] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:55:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:55:03.717678 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81dac0-4665-42d1-8b6e-b9e6b0bb4091 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:03.718159 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81dac0-4665-42d1-8b6e-b9e6b0bb4091 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:03.718262 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81dac0-4665-42d1-8b6e-b9e6b0bb4091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:03.749648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-fc81dac0-4665-42d1-8b6e-b9e6b0bb4091 None None] MFA Rules not processed for user `b613dee1148c4822af2e7847b28cf4aa`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:55:03.751372 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-fc81dac0-4665-42d1-8b6e-b9e6b0bb4091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:03.854420 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1096/2184] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Jul 26 04:55:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:55:03.915394 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5993888-4a68-4144-9ae6-b5dcb78e9dc6 service nova] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:03.918290 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-f5993888-4a68-4144-9ae6-b5dcb78e9dc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:04.080968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5993888-4a68-4144-9ae6-b5dcb78e9dc6 service nova] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:04.086917 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f611a68-2199-440d-9f75-2ed9ddd21ea8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e089e39e9de419b9e2fb1d7fc2d245a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:04.087787 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f611a68-2199-440d-9f75-2ed9ddd21ea8 service swift] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:04.088226 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f611a68-2199-440d-9f75-2ed9ddd21ea8 service swift] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:04.088642 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f611a68-2199-440d-9f75-2ed9ddd21ea8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:04.103453 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f611a68-2199-440d-9f75-2ed9ddd21ea8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:04.107445 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f611a68-2199-440d-9f75-2ed9ddd21ea8 service swift] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:04.120721 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1089/2185] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 04:55:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 04:55:05.379199 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883702b-d7a2-4541-8051-6868e5214f3c None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:05.379891 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883702b-d7a2-4541-8051-6868e5214f3c None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:05.380372 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883702b-d7a2-4541-8051-6868e5214f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:05.405723 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-6883702b-d7a2-4541-8051-6868e5214f3c None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:55:05.407351 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-6883702b-d7a2-4541-8051-6868e5214f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:05.416940 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1097/2186] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Jul 26 04:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:55:05.861948 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f611a68-2199-440d-9f75-2ed9ddd21ea8 service swift] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:05.871302 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:05.877657 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f611a68-2199-440d-9f75-2ed9ddd21ea8 service swift] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:05.885630 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9aeb3-2650-4c03-a5de-2f56d89c20ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:05.886729 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9aeb3-2650-4c03-a5de-2f56d89c20ed service nova] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:05.887262 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9aeb3-2650-4c03-a5de-2f56d89c20ed service nova] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:05.887765 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9aeb3-2650-4c03-a5de-2f56d89c20ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:05.900127 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9aeb3-2650-4c03-a5de-2f56d89c20ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:05.902281 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b9aeb3-2650-4c03-a5de-2f56d89c20ed service nova] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:05.925296 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1090/2187] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:55:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:55:09.779618 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772d661-dfe6-4676-a315-5f74a553fdff None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:09.780245 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772d661-dfe6-4676-a315-5f74a553fdff None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:09.780245 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772d661-dfe6-4676-a315-5f74a553fdff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:09.803602 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-6772d661-dfe6-4676-a315-5f74a553fdff None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:55:09.805159 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-6772d661-dfe6-4676-a315-5f74a553fdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:09.814966 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1098/2188] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Jul 26 04:55:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:55:10.020410 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9aeb3-2650-4c03-a5de-2f56d89c20ed service nova] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:10.037425 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9aeb3-2650-4c03-a5de-2f56d89c20ed service nova] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:10.048684 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71812f41-2eb7-42e6-85d1-11965ca85a6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:10.049525 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71812f41-2eb7-42e6-85d1-11965ca85a6f service nova] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:10.050133 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71812f41-2eb7-42e6-85d1-11965ca85a6f service nova] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:10.050648 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71812f41-2eb7-42e6-85d1-11965ca85a6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:10.065572 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71812f41-2eb7-42e6-85d1-11965ca85a6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:10.067603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71812f41-2eb7-42e6-85d1-11965ca85a6f service nova] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:10.079505 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1091/2189] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:55:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:55:14.132032 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9de31-a4c8-4798-980c-ed1ab13589c0 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:14.133464 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9de31-a4c8-4798-980c-ed1ab13589c0 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:14.134148 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9de31-a4c8-4798-980c-ed1ab13589c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:14.173958 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-a2c9de31-a4c8-4798-980c-ed1ab13589c0 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:55:14.175248 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-a2c9de31-a4c8-4798-980c-ed1ab13589c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:14.186961 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1099/2190] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Jul 26 04:55:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:55:14.421944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71812f41-2eb7-42e6-85d1-11965ca85a6f service nova] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:14.439048 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71812f41-2eb7-42e6-85d1-11965ca85a6f service nova] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:14.465286 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18cb43-eb47-4a3d-9d7d-8df347489eda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:14.469876 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18cb43-eb47-4a3d-9d7d-8df347489eda service nova] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:14.470589 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18cb43-eb47-4a3d-9d7d-8df347489eda service nova] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:14.471065 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18cb43-eb47-4a3d-9d7d-8df347489eda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:14.484376 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18cb43-eb47-4a3d-9d7d-8df347489eda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:14.492496 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca18cb43-eb47-4a3d-9d7d-8df347489eda service nova] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:14.533360 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1092/2191] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:55:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:55:18.020486 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9de31-a4c8-4798-980c-ed1ab13589c0 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:18.022125 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-a2c9de31-a4c8-4798-980c-ed1ab13589c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:18.082549 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9de31-a4c8-4798-980c-ed1ab13589c0 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:18.086616 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de3f93-d85e-4a3f-8bcc-f419fa0630db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:18.087261 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de3f93-d85e-4a3f-8bcc-f419fa0630db service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:18.087538 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de3f93-d85e-4a3f-8bcc-f419fa0630db service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:18.087804 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de3f93-d85e-4a3f-8bcc-f419fa0630db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:18.098184 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de3f93-d85e-4a3f-8bcc-f419fa0630db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:18.099941 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5de3f93-d85e-4a3f-8bcc-f419fa0630db service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:18.110693 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1100/2192] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:55:18 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:55:24.508311 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=16 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:28.106191 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:29.136928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818ffd5-2c7d-4371-8b97-a323653d855f None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:29.137509 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818ffd5-2c7d-4371-8b97-a323653d855f None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:29.137509 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818ffd5-2c7d-4371-8b97-a323653d855f None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:29.139352 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1093/2193] 10.222.0.39 () {54 vars in 921 bytes} [Tue Jul 26 04:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:55:29.147257 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa51a28-bfd8-44f8-b414-34a782d3799f None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:29.148280 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa51a28-bfd8-44f8-b414-34a782d3799f None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:29.148481 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa51a28-bfd8-44f8-b414-34a782d3799f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:29.174819 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-2aa51a28-bfd8-44f8-b414-34a782d3799f None None] MFA Rules not processed for user `ae8593e125da4b208dd100608aa2b462`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:55:29.176440 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-2aa51a28-bfd8-44f8-b414-34a782d3799f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:29.188780 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1101/2194] 10.222.0.39 () {58 vars in 1018 bytes} [Tue Jul 26 04:55:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:55:29.201210 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818ffd5-2c7d-4371-8b97-a323653d855f None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:29.203641 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-2818ffd5-2c7d-4371-8b97-a323653d855f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:29.270205 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818ffd5-2c7d-4371-8b97-a323653d855f None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:29.274150 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39baa2d-2358-4794-9bf8-3a3aa0ac2ae3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfbf2c03eb740ed8b72c4825cffc341', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:29.274768 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39baa2d-2358-4794-9bf8-3a3aa0ac2ae3 service glance] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:29.275046 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39baa2d-2358-4794-9bf8-3a3aa0ac2ae3 service glance] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:29.275450 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39baa2d-2358-4794-9bf8-3a3aa0ac2ae3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:29.288796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39baa2d-2358-4794-9bf8-3a3aa0ac2ae3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:29.289292 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39baa2d-2358-4794-9bf8-3a3aa0ac2ae3 service glance] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:29.304159 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1094/2195] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:55:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:55:29.417322 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59422a-59a5-469a-8db9-28c8620828ba None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:29.417671 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59422a-59a5-469a-8db9-28c8620828ba None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:29.418391 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59422a-59a5-469a-8db9-28c8620828ba None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:29.420644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1102/2196] 10.222.0.39 () {54 vars in 921 bytes} [Tue Jul 26 04:55:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:55:29.428740 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0de64-5d63-4cae-b933-b3bdaacff0ba None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:29.429624 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0de64-5d63-4cae-b933-b3bdaacff0ba None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:29.430012 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0de64-5d63-4cae-b933-b3bdaacff0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:29.453772 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-10d0de64-5d63-4cae-b933-b3bdaacff0ba None None] MFA Rules not processed for user `74fee029d5214ce18b4b9ddc2df72a23`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:55:29.455214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-10d0de64-5d63-4cae-b933-b3bdaacff0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:29.526277 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1095/2197] 10.222.0.39 () {58 vars in 1018 bytes} [Tue Jul 26 04:55:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:55:29.539609 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59422a-59a5-469a-8db9-28c8620828ba None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:29.554667 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59422a-59a5-469a-8db9-28c8620828ba None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:29.560174 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b251fe-353a-4209-a400-41298dbc1673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:29.560889 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b251fe-353a-4209-a400-41298dbc1673 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:29.561147 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b251fe-353a-4209-a400-41298dbc1673 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:29.561616 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b251fe-353a-4209-a400-41298dbc1673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:29.578531 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b251fe-353a-4209-a400-41298dbc1673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:29.580575 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b251fe-353a-4209-a400-41298dbc1673 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:29.592560 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1103/2198] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:55:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:55:29.686237 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616732f-fbf3-4c22-a0de-3ffbedcc3f45 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:29.686518 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616732f-fbf3-4c22-a0de-3ffbedcc3f45 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:29.686833 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616732f-fbf3-4c22-a0de-3ffbedcc3f45 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:29.688483 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1096/2199] 10.222.0.39 () {54 vars in 921 bytes} [Tue Jul 26 04:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:55:29.694517 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896937f-2f85-4ca3-b39b-ef18b73e3bcf None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:29.694876 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896937f-2f85-4ca3-b39b-ef18b73e3bcf None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:29.695152 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896937f-2f85-4ca3-b39b-ef18b73e3bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:29.715254 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-b896937f-2f85-4ca3-b39b-ef18b73e3bcf None None] MFA Rules not processed for user `ae8593e125da4b208dd100608aa2b462`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:55:29.716475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-b896937f-2f85-4ca3-b39b-ef18b73e3bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:29.726086 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1104/2200] 10.222.0.39 () {58 vars in 1018 bytes} [Tue Jul 26 04:55:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:55:29.739727 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616732f-fbf3-4c22-a0de-3ffbedcc3f45 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:29.741589 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-6616732f-fbf3-4c22-a0de-3ffbedcc3f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:29.761184 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616732f-fbf3-4c22-a0de-3ffbedcc3f45 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:29.766807 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1bdeb-b4bd-4eb0-a72e-b1fcc2868d4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:29.767460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1bdeb-b4bd-4eb0-a72e-b1fcc2868d4a service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:29.767737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1bdeb-b4bd-4eb0-a72e-b1fcc2868d4a service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:29.768006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1bdeb-b4bd-4eb0-a72e-b1fcc2868d4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:29.786676 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1bdeb-b4bd-4eb0-a72e-b1fcc2868d4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:29.788320 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1bdeb-b4bd-4eb0-a72e-b1fcc2868d4a service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:29.801255 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1097/2201] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:55:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:55:35.505202 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896937f-2f85-4ca3-b39b-ef18b73e3bcf None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:35.506811 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-b896937f-2f85-4ca3-b39b-ef18b73e3bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:35.605739 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896937f-2f85-4ca3-b39b-ef18b73e3bcf None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:35.611161 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1539007-39a9-458b-a38d-a0cde5e05d23 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21dfe7b4d6524ec2885224d77395b00b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:35.611816 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1539007-39a9-458b-a38d-a0cde5e05d23 service placement] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:35.612082 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1539007-39a9-458b-a38d-a0cde5e05d23 service placement] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:35.612359 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1539007-39a9-458b-a38d-a0cde5e05d23 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:35.614603 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-f1539007-39a9-458b-a38d-a0cde5e05d23 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:35.627994 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1539007-39a9-458b-a38d-a0cde5e05d23 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:35.629801 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1539007-39a9-458b-a38d-a0cde5e05d23 service placement] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:35.642418 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1105/2202] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:55:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:55:38.685346 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1bdeb-b4bd-4eb0-a72e-b1fcc2868d4a service neutron] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:38.694735 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1bdeb-b4bd-4eb0-a72e-b1fcc2868d4a service neutron] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:38.698649 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04db1e-9fab-4071-b0b6-7aaf3137d5c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:38.699263 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04db1e-9fab-4071-b0b6-7aaf3137d5c4 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:38.699537 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04db1e-9fab-4071-b0b6-7aaf3137d5c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:38.699787 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04db1e-9fab-4071-b0b6-7aaf3137d5c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:38.701695 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-7c04db1e-9fab-4071-b0b6-7aaf3137d5c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:38.769508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04db1e-9fab-4071-b0b6-7aaf3137d5c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:38.771017 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04db1e-9fab-4071-b0b6-7aaf3137d5c4 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:38.782415 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1098/2203] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:55:38 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:55:40.745908 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ba4dd-4da0-478f-a41a-648761f6cace None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:40.746504 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ba4dd-4da0-478f-a41a-648761f6cace None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:40.746504 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ba4dd-4da0-478f-a41a-648761f6cace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:40.766360 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-581ba4dd-4da0-478f-a41a-648761f6cace None None] MFA Rules not processed for user `b613dee1148c4822af2e7847b28cf4aa`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:55:40.767581 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-581ba4dd-4da0-478f-a41a-648761f6cace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:40.775498 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1106/2204] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Jul 26 04:55:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:55:40.788001 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04db1e-9fab-4071-b0b6-7aaf3137d5c4 service neutron] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:40.799620 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04db1e-9fab-4071-b0b6-7aaf3137d5c4 service neutron] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:40.805294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20219aa-2f3e-40d2-9db6-77f65ba0077e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e089e39e9de419b9e2fb1d7fc2d245a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:40.806023 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20219aa-2f3e-40d2-9db6-77f65ba0077e service swift] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:40.806312 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20219aa-2f3e-40d2-9db6-77f65ba0077e service swift] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:40.806581 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20219aa-2f3e-40d2-9db6-77f65ba0077e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:40.815825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20219aa-2f3e-40d2-9db6-77f65ba0077e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:40.817446 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20219aa-2f3e-40d2-9db6-77f65ba0077e service swift] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:40.826471 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1099/2205] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 04:55:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 04:55:43.717927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4651f5a-cda2-4eb5-988a-0df0a11c0226 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:43.719080 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4651f5a-cda2-4eb5-988a-0df0a11c0226 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:43.719514 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4651f5a-cda2-4eb5-988a-0df0a11c0226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:43.741570 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-c4651f5a-cda2-4eb5-988a-0df0a11c0226 None None] MFA Rules not processed for user `b1977b61158e47729cd8602e9593ff5c`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:55:43.743001 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-c4651f5a-cda2-4eb5-988a-0df0a11c0226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:43.802472 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1107/2206] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:55:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:55:45.858417 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20219aa-2f3e-40d2-9db6-77f65ba0077e service swift] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:45.872291 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20219aa-2f3e-40d2-9db6-77f65ba0077e service swift] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:45.877657 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463658a-e7dd-46f8-a261-05e98d7a4227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:45.878364 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463658a-e7dd-46f8-a261-05e98d7a4227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:45.878651 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463658a-e7dd-46f8-a261-05e98d7a4227 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:45.878931 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463658a-e7dd-46f8-a261-05e98d7a4227 admin admin] PATH_INFO: `/v3/users/5c50c1b90c7e44c4be4bce2fb1e81ccc` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:45.880237 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463658a-e7dd-46f8-a261-05e98d7a4227 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c50c1b90c7e44c4be4bce2fb1e81ccc)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:45.882221 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463658a-e7dd-46f8-a261-05e98d7a4227 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:45.902457 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:45.944073 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-b463658a-e7dd-46f8-a261-05e98d7a4227 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c50c1b90c7e44c4be4bce2fb1e81ccc'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:45.953247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-b463658a-e7dd-46f8-a261-05e98d7a4227 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c50c1b90c7e44c4be4bce2fb1e81ccc'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:45.972110 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-b463658a-e7dd-46f8-a261-05e98d7a4227 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c50c1b90c7e44c4be4bce2fb1e81ccc'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:45.985519 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-b463658a-e7dd-46f8-a261-05e98d7a4227 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c50c1b90c7e44c4be4bce2fb1e81ccc'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:45.986197 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-b463658a-e7dd-46f8-a261-05e98d7a4227 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c50c1b90c7e44c4be4bce2fb1e81ccc'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:45.994732 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1100/2207] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:55:45 2022] DELETE /identity/v3/users/5c50c1b90c7e44c4be4bce2fb1e81ccc => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:55:46.225674 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4651f5a-cda2-4eb5-988a-0df0a11c0226 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:46.259402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4651f5a-cda2-4eb5-988a-0df0a11c0226 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:46.360623 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678e10e-5388-4184-acf4-70af4f87b539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:46.361408 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678e10e-5388-4184-acf4-70af4f87b539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:46.361777 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678e10e-5388-4184-acf4-70af4f87b539 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:46.362311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678e10e-5388-4184-acf4-70af4f87b539 admin admin] PATH_INFO: `/v3/projects/b35235e4f1c044f2ba2f07fd1afa2c29` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:46.363678 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678e10e-5388-4184-acf4-70af4f87b539 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b35235e4f1c044f2ba2f07fd1afa2c29)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:46.366394 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678e10e-5388-4184-acf4-70af4f87b539 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:46.370097 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:46.445232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-d678e10e-5388-4184-acf4-70af4f87b539 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b35235e4f1c044f2ba2f07fd1afa2c29', 'request_id': 'req-d678e10e-5388-4184-acf4-70af4f87b539'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:46.452485 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-d678e10e-5388-4184-acf4-70af4f87b539 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b35235e4f1c044f2ba2f07fd1afa2c29', 'request_id': 'req-d678e10e-5388-4184-acf4-70af4f87b539'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:46.459086 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-d678e10e-5388-4184-acf4-70af4f87b539 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b35235e4f1c044f2ba2f07fd1afa2c29', 'request_id': 'req-d678e10e-5388-4184-acf4-70af4f87b539'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:46.473010 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-d678e10e-5388-4184-acf4-70af4f87b539 admin admin] The token cache is being invalidate because project b35235e4f1c044f2ba2f07fd1afa2c29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:55:46.473242 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-d678e10e-5388-4184-acf4-70af4f87b539 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:46.473937 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-d678e10e-5388-4184-acf4-70af4f87b539 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:46.475558 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1108/2208] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:55:46 2022] DELETE /identity/v3/projects/b35235e4f1c044f2ba2f07fd1afa2c29 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:55:46.479626 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463658a-e7dd-46f8-a261-05e98d7a4227 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:46.481389 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-b463658a-e7dd-46f8-a261-05e98d7a4227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:46.498696 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463658a-e7dd-46f8-a261-05e98d7a4227 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:46.560023 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203457ba-0cb0-4911-918a-1580d3ead357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:46.560707 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203457ba-0cb0-4911-918a-1580d3ead357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:46.560978 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203457ba-0cb0-4911-918a-1580d3ead357 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:46.561256 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203457ba-0cb0-4911-918a-1580d3ead357 admin admin] PATH_INFO: `/v3/users/6eb0611780a54582a814d0945c48326f` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:46.563281 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203457ba-0cb0-4911-918a-1580d3ead357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eb0611780a54582a814d0945c48326f)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:46.565264 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203457ba-0cb0-4911-918a-1580d3ead357 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:46.615526 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-203457ba-0cb0-4911-918a-1580d3ead357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eb0611780a54582a814d0945c48326f'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:46.625907 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-203457ba-0cb0-4911-918a-1580d3ead357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eb0611780a54582a814d0945c48326f'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:46.644755 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-203457ba-0cb0-4911-918a-1580d3ead357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eb0611780a54582a814d0945c48326f'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:46.653541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-203457ba-0cb0-4911-918a-1580d3ead357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eb0611780a54582a814d0945c48326f'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:46.654280 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-203457ba-0cb0-4911-918a-1580d3ead357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eb0611780a54582a814d0945c48326f'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:46.660242 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1101/2209] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:55:46 2022] DELETE /identity/v3/users/6eb0611780a54582a814d0945c48326f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:55:46.855427 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678e10e-5388-4184-acf4-70af4f87b539 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:46.856947 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-d678e10e-5388-4184-acf4-70af4f87b539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:46.870843 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678e10e-5388-4184-acf4-70af4f87b539 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:46.955431 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61c530-9369-4064-9c3d-1e263ca42666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:46.956196 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61c530-9369-4064-9c3d-1e263ca42666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:46.956544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61c530-9369-4064-9c3d-1e263ca42666 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:46.956887 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61c530-9369-4064-9c3d-1e263ca42666 admin admin] PATH_INFO: `/v3/projects/fa34b3bff27140a0ac5b179a86c5b28a` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:46.958221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61c530-9369-4064-9c3d-1e263ca42666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa34b3bff27140a0ac5b179a86c5b28a)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:46.960571 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61c530-9369-4064-9c3d-1e263ca42666 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:47.037095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2e61c530-9369-4064-9c3d-1e263ca42666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa34b3bff27140a0ac5b179a86c5b28a', 'request_id': 'req-2e61c530-9369-4064-9c3d-1e263ca42666'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:47.046602 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2e61c530-9369-4064-9c3d-1e263ca42666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa34b3bff27140a0ac5b179a86c5b28a', 'request_id': 'req-2e61c530-9369-4064-9c3d-1e263ca42666'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:47.054324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2e61c530-9369-4064-9c3d-1e263ca42666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa34b3bff27140a0ac5b179a86c5b28a', 'request_id': 'req-2e61c530-9369-4064-9c3d-1e263ca42666'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:47.067574 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2e61c530-9369-4064-9c3d-1e263ca42666 admin admin] The token cache is being invalidate because project fa34b3bff27140a0ac5b179a86c5b28a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:55:47.067861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2e61c530-9369-4064-9c3d-1e263ca42666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:47.068529 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2e61c530-9369-4064-9c3d-1e263ca42666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:47.070852 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1109/2210] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:55:46 2022] DELETE /identity/v3/projects/fa34b3bff27140a0ac5b179a86c5b28a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:55:47.076929 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202615d6-f130-4830-8602-274822568d1b None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:47.077505 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202615d6-f130-4830-8602-274822568d1b None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:47.077505 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202615d6-f130-4830-8602-274822568d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:47.101418 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-202615d6-f130-4830-8602-274822568d1b None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:55:47.102846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-202615d6-f130-4830-8602-274822568d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:47.109798 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:47.178712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1102/2211] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:55:47.249657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e3b1b-633f-46eb-87c7-2b299fec9e29 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:47.250288 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e3b1b-633f-46eb-87c7-2b299fec9e29 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:47.250288 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324e3b1b-633f-46eb-87c7-2b299fec9e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:47.295260 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-324e3b1b-633f-46eb-87c7-2b299fec9e29 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:55:47.296524 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-324e3b1b-633f-46eb-87c7-2b299fec9e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:47.305820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1110/2212] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:55:47.311685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202615d6-f130-4830-8602-274822568d1b None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:47.323261 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202615d6-f130-4830-8602-274822568d1b None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:47.328684 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1097a27-0ddf-4012-a280-75d5b895e33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:47.329300 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1097a27-0ddf-4012-a280-75d5b895e33f admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:47.329574 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1097a27-0ddf-4012-a280-75d5b895e33f admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:47.329839 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1097a27-0ddf-4012-a280-75d5b895e33f admin admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:47.330576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1097a27-0ddf-4012-a280-75d5b895e33f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:55:47.330878 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1097a27-0ddf-4012-a280-75d5b895e33f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:47.332488 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1097a27-0ddf-4012-a280-75d5b895e33f admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:47.344868 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1103/2213] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:55:47.350016 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e3b1b-633f-46eb-87c7-2b299fec9e29 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:47.360187 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324e3b1b-633f-46eb-87c7-2b299fec9e29 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:47.365810 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b399f3-0d46-4642-885d-cbc4c240cccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:47.366508 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b399f3-0d46-4642-885d-cbc4c240cccd admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:47.366789 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b399f3-0d46-4642-885d-cbc4c240cccd admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:47.367055 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b399f3-0d46-4642-885d-cbc4c240cccd admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:47.367763 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b399f3-0d46-4642-885d-cbc4c240cccd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:47.370017 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b399f3-0d46-4642-885d-cbc4c240cccd admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:47.394595 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:47.411774 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1111/2214] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:55:47 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:55:47.416266 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1097a27-0ddf-4012-a280-75d5b895e33f admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:47.428614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1097a27-0ddf-4012-a280-75d5b895e33f admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:47.503168 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a21b4c-af88-48dc-858a-721de0af5cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:47.504144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a21b4c-af88-48dc-858a-721de0af5cab admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:47.504612 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a21b4c-af88-48dc-858a-721de0af5cab admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:47.505047 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a21b4c-af88-48dc-858a-721de0af5cab admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:47.506859 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a21b4c-af88-48dc-858a-721de0af5cab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:47.509079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a21b4c-af88-48dc-858a-721de0af5cab admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:47.542931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b399f3-0d46-4642-885d-cbc4c240cccd admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:47.544858 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1104/2215] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:55:47 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:55:47.554784 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b399f3-0d46-4642-885d-cbc4c240cccd admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:47.560075 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64473c91-48b8-4e34-bd10-060647f942b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:47.560722 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64473c91-48b8-4e34-bd10-060647f942b6 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:47.561003 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64473c91-48b8-4e34-bd10-060647f942b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:47.561270 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64473c91-48b8-4e34-bd10-060647f942b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:47.562030 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64473c91-48b8-4e34-bd10-060647f942b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:47.563699 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64473c91-48b8-4e34-bd10-060647f942b6 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:47.578771 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1112/2216] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:55:47.584152 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a21b4c-af88-48dc-858a-721de0af5cab admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:47.596622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a21b4c-af88-48dc-858a-721de0af5cab admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:47.603208 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6f457-0dbf-4a44-9a90-fbd1d932ff80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:47.603869 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6f457-0dbf-4a44-9a90-fbd1d932ff80 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:47.604146 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6f457-0dbf-4a44-9a90-fbd1d932ff80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:47.604416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6f457-0dbf-4a44-9a90-fbd1d932ff80 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:47.605646 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb6f457-0dbf-4a44-9a90-fbd1d932ff80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:47.607385 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb6f457-0dbf-4a44-9a90-fbd1d932ff80 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:47.621120 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1105/2217] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:55:47.625623 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64473c91-48b8-4e34-bd10-060647f942b6 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:47.636032 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64473c91-48b8-4e34-bd10-060647f942b6 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:47.642189 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26cd8f-5f28-41fe-8504-43aa5d62f934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:47.643455 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26cd8f-5f28-41fe-8504-43aa5d62f934 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:47.643740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26cd8f-5f28-41fe-8504-43aa5d62f934 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:47.644021 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26cd8f-5f28-41fe-8504-43aa5d62f934 admin admin] PATH_INFO: `/v3/projects/ffac56d55b8f4f91b7ab3519af66b917/users/29be03d061bb430fb0e8330b9001fc97/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:47.661764 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26cd8f-5f28-41fe-8504-43aa5d62f934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffac56d55b8f4f91b7ab3519af66b917, user_id=29be03d061bb430fb0e8330b9001fc97, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:47.664659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26cd8f-5f28-41fe-8504-43aa5d62f934 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:47.681228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1113/2218] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:55:47 2022] PUT /identity/v3/projects/ffac56d55b8f4f91b7ab3519af66b917/users/29be03d061bb430fb0e8330b9001fc97/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:55:47.691587 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf30e1f-ee0e-4156-8e0c-8ef0dda521e6 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:47.692011 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf30e1f-ee0e-4156-8e0c-8ef0dda521e6 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:47.692357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf30e1f-ee0e-4156-8e0c-8ef0dda521e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:47.727934 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-9cf30e1f-ee0e-4156-8e0c-8ef0dda521e6 None None] MFA Rules not processed for user `29be03d061bb430fb0e8330b9001fc97`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:55:47.729326 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-9cf30e1f-ee0e-4156-8e0c-8ef0dda521e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:47.810919 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1106/2219] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:55:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:55:47.823666 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26cd8f-5f28-41fe-8504-43aa5d62f934 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:47.825470 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-6d26cd8f-5f28-41fe-8504-43aa5d62f934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:47.887260 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26cd8f-5f28-41fe-8504-43aa5d62f934 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:47.891085 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78ee9c-b600-4179-990a-90ea957e3c35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:47.891805 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78ee9c-b600-4179-990a-90ea957e3c35 service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:47.892250 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78ee9c-b600-4179-990a-90ea957e3c35 service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:47.892537 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78ee9c-b600-4179-990a-90ea957e3c35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:47.902326 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78ee9c-b600-4179-990a-90ea957e3c35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:47.903836 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78ee9c-b600-4179-990a-90ea957e3c35 service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:47.914602 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1114/2220] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:55:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:55:47.935140 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf30e1f-ee0e-4156-8e0c-8ef0dda521e6 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:47.948011 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:48.009778 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf30e1f-ee0e-4156-8e0c-8ef0dda521e6 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:48.015562 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ba6d2-16c7-4072-8a02-ccdbcdb2fd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:48.016412 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ba6d2-16c7-4072-8a02-ccdbcdb2fd49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:48.016761 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ba6d2-16c7-4072-8a02-ccdbcdb2fd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:48.017101 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ba6d2-16c7-4072-8a02-ccdbcdb2fd49 admin admin] PATH_INFO: `/v3/users/29be03d061bb430fb0e8330b9001fc97` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:48.018620 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ba6d2-16c7-4072-8a02-ccdbcdb2fd49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29be03d061bb430fb0e8330b9001fc97)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:48.020688 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ba6d2-16c7-4072-8a02-ccdbcdb2fd49 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:48.090313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-9c8ba6d2-16c7-4072-8a02-ccdbcdb2fd49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29be03d061bb430fb0e8330b9001fc97'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:48.101875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-9c8ba6d2-16c7-4072-8a02-ccdbcdb2fd49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29be03d061bb430fb0e8330b9001fc97'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:48.118615 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-9c8ba6d2-16c7-4072-8a02-ccdbcdb2fd49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29be03d061bb430fb0e8330b9001fc97'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:48.129833 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-9c8ba6d2-16c7-4072-8a02-ccdbcdb2fd49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29be03d061bb430fb0e8330b9001fc97'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:48.131195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-9c8ba6d2-16c7-4072-8a02-ccdbcdb2fd49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29be03d061bb430fb0e8330b9001fc97'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:48.138841 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1107/2221] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:55:47 2022] DELETE /identity/v3/users/29be03d061bb430fb0e8330b9001fc97 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:55:48.143338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82dfaa-ee5f-4019-b75c-4afcbf2d217d None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:48.143626 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82dfaa-ee5f-4019-b75c-4afcbf2d217d None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:48.143904 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82dfaa-ee5f-4019-b75c-4afcbf2d217d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:48.164454 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-5f82dfaa-ee5f-4019-b75c-4afcbf2d217d None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:55:48.165725 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-5f82dfaa-ee5f-4019-b75c-4afcbf2d217d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:48.238585 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1115/2222] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:55:48.250372 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ba6d2-16c7-4072-8a02-ccdbcdb2fd49 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:48.251921 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-9c8ba6d2-16c7-4072-8a02-ccdbcdb2fd49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:48.347055 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ba6d2-16c7-4072-8a02-ccdbcdb2fd49 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:48.350811 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e4097-b425-4a52-8b5e-7cdd190287d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:48.351514 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e4097-b425-4a52-8b5e-7cdd190287d3 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:48.351791 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e4097-b425-4a52-8b5e-7cdd190287d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:48.352116 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e4097-b425-4a52-8b5e-7cdd190287d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:48.363488 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e4097-b425-4a52-8b5e-7cdd190287d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:48.365390 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55e4097-b425-4a52-8b5e-7cdd190287d3 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:48.381554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1108/2223] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:55:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:55:48.826527 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82dfaa-ee5f-4019-b75c-4afcbf2d217d None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:48.828185 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-5f82dfaa-ee5f-4019-b75c-4afcbf2d217d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:48.843650 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82dfaa-ee5f-4019-b75c-4afcbf2d217d None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:48.848923 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efecebf-6227-400f-8ffa-049100bd0a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:48.849759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efecebf-6227-400f-8ffa-049100bd0a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:48.850094 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efecebf-6227-400f-8ffa-049100bd0a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:48.850376 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efecebf-6227-400f-8ffa-049100bd0a88 admin admin] PATH_INFO: `/v3/projects/ffac56d55b8f4f91b7ab3519af66b917` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:48.851716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efecebf-6227-400f-8ffa-049100bd0a88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffac56d55b8f4f91b7ab3519af66b917)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:48.853734 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efecebf-6227-400f-8ffa-049100bd0a88 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:48.929673 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-9efecebf-6227-400f-8ffa-049100bd0a88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffac56d55b8f4f91b7ab3519af66b917', 'request_id': 'req-9efecebf-6227-400f-8ffa-049100bd0a88'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:48.939345 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-9efecebf-6227-400f-8ffa-049100bd0a88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffac56d55b8f4f91b7ab3519af66b917', 'request_id': 'req-9efecebf-6227-400f-8ffa-049100bd0a88'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:48.943658 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:INSERT=3,keystone:SELECT=92,keystone:DELETE=5 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:48.948384 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-9efecebf-6227-400f-8ffa-049100bd0a88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffac56d55b8f4f91b7ab3519af66b917', 'request_id': 'req-9efecebf-6227-400f-8ffa-049100bd0a88'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:48.963082 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-9efecebf-6227-400f-8ffa-049100bd0a88 admin admin] The token cache is being invalidate because project ffac56d55b8f4f91b7ab3519af66b917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:55:48.963713 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-9efecebf-6227-400f-8ffa-049100bd0a88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:48.964669 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-9efecebf-6227-400f-8ffa-049100bd0a88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:48.966495 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1116/2224] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:55:48 2022] DELETE /identity/v3/projects/ffac56d55b8f4f91b7ab3519af66b917 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:55:48.971983 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0bc33-1790-40f9-9532-4c1100a87d34 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:48.972312 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0bc33-1790-40f9-9532-4c1100a87d34 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:48.972539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0bc33-1790-40f9-9532-4c1100a87d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:49.002070 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-a2f0bc33-1790-40f9-9532-4c1100a87d34 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:55:49.003479 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-a2f0bc33-1790-40f9-9532-4c1100a87d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:49.031605 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:49.070931 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1109/2225] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:55:49.078450 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23a50f-4db0-4c9a-8657-4c3b9a91a330 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:49.078724 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23a50f-4db0-4c9a-8657-4c3b9a91a330 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:49.079087 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23a50f-4db0-4c9a-8657-4c3b9a91a330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:49.105019 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-7d23a50f-4db0-4c9a-8657-4c3b9a91a330 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:55:49.106597 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-7d23a50f-4db0-4c9a-8657-4c3b9a91a330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:49.120749 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1117/2226] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:55:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:55:49.122300 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0bc33-1790-40f9-9532-4c1100a87d34 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:49.133394 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0bc33-1790-40f9-9532-4c1100a87d34 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:49.138647 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4f6a4-ccad-4518-b006-a14e5d635d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:49.139293 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4f6a4-ccad-4518-b006-a14e5d635d6b admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:49.139574 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4f6a4-ccad-4518-b006-a14e5d635d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:49.139845 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4f6a4-ccad-4518-b006-a14e5d635d6b admin admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:49.140557 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c4f6a4-ccad-4518-b006-a14e5d635d6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:55:49.140864 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c4f6a4-ccad-4518-b006-a14e5d635d6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:49.142530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c4f6a4-ccad-4518-b006-a14e5d635d6b admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:49.155204 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1110/2227] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:55:49.159637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23a50f-4db0-4c9a-8657-4c3b9a91a330 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:49.169117 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23a50f-4db0-4c9a-8657-4c3b9a91a330 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:49.174050 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7137f85-0d35-4dfb-ba8b-d3dfb1b4591b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:49.174680 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7137f85-0d35-4dfb-ba8b-d3dfb1b4591b admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:49.174962 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7137f85-0d35-4dfb-ba8b-d3dfb1b4591b admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:49.175239 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7137f85-0d35-4dfb-ba8b-d3dfb1b4591b admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:49.175923 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7137f85-0d35-4dfb-ba8b-d3dfb1b4591b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:49.177939 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7137f85-0d35-4dfb-ba8b-d3dfb1b4591b admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:49.216798 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1118/2228] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:55:49 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:55:49.218059 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4f6a4-ccad-4518-b006-a14e5d635d6b admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:49.229242 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4f6a4-ccad-4518-b006-a14e5d635d6b admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:49.316351 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a23680-201b-49fa-b469-bb4a12664808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:49.318258 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a23680-201b-49fa-b469-bb4a12664808 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:49.318576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a23680-201b-49fa-b469-bb4a12664808 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:49.318928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a23680-201b-49fa-b469-bb4a12664808 admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:49.319808 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a23680-201b-49fa-b469-bb4a12664808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:49.323172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a23680-201b-49fa-b469-bb4a12664808 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:49.353593 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1111/2229] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:55:49 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:55:49.354943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7137f85-0d35-4dfb-ba8b-d3dfb1b4591b admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:49.368708 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7137f85-0d35-4dfb-ba8b-d3dfb1b4591b admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:49.381264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c45d0-b7c5-4810-b673-b0bd10ad69ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:49.381911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c45d0-b7c5-4810-b673-b0bd10ad69ec admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:49.382228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c45d0-b7c5-4810-b673-b0bd10ad69ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:49.382499 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c45d0-b7c5-4810-b673-b0bd10ad69ec admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:49.383237 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c45d0-b7c5-4810-b673-b0bd10ad69ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:49.384975 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c45d0-b7c5-4810-b673-b0bd10ad69ec admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:49.397164 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1119/2230] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:55:49.401346 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a23680-201b-49fa-b469-bb4a12664808 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:49.412340 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a23680-201b-49fa-b469-bb4a12664808 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:49.418223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159eeebe-7de2-44b8-a589-34b357132f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:49.420558 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159eeebe-7de2-44b8-a589-34b357132f96 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:49.420558 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159eeebe-7de2-44b8-a589-34b357132f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:49.420558 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159eeebe-7de2-44b8-a589-34b357132f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:49.420558 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159eeebe-7de2-44b8-a589-34b357132f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:49.421909 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159eeebe-7de2-44b8-a589-34b357132f96 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:49.433569 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1112/2231] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:55:49.437919 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c45d0-b7c5-4810-b673-b0bd10ad69ec admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:49.448510 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c45d0-b7c5-4810-b673-b0bd10ad69ec admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:49.457703 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8093cde-ed15-4754-9aa6-f606aff064ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:49.458459 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8093cde-ed15-4754-9aa6-f606aff064ae admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:49.458738 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8093cde-ed15-4754-9aa6-f606aff064ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:49.459087 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8093cde-ed15-4754-9aa6-f606aff064ae admin admin] PATH_INFO: `/v3/projects/c67360e061e34d189ef4621c750cce98/users/a2c53c418928474887a5b45f027c55ab/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:49.479228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8093cde-ed15-4754-9aa6-f606aff064ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=c67360e061e34d189ef4621c750cce98, user_id=a2c53c418928474887a5b45f027c55ab, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:49.482304 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8093cde-ed15-4754-9aa6-f606aff064ae admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:49.506105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1120/2232] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:55:49 2022] PUT /identity/v3/projects/c67360e061e34d189ef4621c750cce98/users/a2c53c418928474887a5b45f027c55ab/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:55:49.513594 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25b811-ed91-4604-9e57-8b1f4353367e None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:49.513888 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25b811-ed91-4604-9e57-8b1f4353367e None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:49.514199 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25b811-ed91-4604-9e57-8b1f4353367e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:49.546570 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-7e25b811-ed91-4604-9e57-8b1f4353367e None None] MFA Rules not processed for user `a2c53c418928474887a5b45f027c55ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:55:49.548067 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-7e25b811-ed91-4604-9e57-8b1f4353367e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:49.619871 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1113/2233] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:55:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:55:49.624420 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8093cde-ed15-4754-9aa6-f606aff064ae admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:49.696511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8093cde-ed15-4754-9aa6-f606aff064ae admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:49.701695 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced6fe8-6622-45ab-9357-1cad7ab49083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:49.702475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced6fe8-6622-45ab-9357-1cad7ab49083 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:49.702709 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced6fe8-6622-45ab-9357-1cad7ab49083 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:49.702980 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced6fe8-6622-45ab-9357-1cad7ab49083 admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:49.703657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced6fe8-6622-45ab-9357-1cad7ab49083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:49.705596 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced6fe8-6622-45ab-9357-1cad7ab49083 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:49.736761 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1121/2234] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:55:49 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:55:49.741309 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25b811-ed91-4604-9e57-8b1f4353367e None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:49.752972 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25b811-ed91-4604-9e57-8b1f4353367e None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:49.774915 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:49.818545 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c04643-847e-4080-adea-35de02adc61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:49.819104 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c04643-847e-4080-adea-35de02adc61a admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:49.819403 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c04643-847e-4080-adea-35de02adc61a admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:49.819674 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c04643-847e-4080-adea-35de02adc61a admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:49.820352 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c04643-847e-4080-adea-35de02adc61a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:49.822311 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c04643-847e-4080-adea-35de02adc61a admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:49.847493 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1114/2235] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:55:49 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:55:49.852224 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced6fe8-6622-45ab-9357-1cad7ab49083 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:49.865779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced6fe8-6622-45ab-9357-1cad7ab49083 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:49.871450 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ffb5b-9157-425b-9a84-b9e839b77525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:49.872212 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ffb5b-9157-425b-9a84-b9e839b77525 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:49.872503 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ffb5b-9157-425b-9a84-b9e839b77525 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:49.872777 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ffb5b-9157-425b-9a84-b9e839b77525 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:49.873503 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ffb5b-9157-425b-9a84-b9e839b77525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:49.875272 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ffb5b-9157-425b-9a84-b9e839b77525 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:49.888391 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1122/2236] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:55:49.892435 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c04643-847e-4080-adea-35de02adc61a admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:49.913842 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c04643-847e-4080-adea-35de02adc61a admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:49.927162 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52686e25-4557-45b0-8f4a-c9ca9267a46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:49.928424 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52686e25-4557-45b0-8f4a-c9ca9267a46d admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:49.928424 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52686e25-4557-45b0-8f4a-c9ca9267a46d admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:49.928424 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52686e25-4557-45b0-8f4a-c9ca9267a46d admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:49.929212 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52686e25-4557-45b0-8f4a-c9ca9267a46d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:49.930889 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52686e25-4557-45b0-8f4a-c9ca9267a46d admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:49.943343 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1115/2237] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:55:49.947805 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ffb5b-9157-425b-9a84-b9e839b77525 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:49.959922 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ffb5b-9157-425b-9a84-b9e839b77525 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:49.964709 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e331951-81b8-402c-b249-13e42d642f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:49.965519 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e331951-81b8-402c-b249-13e42d642f4a admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:49.965888 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e331951-81b8-402c-b249-13e42d642f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:49.966385 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e331951-81b8-402c-b249-13e42d642f4a admin admin] PATH_INFO: `/v3/projects/ae2e2e63a3414c62a08ce716e27a4cd8/users/bf4dd7642a084a768e26cc0c8c1e3dff/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:50.003259 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e331951-81b8-402c-b249-13e42d642f4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae2e2e63a3414c62a08ce716e27a4cd8, user_id=bf4dd7642a084a768e26cc0c8c1e3dff, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:50.007335 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e331951-81b8-402c-b249-13e42d642f4a admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:50.024315 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1123/2238] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:55:49 2022] PUT /identity/v3/projects/ae2e2e63a3414c62a08ce716e27a4cd8/users/bf4dd7642a084a768e26cc0c8c1e3dff/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:55:50.034906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522179de-dc62-4d3c-843e-7b00ea0b547c None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:50.035222 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522179de-dc62-4d3c-843e-7b00ea0b547c None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:50.035458 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522179de-dc62-4d3c-843e-7b00ea0b547c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:50.116751 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-522179de-dc62-4d3c-843e-7b00ea0b547c None None] MFA Rules not processed for user `bf4dd7642a084a768e26cc0c8c1e3dff`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:55:50.118505 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-522179de-dc62-4d3c-843e-7b00ea0b547c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:50.216214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1116/2239] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:55:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:55:50.221151 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e331951-81b8-402c-b249-13e42d642f4a admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:50.256352 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:50.299887 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e331951-81b8-402c-b249-13e42d642f4a admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:50.305721 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9f4f2-a7c2-41ac-a5b4-ddb500741ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:50.306432 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9f4f2-a7c2-41ac-a5b4-ddb500741ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:50.306662 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9f4f2-a7c2-41ac-a5b4-ddb500741ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:50.306929 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9f4f2-a7c2-41ac-a5b4-ddb500741ea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:50.307625 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9f4f2-a7c2-41ac-a5b4-ddb500741ea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:50.320738 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9f4f2-a7c2-41ac-a5b4-ddb500741ea9 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:50.346244 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1124/2240] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:55:50 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:55:50.350564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522179de-dc62-4d3c-843e-7b00ea0b547c None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:50.364859 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522179de-dc62-4d3c-843e-7b00ea0b547c None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:50.432503 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b890809-ae8e-46e0-a3b2-07b9564c6d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:50.433161 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b890809-ae8e-46e0-a3b2-07b9564c6d3c admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:50.433439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b890809-ae8e-46e0-a3b2-07b9564c6d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:50.433730 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b890809-ae8e-46e0-a3b2-07b9564c6d3c admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:50.434440 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b890809-ae8e-46e0-a3b2-07b9564c6d3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:50.436445 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b890809-ae8e-46e0-a3b2-07b9564c6d3c admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:50.460028 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1117/2241] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:55:50 2022] POST /identity/v3/users => generated 299 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:55:50.464466 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9f4f2-a7c2-41ac-a5b4-ddb500741ea9 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:50.475536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9f4f2-a7c2-41ac-a5b4-ddb500741ea9 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:50.481723 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689f380-51fe-4ad8-872a-a4094b8570e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:50.482561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689f380-51fe-4ad8-872a-a4094b8570e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:50.482925 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689f380-51fe-4ad8-872a-a4094b8570e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:50.483268 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689f380-51fe-4ad8-872a-a4094b8570e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:50.484230 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689f380-51fe-4ad8-872a-a4094b8570e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:50.486278 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689f380-51fe-4ad8-872a-a4094b8570e4 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:50.508008 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1125/2242] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:55:50.509245 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b890809-ae8e-46e0-a3b2-07b9564c6d3c admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:50.521276 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b890809-ae8e-46e0-a3b2-07b9564c6d3c admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:50.526681 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e8481-90a0-4545-90d6-a5422ad822d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:50.527397 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e8481-90a0-4545-90d6-a5422ad822d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:50.527692 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e8481-90a0-4545-90d6-a5422ad822d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:50.527973 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e8481-90a0-4545-90d6-a5422ad822d9 admin admin] PATH_INFO: `/v3/projects/a05302ff5299415b9b300409f45e8e69/users/dc186cf39c7043069b164b96547cb8e4/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:50.546377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e8481-90a0-4545-90d6-a5422ad822d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a05302ff5299415b9b300409f45e8e69, user_id=dc186cf39c7043069b164b96547cb8e4, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:50.549825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e8481-90a0-4545-90d6-a5422ad822d9 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:50.563034 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:50.570232 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1118/2243] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:55:50 2022] PUT /identity/v3/projects/a05302ff5299415b9b300409f45e8e69/users/dc186cf39c7043069b164b96547cb8e4/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:55:50.573798 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689f380-51fe-4ad8-872a-a4094b8570e4 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:50.584341 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689f380-51fe-4ad8-872a-a4094b8570e4 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:50.653477 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850cb3d-03e1-4928-9689-f0dc161cc1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:50.654179 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850cb3d-03e1-4928-9689-f0dc161cc1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:50.654462 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850cb3d-03e1-4928-9689-f0dc161cc1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:50.654822 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850cb3d-03e1-4928-9689-f0dc161cc1c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:50.655533 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850cb3d-03e1-4928-9689-f0dc161cc1c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:50.657301 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850cb3d-03e1-4928-9689-f0dc161cc1c3 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:50.669541 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1126/2244] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:55:50.674260 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e8481-90a0-4545-90d6-a5422ad822d9 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:50.685360 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e8481-90a0-4545-90d6-a5422ad822d9 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:50.690302 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda81237-6f2b-486f-8824-b5176d871874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:50.690965 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda81237-6f2b-486f-8824-b5176d871874 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:50.691240 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda81237-6f2b-486f-8824-b5176d871874 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:50.691512 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda81237-6f2b-486f-8824-b5176d871874 admin admin] PATH_INFO: `/v3/projects/a05302ff5299415b9b300409f45e8e69/users/dc186cf39c7043069b164b96547cb8e4/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:50.693500 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda81237-6f2b-486f-8824-b5176d871874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a05302ff5299415b9b300409f45e8e69, user_id=dc186cf39c7043069b164b96547cb8e4, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:50.696163 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda81237-6f2b-486f-8824-b5176d871874 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:50.706967 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1119/2245] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:55:50 2022] PUT /identity/v3/projects/a05302ff5299415b9b300409f45e8e69/users/dc186cf39c7043069b164b96547cb8e4/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:55:50.718679 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332bc8b-ba70-4ba2-9638-10f0a861e29e None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:50.718964 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332bc8b-ba70-4ba2-9638-10f0a861e29e None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:50.719240 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332bc8b-ba70-4ba2-9638-10f0a861e29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:50.750972 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-0332bc8b-ba70-4ba2-9638-10f0a861e29e None None] MFA Rules not processed for user `dc186cf39c7043069b164b96547cb8e4`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:55:50.752206 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-0332bc8b-ba70-4ba2-9638-10f0a861e29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:50.825637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1127/2246] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:55:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:55:50.837496 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda81237-6f2b-486f-8824-b5176d871874 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:50.839321 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-fda81237-6f2b-486f-8824-b5176d871874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:50.900878 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda81237-6f2b-486f-8824-b5176d871874 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:50.904788 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65052d8c-6210-431e-ad95-01cd4877a58a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:50.905377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65052d8c-6210-431e-ad95-01cd4877a58a service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:50.905651 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65052d8c-6210-431e-ad95-01cd4877a58a service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:50.905926 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65052d8c-6210-431e-ad95-01cd4877a58a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:50.967840 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65052d8c-6210-431e-ad95-01cd4877a58a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:50.969298 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65052d8c-6210-431e-ad95-01cd4877a58a service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:50.979443 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1120/2247] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:55:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:55:52.552124 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332bc8b-ba70-4ba2-9638-10f0a861e29e None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:52.553829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-0332bc8b-ba70-4ba2-9638-10f0a861e29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:52.566945 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332bc8b-ba70-4ba2-9638-10f0a861e29e None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:52.575747 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5d1a9-c237-4ed2-acda-b0a0ed3948f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:52.576461 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5d1a9-c237-4ed2-acda-b0a0ed3948f2 service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:52.576741 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5d1a9-c237-4ed2-acda-b0a0ed3948f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:52.577038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a5d1a9-c237-4ed2-acda-b0a0ed3948f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:52.606615 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:52.641321 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5d1a9-c237-4ed2-acda-b0a0ed3948f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:52.642859 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a5d1a9-c237-4ed2-acda-b0a0ed3948f2 service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:52.652184 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1128/2248] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:55:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:55:53.253939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65052d8c-6210-431e-ad95-01cd4877a58a service cinder] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:53.262901 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65052d8c-6210-431e-ad95-01cd4877a58a service cinder] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:53.266939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758574b-973c-4dd9-b248-55f86d961c06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:53.267593 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758574b-973c-4dd9-b248-55f86d961c06 service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:53.267839 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758574b-973c-4dd9-b248-55f86d961c06 service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:53.268083 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758574b-973c-4dd9-b248-55f86d961c06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:53.278405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758574b-973c-4dd9-b248-55f86d961c06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:53.279865 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758574b-973c-4dd9-b248-55f86d961c06 service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:53.290371 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1121/2249] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:55:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:55:57.207777 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5d1a9-c237-4ed2-acda-b0a0ed3948f2 service cinder] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:57.274669 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a5d1a9-c237-4ed2-acda-b0a0ed3948f2 service cinder] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:57.285927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073f208-fb08-4195-bc4a-68f6389bb384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:57.286666 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073f208-fb08-4195-bc4a-68f6389bb384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:57.286961 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073f208-fb08-4195-bc4a-68f6389bb384 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:57.287336 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073f208-fb08-4195-bc4a-68f6389bb384 admin admin] PATH_INFO: `/v3/users/a2c53c418928474887a5b45f027c55ab` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:57.288518 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073f208-fb08-4195-bc4a-68f6389bb384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2c53c418928474887a5b45f027c55ab)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:57.290637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073f208-fb08-4195-bc4a-68f6389bb384 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:57.354758 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-b073f208-fb08-4195-bc4a-68f6389bb384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2c53c418928474887a5b45f027c55ab'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:57.355405 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-b073f208-fb08-4195-bc4a-68f6389bb384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2c53c418928474887a5b45f027c55ab'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:57.370558 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-b073f208-fb08-4195-bc4a-68f6389bb384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2c53c418928474887a5b45f027c55ab'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:57.398033 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-b073f208-fb08-4195-bc4a-68f6389bb384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2c53c418928474887a5b45f027c55ab'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:57.406087 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-b073f208-fb08-4195-bc4a-68f6389bb384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2c53c418928474887a5b45f027c55ab'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:57.414218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1129/2250] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:55:57 2022] DELETE /identity/v3/users/a2c53c418928474887a5b45f027c55ab => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:55:57.418924 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22929051-9636-4c58-a06c-bf55c2e95051 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:57.419602 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22929051-9636-4c58-a06c-bf55c2e95051 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:57.419602 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22929051-9636-4c58-a06c-bf55c2e95051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:57.447451 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-22929051-9636-4c58-a06c-bf55c2e95051 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:55:57.448691 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-22929051-9636-4c58-a06c-bf55c2e95051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:57.520414 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1122/2251] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:55:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:55:57.530733 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073f208-fb08-4195-bc4a-68f6389bb384 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:57.532233 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-b073f208-fb08-4195-bc4a-68f6389bb384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:57.585167 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:57.597869 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073f208-fb08-4195-bc4a-68f6389bb384 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:57.602847 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db136e-4ae0-4ea5-9477-03bdd784ae33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:57.603556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db136e-4ae0-4ea5-9477-03bdd784ae33 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:57.604306 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db136e-4ae0-4ea5-9477-03bdd784ae33 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:57.604306 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db136e-4ae0-4ea5-9477-03bdd784ae33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:57.617928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db136e-4ae0-4ea5-9477-03bdd784ae33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:57.619551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db136e-4ae0-4ea5-9477-03bdd784ae33 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:57.630697 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1130/2252] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:55:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:55:57.920323 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22929051-9636-4c58-a06c-bf55c2e95051 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:57.922095 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-22929051-9636-4c58-a06c-bf55c2e95051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:57.935823 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22929051-9636-4c58-a06c-bf55c2e95051 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:57.942217 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261aa48-c084-4108-870f-289b99f6b4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:57.942503 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261aa48-c084-4108-870f-289b99f6b4b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:57.942858 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261aa48-c084-4108-870f-289b99f6b4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:57.943179 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261aa48-c084-4108-870f-289b99f6b4b5 admin admin] PATH_INFO: `/v3/projects/c67360e061e34d189ef4621c750cce98` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:57.944712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261aa48-c084-4108-870f-289b99f6b4b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c67360e061e34d189ef4621c750cce98)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:57.947143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261aa48-c084-4108-870f-289b99f6b4b5 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:57.970949 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:57.995673 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-3261aa48-c084-4108-870f-289b99f6b4b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c67360e061e34d189ef4621c750cce98', 'request_id': 'req-3261aa48-c084-4108-870f-289b99f6b4b5'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:58.005769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-3261aa48-c084-4108-870f-289b99f6b4b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c67360e061e34d189ef4621c750cce98', 'request_id': 'req-3261aa48-c084-4108-870f-289b99f6b4b5'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:58.012070 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-3261aa48-c084-4108-870f-289b99f6b4b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c67360e061e34d189ef4621c750cce98', 'request_id': 'req-3261aa48-c084-4108-870f-289b99f6b4b5'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:58.024079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-3261aa48-c084-4108-870f-289b99f6b4b5 admin admin] The token cache is being invalidate because project c67360e061e34d189ef4621c750cce98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:55:58.024371 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-3261aa48-c084-4108-870f-289b99f6b4b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:58.025112 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-3261aa48-c084-4108-870f-289b99f6b4b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:58.026758 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1123/2253] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:55:57 2022] DELETE /identity/v3/projects/c67360e061e34d189ef4621c750cce98 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:55:58.031297 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db136e-4ae0-4ea5-9477-03bdd784ae33 service neutron] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:58.041755 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db136e-4ae0-4ea5-9477-03bdd784ae33 service neutron] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:58.106137 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efd7bc-56cc-48c2-9660-fe90325dabeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:58.106854 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efd7bc-56cc-48c2-9660-fe90325dabeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:58.107281 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efd7bc-56cc-48c2-9660-fe90325dabeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:58.107563 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efd7bc-56cc-48c2-9660-fe90325dabeb admin admin] PATH_INFO: `/v3/users/bf4dd7642a084a768e26cc0c8c1e3dff` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:58.108819 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3efd7bc-56cc-48c2-9660-fe90325dabeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf4dd7642a084a768e26cc0c8c1e3dff)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:58.110998 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3efd7bc-56cc-48c2-9660-fe90325dabeb admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:58.164374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-f3efd7bc-56cc-48c2-9660-fe90325dabeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf4dd7642a084a768e26cc0c8c1e3dff'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:58.165010 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-f3efd7bc-56cc-48c2-9660-fe90325dabeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf4dd7642a084a768e26cc0c8c1e3dff'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:58.172736 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-f3efd7bc-56cc-48c2-9660-fe90325dabeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf4dd7642a084a768e26cc0c8c1e3dff'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:58.187097 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-f3efd7bc-56cc-48c2-9660-fe90325dabeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf4dd7642a084a768e26cc0c8c1e3dff'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:58.195603 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-f3efd7bc-56cc-48c2-9660-fe90325dabeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf4dd7642a084a768e26cc0c8c1e3dff'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:58.202438 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1131/2254] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:55:58 2022] DELETE /identity/v3/users/bf4dd7642a084a768e26cc0c8c1e3dff => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:55:58.686576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261aa48-c084-4108-870f-289b99f6b4b5 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:58.688107 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-3261aa48-c084-4108-870f-289b99f6b4b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:58.701611 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261aa48-c084-4108-870f-289b99f6b4b5 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:58.794070 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c677538-8f4c-4c10-ba60-dd93d31f869b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:58.797757 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c677538-8f4c-4c10-ba60-dd93d31f869b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:58.797757 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c677538-8f4c-4c10-ba60-dd93d31f869b admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:58.797757 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c677538-8f4c-4c10-ba60-dd93d31f869b admin admin] PATH_INFO: `/v3/projects/ae2e2e63a3414c62a08ce716e27a4cd8` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:58.798735 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c677538-8f4c-4c10-ba60-dd93d31f869b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae2e2e63a3414c62a08ce716e27a4cd8)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:58.801127 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c677538-8f4c-4c10-ba60-dd93d31f869b admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:58.852875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-0c677538-8f4c-4c10-ba60-dd93d31f869b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae2e2e63a3414c62a08ce716e27a4cd8', 'request_id': 'req-0c677538-8f4c-4c10-ba60-dd93d31f869b'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:58.860909 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-0c677538-8f4c-4c10-ba60-dd93d31f869b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae2e2e63a3414c62a08ce716e27a4cd8', 'request_id': 'req-0c677538-8f4c-4c10-ba60-dd93d31f869b'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:58.867842 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-0c677538-8f4c-4c10-ba60-dd93d31f869b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae2e2e63a3414c62a08ce716e27a4cd8', 'request_id': 'req-0c677538-8f4c-4c10-ba60-dd93d31f869b'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:58.880608 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-0c677538-8f4c-4c10-ba60-dd93d31f869b admin admin] The token cache is being invalidate because project ae2e2e63a3414c62a08ce716e27a4cd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:55:58.880897 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-0c677538-8f4c-4c10-ba60-dd93d31f869b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:58.881690 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-0c677538-8f4c-4c10-ba60-dd93d31f869b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:58.883260 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1124/2255] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:55:58 2022] DELETE /identity/v3/projects/ae2e2e63a3414c62a08ce716e27a4cd8 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:55:58.887475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efd7bc-56cc-48c2-9660-fe90325dabeb admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:58.888936 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-f3efd7bc-56cc-48c2-9660-fe90325dabeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:58.903097 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efd7bc-56cc-48c2-9660-fe90325dabeb admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:58.967008 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc44ba0-34af-4916-baaf-71260c42b4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:58.967661 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc44ba0-34af-4916-baaf-71260c42b4cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:58.967942 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc44ba0-34af-4916-baaf-71260c42b4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:58.968213 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc44ba0-34af-4916-baaf-71260c42b4cc admin admin] PATH_INFO: `/v3/users/dc186cf39c7043069b164b96547cb8e4` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:58.969366 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc44ba0-34af-4916-baaf-71260c42b4cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc186cf39c7043069b164b96547cb8e4)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:58.971389 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc44ba0-34af-4916-baaf-71260c42b4cc admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:58.977125 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:59.022609 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-3bc44ba0-34af-4916-baaf-71260c42b4cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc186cf39c7043069b164b96547cb8e4'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:59.023215 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-3bc44ba0-34af-4916-baaf-71260c42b4cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc186cf39c7043069b164b96547cb8e4'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:59.031027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-3bc44ba0-34af-4916-baaf-71260c42b4cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc186cf39c7043069b164b96547cb8e4'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:59.043698 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-3bc44ba0-34af-4916-baaf-71260c42b4cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc186cf39c7043069b164b96547cb8e4'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:59.050618 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-3bc44ba0-34af-4916-baaf-71260c42b4cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc186cf39c7043069b164b96547cb8e4'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:59.056803 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1132/2256] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:55:58 2022] DELETE /identity/v3/users/dc186cf39c7043069b164b96547cb8e4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:55:59.338392 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c677538-8f4c-4c10-ba60-dd93d31f869b admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:55:59.339892 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-0c677538-8f4c-4c10-ba60-dd93d31f869b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:55:59.355325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c677538-8f4c-4c10-ba60-dd93d31f869b admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:55:59.398788 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:55:59.420471 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ed8a3-9e19-451d-818e-39afb10a1225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:55:59.421159 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ed8a3-9e19-451d-818e-39afb10a1225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:55:59.421435 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ed8a3-9e19-451d-818e-39afb10a1225 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:55:59.421705 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ed8a3-9e19-451d-818e-39afb10a1225 admin admin] PATH_INFO: `/v3/projects/a05302ff5299415b9b300409f45e8e69` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:55:59.423141 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ed8a3-9e19-451d-818e-39afb10a1225 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a05302ff5299415b9b300409f45e8e69)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:55:59.425053 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ed8a3-9e19-451d-818e-39afb10a1225 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:55:59.477442 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-705ed8a3-9e19-451d-818e-39afb10a1225 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a05302ff5299415b9b300409f45e8e69', 'request_id': 'req-705ed8a3-9e19-451d-818e-39afb10a1225'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:59.487588 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-705ed8a3-9e19-451d-818e-39afb10a1225 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a05302ff5299415b9b300409f45e8e69', 'request_id': 'req-705ed8a3-9e19-451d-818e-39afb10a1225'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:59.495467 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-705ed8a3-9e19-451d-818e-39afb10a1225 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a05302ff5299415b9b300409f45e8e69', 'request_id': 'req-705ed8a3-9e19-451d-818e-39afb10a1225'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:59.509275 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-705ed8a3-9e19-451d-818e-39afb10a1225 admin admin] The token cache is being invalidate because project a05302ff5299415b9b300409f45e8e69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:55:59.509565 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-705ed8a3-9e19-451d-818e-39afb10a1225 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:59.510387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-705ed8a3-9e19-451d-818e-39afb10a1225 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:55:59.512406 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1125/2257] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:55:59 2022] DELETE /identity/v3/projects/a05302ff5299415b9b300409f45e8e69 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:56:01.957037 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c551824-a26c-4007-a4a5-803a7cd9b1ae None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:56:01.957528 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c551824-a26c-4007-a4a5-803a7cd9b1ae None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:56:01.957626 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c551824-a26c-4007-a4a5-803a7cd9b1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:56:01.981756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-7c551824-a26c-4007-a4a5-803a7cd9b1ae None None] MFA Rules not processed for user `b613dee1148c4822af2e7847b28cf4aa`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:56:01.983085 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-7c551824-a26c-4007-a4a5-803a7cd9b1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:56:02.077524 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1133/2258] 10.222.0.39 () {58 vars in 967 bytes} [Tue Jul 26 04:56:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:56:02.088902 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ed8a3-9e19-451d-818e-39afb10a1225 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:56:02.090889 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-705ed8a3-9e19-451d-818e-39afb10a1225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:56:02.183693 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ed8a3-9e19-451d-818e-39afb10a1225 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:56:02.188751 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c945f12-2dc6-4ab0-b378-279c17e8e0e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e089e39e9de419b9e2fb1d7fc2d245a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:56:02.189396 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c945f12-2dc6-4ab0-b378-279c17e8e0e9 service swift] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:56:02.189675 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c945f12-2dc6-4ab0-b378-279c17e8e0e9 service swift] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:56:02.189948 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c945f12-2dc6-4ab0-b378-279c17e8e0e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:56:02.199505 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c945f12-2dc6-4ab0-b378-279c17e8e0e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:56:02.201132 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c945f12-2dc6-4ab0-b378-279c17e8e0e9 service swift] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:56:02.210489 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1126/2259] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 04:56:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 26 04:56:08.020948 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729bef9-4f29-4410-beda-5491b705d3dd None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:56:08.021958 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729bef9-4f29-4410-beda-5491b705d3dd None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:56:08.022430 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729bef9-4f29-4410-beda-5491b705d3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:56:08.043492 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-5729bef9-4f29-4410-beda-5491b705d3dd None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:56:08.045018 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-5729bef9-4f29-4410-beda-5491b705d3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:56:08.113887 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1134/2260] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Jul 26 04:56:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:56:08.135271 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c945f12-2dc6-4ab0-b378-279c17e8e0e9 service swift] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:56:08.136962 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-7c945f12-2dc6-4ab0-b378-279c17e8e0e9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:56:08.202494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:56:08.219724 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c945f12-2dc6-4ab0-b378-279c17e8e0e9 service swift] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:56:08.225809 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d24ff-f8c9-4f3e-8209-c6188679225f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:56:08.226491 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d24ff-f8c9-4f3e-8209-c6188679225f service nova] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:56:08.226788 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d24ff-f8c9-4f3e-8209-c6188679225f service nova] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:56:08.227064 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d24ff-f8c9-4f3e-8209-c6188679225f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:56:08.236214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d24ff-f8c9-4f3e-8209-c6188679225f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:56:08.237822 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d24ff-f8c9-4f3e-8209-c6188679225f service nova] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:56:08.249269 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1127/2261] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:56:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:56:13.450165 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa942a0b-3df6-4d00-b84b-e3da8b1c8cce None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:56:13.450763 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa942a0b-3df6-4d00-b84b-e3da8b1c8cce None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:56:13.450763 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa942a0b-3df6-4d00-b84b-e3da8b1c8cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:56:13.472625 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-aa942a0b-3df6-4d00-b84b-e3da8b1c8cce None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:56:13.473871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-aa942a0b-3df6-4d00-b84b-e3da8b1c8cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:56:13.485650 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1135/2262] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Jul 26 04:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:56:13.531265 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d24ff-f8c9-4f3e-8209-c6188679225f service nova] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:56:13.532923 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-558d24ff-f8c9-4f3e-8209-c6188679225f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:56:13.549649 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d24ff-f8c9-4f3e-8209-c6188679225f service nova] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:56:13.556842 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26e4cd-11d3-430d-857b-0bd6e631d791 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:56:13.557631 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26e4cd-11d3-430d-857b-0bd6e631d791 service nova] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:56:13.557908 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26e4cd-11d3-430d-857b-0bd6e631d791 service nova] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:56:13.558212 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26e4cd-11d3-430d-857b-0bd6e631d791 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:56:13.568216 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26e4cd-11d3-430d-857b-0bd6e631d791 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:56:13.570005 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26e4cd-11d3-430d-857b-0bd6e631d791 service nova] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:56:13.581589 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1128/2263] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:56:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:56:17.560601 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68516222-7fd4-48d5-be19-8b6b0f028216 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:56:17.561232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68516222-7fd4-48d5-be19-8b6b0f028216 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:56:17.561232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68516222-7fd4-48d5-be19-8b6b0f028216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:56:17.582060 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-68516222-7fd4-48d5-be19-8b6b0f028216 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:56:17.583369 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-68516222-7fd4-48d5-be19-8b6b0f028216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:56:17.591935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1136/2264] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Jul 26 04:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:56:17.616817 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26e4cd-11d3-430d-857b-0bd6e631d791 service nova] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:56:17.632257 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26e4cd-11d3-430d-857b-0bd6e631d791 service nova] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:56:17.638544 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6798e-1935-40d9-b117-b6003da1b6d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:56:17.639120 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6798e-1935-40d9-b117-b6003da1b6d5 service nova] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:56:17.639404 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6798e-1935-40d9-b117-b6003da1b6d5 service nova] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:56:17.639672 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6798e-1935-40d9-b117-b6003da1b6d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:56:17.649228 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b6798e-1935-40d9-b117-b6003da1b6d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:56:17.650902 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b6798e-1935-40d9-b117-b6003da1b6d5 service nova] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:56:17.661851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1129/2265] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:56:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:56:18.905263 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48233e8-1789-4213-93c4-0af53d843160 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:56:18.905807 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48233e8-1789-4213-93c4-0af53d843160 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:56:18.905807 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48233e8-1789-4213-93c4-0af53d843160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:56:18.927054 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-d48233e8-1789-4213-93c4-0af53d843160 None None] MFA Rules not processed for user `c3274391c65b4eeab0fcf22ca4f8b791`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:56:18.928324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-d48233e8-1789-4213-93c4-0af53d843160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:56:18.941567 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:56:18.999570 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1137/2266] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:56:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:56:21.774995 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280a69a-cbd3-47aa-a54d-389c3751b836 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:56:21.775636 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280a69a-cbd3-47aa-a54d-389c3751b836 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:56:21.775636 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280a69a-cbd3-47aa-a54d-389c3751b836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:56:21.801140 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-6280a69a-cbd3-47aa-a54d-389c3751b836 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:56:21.803144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-6280a69a-cbd3-47aa-a54d-389c3751b836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:56:21.812522 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1130/2267] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Jul 26 04:56:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:56:21.843292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48233e8-1789-4213-93c4-0af53d843160 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:56:21.856887 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48233e8-1789-4213-93c4-0af53d843160 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:56:21.863119 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec0f57-5435-49bb-abbb-971392fe773c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:56:21.863764 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec0f57-5435-49bb-abbb-971392fe773c service nova] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:56:21.864780 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec0f57-5435-49bb-abbb-971392fe773c service nova] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:56:21.865422 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec0f57-5435-49bb-abbb-971392fe773c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:56:21.875158 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec0f57-5435-49bb-abbb-971392fe773c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:56:21.877112 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec0f57-5435-49bb-abbb-971392fe773c service nova] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:56:21.895492 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1138/2268] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:56:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:56:25.980627 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf0fce-4deb-4440-8cf5-e1c522630057 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:56:25.981218 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf0fce-4deb-4440-8cf5-e1c522630057 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:56:25.981218 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf0fce-4deb-4440-8cf5-e1c522630057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:56:26.001727 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-eebf0fce-4deb-4440-8cf5-e1c522630057 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:56:26.002989 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-eebf0fce-4deb-4440-8cf5-e1c522630057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:56:26.011804 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1131/2269] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Jul 26 04:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:56:26.037214 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec0f57-5435-49bb-abbb-971392fe773c service nova] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:56:26.049005 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec0f57-5435-49bb-abbb-971392fe773c service nova] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:56:26.055979 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39277c4-572d-483a-9349-f94d9ded27b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:56:26.056595 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39277c4-572d-483a-9349-f94d9ded27b9 service nova] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:56:26.056876 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39277c4-572d-483a-9349-f94d9ded27b9 service nova] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:56:26.057148 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39277c4-572d-483a-9349-f94d9ded27b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:56:26.066325 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39277c4-572d-483a-9349-f94d9ded27b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:56:26.067936 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39277c4-572d-483a-9349-f94d9ded27b9 service nova] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:56:26.077951 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1139/2270] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:56:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:56:35.996296 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=25 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:56:36.073603 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=29 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:56:43.760196 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdef86b-3bc7-4334-bfa1-e3f6b962bd07 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:56:43.760567 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdef86b-3bc7-4334-bfa1-e3f6b962bd07 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:56:43.760656 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdef86b-3bc7-4334-bfa1-e3f6b962bd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:56:43.781584 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-7fdef86b-3bc7-4334-bfa1-e3f6b962bd07 None None] MFA Rules not processed for user `8b912bfd686648fa9aae1dca24c78697`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:56:43.783118 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-7fdef86b-3bc7-4334-bfa1-e3f6b962bd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:56:43.841641 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1132/2271] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:56:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:56:53.834950 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=25 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:56:54.624232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e2464-e833-49b3-ad50-b0a37f3a7b3b None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:56:54.624815 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e2464-e833-49b3-ad50-b0a37f3a7b3b None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:56:54.624815 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e2464-e833-49b3-ad50-b0a37f3a7b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:56:54.644519 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-1e7e2464-e833-49b3-ad50-b0a37f3a7b3b None None] MFA Rules not processed for user `c01c17a9cf7e485da50e80b139cf19eb`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:56:54.645712 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-1e7e2464-e833-49b3-ad50-b0a37f3a7b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:56:54.701013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1140/2272] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:56:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:57:00.544996 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdef86b-3bc7-4334-bfa1-e3f6b962bd07 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:57:00.546681 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-7fdef86b-3bc7-4334-bfa1-e3f6b962bd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:57:00.564542 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdef86b-3bc7-4334-bfa1-e3f6b962bd07 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:57:00.569362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff802c2-9f0d-4b0f-8751-ac6d906df490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:57:00.570063 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff802c2-9f0d-4b0f-8751-ac6d906df490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:57:00.570344 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff802c2-9f0d-4b0f-8751-ac6d906df490 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:57:00.571272 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff802c2-9f0d-4b0f-8751-ac6d906df490 admin admin] PATH_INFO: `/v3/users/b1977b61158e47729cd8602e9593ff5c` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:57:00.572463 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff802c2-9f0d-4b0f-8751-ac6d906df490 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1977b61158e47729cd8602e9593ff5c)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:57:00.574425 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff802c2-9f0d-4b0f-8751-ac6d906df490 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:57:00.628790 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-bff802c2-9f0d-4b0f-8751-ac6d906df490 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1977b61158e47729cd8602e9593ff5c'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:57:00.637928 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-bff802c2-9f0d-4b0f-8751-ac6d906df490 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1977b61158e47729cd8602e9593ff5c'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:57:00.650467 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-bff802c2-9f0d-4b0f-8751-ac6d906df490 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1977b61158e47729cd8602e9593ff5c'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:57:00.657451 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-bff802c2-9f0d-4b0f-8751-ac6d906df490 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1977b61158e47729cd8602e9593ff5c'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:57:00.658219 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-bff802c2-9f0d-4b0f-8751-ac6d906df490 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1977b61158e47729cd8602e9593ff5c'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:57:00.664374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1133/2273] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:57:00 2022] DELETE /identity/v3/users/b1977b61158e47729cd8602e9593ff5c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:57:00.859946 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e2464-e833-49b3-ad50-b0a37f3a7b3b None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:57:00.873424 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e2464-e833-49b3-ad50-b0a37f3a7b3b None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:57:00.934161 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217fc79-2a5c-4df2-8bd3-d3b0c847a801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:57:00.934836 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217fc79-2a5c-4df2-8bd3-d3b0c847a801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:57:00.935180 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217fc79-2a5c-4df2-8bd3-d3b0c847a801 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:57:00.935447 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217fc79-2a5c-4df2-8bd3-d3b0c847a801 admin admin] PATH_INFO: `/v3/projects/8e6f8d5eb0ae4c479a4f6df4a4eb8d4e` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:57:00.936744 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217fc79-2a5c-4df2-8bd3-d3b0c847a801 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e6f8d5eb0ae4c479a4f6df4a4eb8d4e)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:57:00.938836 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217fc79-2a5c-4df2-8bd3-d3b0c847a801 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:57:01.005128 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-a217fc79-2a5c-4df2-8bd3-d3b0c847a801 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e6f8d5eb0ae4c479a4f6df4a4eb8d4e', 'request_id': 'req-a217fc79-2a5c-4df2-8bd3-d3b0c847a801'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:57:01.015268 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-a217fc79-2a5c-4df2-8bd3-d3b0c847a801 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e6f8d5eb0ae4c479a4f6df4a4eb8d4e', 'request_id': 'req-a217fc79-2a5c-4df2-8bd3-d3b0c847a801'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:57:01.021933 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-a217fc79-2a5c-4df2-8bd3-d3b0c847a801 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e6f8d5eb0ae4c479a4f6df4a4eb8d4e', 'request_id': 'req-a217fc79-2a5c-4df2-8bd3-d3b0c847a801'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:57:01.033231 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-a217fc79-2a5c-4df2-8bd3-d3b0c847a801 admin admin] The token cache is being invalidate because project 8e6f8d5eb0ae4c479a4f6df4a4eb8d4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:57:01.033518 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-a217fc79-2a5c-4df2-8bd3-d3b0c847a801 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:57:01.034239 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-a217fc79-2a5c-4df2-8bd3-d3b0c847a801 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:57:01.035829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1141/2274] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:57:00 2022] DELETE /identity/v3/projects/8e6f8d5eb0ae4c479a4f6df4a4eb8d4e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:57:10.660881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:57:11.030082 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:57:29.618301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff802c2-9f0d-4b0f-8751-ac6d906df490 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:57:29.619855 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-bff802c2-9f0d-4b0f-8751-ac6d906df490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:57:29.693392 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff802c2-9f0d-4b0f-8751-ac6d906df490 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:57:29.747863 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf27325-428c-4318-a0f3-d898b5fb716d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:57:29.748496 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf27325-428c-4318-a0f3-d898b5fb716d service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:57:29.748778 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf27325-428c-4318-a0f3-d898b5fb716d service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:57:29.749050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf27325-428c-4318-a0f3-d898b5fb716d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:57:29.751005 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-fcf27325-428c-4318-a0f3-d898b5fb716d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:57:29.822086 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf27325-428c-4318-a0f3-d898b5fb716d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:57:29.823463 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf27325-428c-4318-a0f3-d898b5fb716d service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:57:29.834695 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1134/2275] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:57:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:57:31.849135 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217fc79-2a5c-4df2-8bd3-d3b0c847a801 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:57:31.850791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-a217fc79-2a5c-4df2-8bd3-d3b0c847a801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:57:31.864891 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217fc79-2a5c-4df2-8bd3-d3b0c847a801 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:57:31.870035 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ea9c2-b857-4c3a-88eb-94b49522e0f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:57:31.870680 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ea9c2-b857-4c3a-88eb-94b49522e0f1 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:57:31.870962 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ea9c2-b857-4c3a-88eb-94b49522e0f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:57:31.871235 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ea9c2-b857-4c3a-88eb-94b49522e0f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:57:31.873111 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-fb8ea9c2-b857-4c3a-88eb-94b49522e0f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:57:31.887704 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ea9c2-b857-4c3a-88eb-94b49522e0f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:57:31.889292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ea9c2-b857-4c3a-88eb-94b49522e0f1 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:57:31.902285 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1142/2276] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:57:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:57:35.862414 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9fa2d-0b69-4db1-a103-7f98fc8c8441 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:57:35.862937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9fa2d-0b69-4db1-a103-7f98fc8c8441 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:57:35.862937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9fa2d-0b69-4db1-a103-7f98fc8c8441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:57:35.908037 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-60c9fa2d-0b69-4db1-a103-7f98fc8c8441 None None] MFA Rules not processed for user `1395843934af46cc90694bb1c0fc8a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:57:35.909706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-60c9fa2d-0b69-4db1-a103-7f98fc8c8441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:57:35.985878 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1135/2277] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:57:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:57:37.151935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e9553-85e9-430f-82c8-c0467791b494 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:57:37.152437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e9553-85e9-430f-82c8-c0467791b494 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:57:37.152535 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e9553-85e9-430f-82c8-c0467791b494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:57:37.173279 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-fa3e9553-85e9-430f-82c8-c0467791b494 None None] MFA Rules not processed for user `c3274391c65b4eeab0fcf22ca4f8b791`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:57:37.174525 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-fa3e9553-85e9-430f-82c8-c0467791b494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:57:37.230947 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1143/2278] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:57:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:57:37.242971 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9fa2d-0b69-4db1-a103-7f98fc8c8441 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:57:37.244484 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-60c9fa2d-0b69-4db1-a103-7f98fc8c8441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:57:37.255754 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:57:37.262957 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9fa2d-0b69-4db1-a103-7f98fc8c8441 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:57:37.275317 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcfa44-7b94-4944-b424-1ded4d0fad18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:57:37.275955 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcfa44-7b94-4944-b424-1ded4d0fad18 service nova] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:57:37.276421 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcfa44-7b94-4944-b424-1ded4d0fad18 service nova] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:57:37.276693 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bcfa44-7b94-4944-b424-1ded4d0fad18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:57:37.278809 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-80bcfa44-7b94-4944-b424-1ded4d0fad18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:57:37.291486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bcfa44-7b94-4944-b424-1ded4d0fad18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:57:37.293383 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bcfa44-7b94-4944-b424-1ded4d0fad18 service nova] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:57:37.303119 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1136/2279] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:57:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:57:47.224040 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=31 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:57:47.298839 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=5 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:57:50.897328 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e9553-85e9-430f-82c8-c0467791b494 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:57:50.899013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-fa3e9553-85e9-430f-82c8-c0467791b494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:57:50.923036 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e9553-85e9-430f-82c8-c0467791b494 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:57:50.933141 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcfa44-7b94-4944-b424-1ded4d0fad18 service nova] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:57:50.935571 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5361c7-5855-4350-aa9e-cd5b6b9cc3a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:57:50.936478 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5361c7-5855-4350-aa9e-cd5b6b9cc3a6 service nova] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:57:50.936927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5361c7-5855-4350-aa9e-cd5b6b9cc3a6 service nova] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:57:50.937655 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5361c7-5855-4350-aa9e-cd5b6b9cc3a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:57:50.940024 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-8e5361c7-5855-4350-aa9e-cd5b6b9cc3a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:57:50.942761 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bcfa44-7b94-4944-b424-1ded4d0fad18 service nova] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:57:50.946591 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b3dbf-c90d-44d0-ba08-8367341b3215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:57:50.947217 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b3dbf-c90d-44d0-ba08-8367341b3215 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:57:50.947500 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b3dbf-c90d-44d0-ba08-8367341b3215 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:57:50.947803 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b3dbf-c90d-44d0-ba08-8367341b3215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:57:50.949556 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-431b3dbf-c90d-44d0-ba08-8367341b3215 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:57:51.012303 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5361c7-5855-4350-aa9e-cd5b6b9cc3a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:57:51.013943 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5361c7-5855-4350-aa9e-cd5b6b9cc3a6 service nova] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:57:51.021543 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b3dbf-c90d-44d0-ba08-8367341b3215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:57:51.023035 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b3dbf-c90d-44d0-ba08-8367341b3215 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:57:51.023649 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1144/2280] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:57:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:57:51.034160 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1137/2281] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:57:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:57:55.387010 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5361c7-5855-4350-aa9e-cd5b6b9cc3a6 service nova] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:57:55.391617 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-8e5361c7-5855-4350-aa9e-cd5b6b9cc3a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:57:55.414129 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5361c7-5855-4350-aa9e-cd5b6b9cc3a6 service nova] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:57:55.421002 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f837f1-a65b-413a-94f6-3a12f555a70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:57:55.421751 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f837f1-a65b-413a-94f6-3a12f555a70e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:57:55.422136 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f837f1-a65b-413a-94f6-3a12f555a70e admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:57:55.422622 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f837f1-a65b-413a-94f6-3a12f555a70e admin admin] PATH_INFO: `/v3/users/8b912bfd686648fa9aae1dca24c78697` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:57:55.423842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f837f1-a65b-413a-94f6-3a12f555a70e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b912bfd686648fa9aae1dca24c78697)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:57:55.425909 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f837f1-a65b-413a-94f6-3a12f555a70e admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:57:55.478778 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-83f837f1-a65b-413a-94f6-3a12f555a70e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b912bfd686648fa9aae1dca24c78697'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:57:55.479545 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-83f837f1-a65b-413a-94f6-3a12f555a70e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b912bfd686648fa9aae1dca24c78697'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:57:55.489207 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-83f837f1-a65b-413a-94f6-3a12f555a70e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b912bfd686648fa9aae1dca24c78697'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:57:55.506445 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-83f837f1-a65b-413a-94f6-3a12f555a70e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b912bfd686648fa9aae1dca24c78697'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:57:55.515042 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-83f837f1-a65b-413a-94f6-3a12f555a70e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b912bfd686648fa9aae1dca24c78697'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:57:55.523784 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1145/2282] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:57:55 2022] DELETE /identity/v3/users/8b912bfd686648fa9aae1dca24c78697 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:57:55.818703 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b3dbf-c90d-44d0-ba08-8367341b3215 service neutron] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:57:55.839207 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b3dbf-c90d-44d0-ba08-8367341b3215 service neutron] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:57:55.906502 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeca928-b974-4ddc-b00d-2e60ae188923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:57:55.907218 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeca928-b974-4ddc-b00d-2e60ae188923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:57:55.907506 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeca928-b974-4ddc-b00d-2e60ae188923 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:57:55.907777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeca928-b974-4ddc-b00d-2e60ae188923 admin admin] PATH_INFO: `/v3/projects/67113d9f19aa44fda88cc66b6012b9cd` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:57:55.908990 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeca928-b974-4ddc-b00d-2e60ae188923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67113d9f19aa44fda88cc66b6012b9cd)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:57:55.911041 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeca928-b974-4ddc-b00d-2e60ae188923 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:57:55.964667 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-feeca928-b974-4ddc-b00d-2e60ae188923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67113d9f19aa44fda88cc66b6012b9cd', 'request_id': 'req-feeca928-b974-4ddc-b00d-2e60ae188923'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:57:55.973593 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-feeca928-b974-4ddc-b00d-2e60ae188923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67113d9f19aa44fda88cc66b6012b9cd', 'request_id': 'req-feeca928-b974-4ddc-b00d-2e60ae188923'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:57:55.979809 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-feeca928-b974-4ddc-b00d-2e60ae188923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67113d9f19aa44fda88cc66b6012b9cd', 'request_id': 'req-feeca928-b974-4ddc-b00d-2e60ae188923'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:57:55.991589 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-feeca928-b974-4ddc-b00d-2e60ae188923 admin admin] The token cache is being invalidate because project 67113d9f19aa44fda88cc66b6012b9cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:57:55.991914 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-feeca928-b974-4ddc-b00d-2e60ae188923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:57:55.992713 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-feeca928-b974-4ddc-b00d-2e60ae188923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:57:55.995365 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1138/2283] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:57:55 2022] DELETE /identity/v3/projects/67113d9f19aa44fda88cc66b6012b9cd => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:57:56.000178 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241d4a4-b08f-48f6-bd2a-078fd6d233a5 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:57:56.000491 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241d4a4-b08f-48f6-bd2a-078fd6d233a5 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:57:56.000774 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241d4a4-b08f-48f6-bd2a-078fd6d233a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:57:56.022877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-a241d4a4-b08f-48f6-bd2a-078fd6d233a5 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:57:56.024110 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-a241d4a4-b08f-48f6-bd2a-078fd6d233a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:57:56.096559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1146/2284] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:57:56.101245 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede2e0f-ae10-4a34-8421-c19497903f78 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:57:56.101648 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede2e0f-ae10-4a34-8421-c19497903f78 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:57:56.101933 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede2e0f-ae10-4a34-8421-c19497903f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:57:56.125563 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-5ede2e0f-ae10-4a34-8421-c19497903f78 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:57:56.126898 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-5ede2e0f-ae10-4a34-8421-c19497903f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:57:56.135306 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1139/2285] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:57:56.140017 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241d4a4-b08f-48f6-bd2a-078fd6d233a5 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:57:56.150670 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241d4a4-b08f-48f6-bd2a-078fd6d233a5 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:57:56.156322 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42e057-c339-448c-b901-e40cf3319b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:57:56.156954 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42e057-c339-448c-b901-e40cf3319b2a admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:57:56.157299 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42e057-c339-448c-b901-e40cf3319b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:57:56.157540 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42e057-c339-448c-b901-e40cf3319b2a admin admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:57:56.158283 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42e057-c339-448c-b901-e40cf3319b2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:57:56.158654 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42e057-c339-448c-b901-e40cf3319b2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:57:56.160304 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42e057-c339-448c-b901-e40cf3319b2a admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:57:56.167782 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:57:56.173958 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1147/2286] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:57:56.178988 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede2e0f-ae10-4a34-8421-c19497903f78 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:57:56.188877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede2e0f-ae10-4a34-8421-c19497903f78 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:57:56.193787 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ec797-82e5-47b4-a4ba-64bcfb9d696f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:57:56.194447 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ec797-82e5-47b4-a4ba-64bcfb9d696f admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:57:56.194729 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ec797-82e5-47b4-a4ba-64bcfb9d696f admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:57:56.195001 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ec797-82e5-47b4-a4ba-64bcfb9d696f admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:57:56.195677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ec797-82e5-47b4-a4ba-64bcfb9d696f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:57:56.197634 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ec797-82e5-47b4-a4ba-64bcfb9d696f admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:57:56.214730 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:57:56.229220 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1140/2287] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:57:56 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:57:56.233296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42e057-c339-448c-b901-e40cf3319b2a admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:57:56.243874 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42e057-c339-448c-b901-e40cf3319b2a admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:57:56.317582 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fd227-b9de-4d30-9693-55ae8346fcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:57:56.318355 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fd227-b9de-4d30-9693-55ae8346fcaa admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:57:56.318701 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fd227-b9de-4d30-9693-55ae8346fcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:57:56.318982 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fd227-b9de-4d30-9693-55ae8346fcaa admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:57:56.319874 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fd227-b9de-4d30-9693-55ae8346fcaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:57:56.321852 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fd227-b9de-4d30-9693-55ae8346fcaa admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:57:56.346179 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1148/2288] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:57:56 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:57:56.348575 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ec797-82e5-47b4-a4ba-64bcfb9d696f admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:57:56.358942 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ec797-82e5-47b4-a4ba-64bcfb9d696f admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:57:56.363736 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedfa38-430a-43cc-9d0d-09c924b35291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:57:56.364351 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedfa38-430a-43cc-9d0d-09c924b35291 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:57:56.364624 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedfa38-430a-43cc-9d0d-09c924b35291 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:57:56.364924 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedfa38-430a-43cc-9d0d-09c924b35291 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:57:56.365670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedfa38-430a-43cc-9d0d-09c924b35291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:57:56.367315 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedfa38-430a-43cc-9d0d-09c924b35291 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:57:56.385407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1141/2289] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:57:56.386857 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fd227-b9de-4d30-9693-55ae8346fcaa admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:57:56.398541 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fd227-b9de-4d30-9693-55ae8346fcaa admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:57:56.406413 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27312a15-c587-4c8f-a28b-51584320d147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:57:56.407182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27312a15-c587-4c8f-a28b-51584320d147 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:57:56.407513 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27312a15-c587-4c8f-a28b-51584320d147 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:57:56.407992 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27312a15-c587-4c8f-a28b-51584320d147 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:57:56.409025 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27312a15-c587-4c8f-a28b-51584320d147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:57:56.411044 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27312a15-c587-4c8f-a28b-51584320d147 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:57:56.423482 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1149/2290] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:57:56.431092 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedfa38-430a-43cc-9d0d-09c924b35291 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:57:56.442511 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedfa38-430a-43cc-9d0d-09c924b35291 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:57:56.450577 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5656a-7241-45ad-9982-d5ddb2a2669f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:57:56.451281 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5656a-7241-45ad-9982-d5ddb2a2669f admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:57:56.451567 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5656a-7241-45ad-9982-d5ddb2a2669f admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:57:56.451847 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d5656a-7241-45ad-9982-d5ddb2a2669f admin admin] PATH_INFO: `/v3/projects/68253a25ff5d42ada38ca21f4c5b7147/users/05eb0335379e47b19934b3b26f427365/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:57:56.467263 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5656a-7241-45ad-9982-d5ddb2a2669f admin admin] RBAC: Authorizing `identity:create_grant(project_id=68253a25ff5d42ada38ca21f4c5b7147, user_id=05eb0335379e47b19934b3b26f427365, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:57:56.469915 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d5656a-7241-45ad-9982-d5ddb2a2669f admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:57:56.494172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1142/2291] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:57:56 2022] PUT /identity/v3/projects/68253a25ff5d42ada38ca21f4c5b7147/users/05eb0335379e47b19934b3b26f427365/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:57:56.496482 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010db97-e76c-4dd5-8d96-d3049bd935f4 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:57:56.496772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010db97-e76c-4dd5-8d96-d3049bd935f4 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:57:56.497041 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010db97-e76c-4dd5-8d96-d3049bd935f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:57:56.526986 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-0010db97-e76c-4dd5-8d96-d3049bd935f4 None None] MFA Rules not processed for user `05eb0335379e47b19934b3b26f427365`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:57:56.528234 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-0010db97-e76c-4dd5-8d96-d3049bd935f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:57:56.603440 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1150/2292] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:57:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:57:56.607363 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5656a-7241-45ad-9982-d5ddb2a2669f admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:57:56.676953 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d5656a-7241-45ad-9982-d5ddb2a2669f admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:57:56.682053 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced974c0-8683-4f94-80fc-5b040066c921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:57:56.682712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced974c0-8683-4f94-80fc-5b040066c921 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:57:56.682997 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced974c0-8683-4f94-80fc-5b040066c921 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:57:56.683269 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced974c0-8683-4f94-80fc-5b040066c921 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:57:56.683981 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced974c0-8683-4f94-80fc-5b040066c921 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:57:56.685886 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced974c0-8683-4f94-80fc-5b040066c921 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:57:56.728619 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1143/2293] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:57:56 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:57:56.729470 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010db97-e76c-4dd5-8d96-d3049bd935f4 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:57:56.741488 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010db97-e76c-4dd5-8d96-d3049bd935f4 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:57:56.822018 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab71baa-70ed-4648-8c3b-0ccc4984329a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:57:56.824419 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab71baa-70ed-4648-8c3b-0ccc4984329a admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:57:56.825448 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab71baa-70ed-4648-8c3b-0ccc4984329a admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:57:56.825915 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab71baa-70ed-4648-8c3b-0ccc4984329a admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:57:56.826691 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab71baa-70ed-4648-8c3b-0ccc4984329a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:57:56.829657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab71baa-70ed-4648-8c3b-0ccc4984329a admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:57:56.846148 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:57:56.859286 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1151/2294] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:57:56 2022] POST /identity/v3/users => generated 295 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:57:56.863042 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced974c0-8683-4f94-80fc-5b040066c921 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:57:56.876282 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced974c0-8683-4f94-80fc-5b040066c921 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:57:56.882313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aee510-12bc-42c0-bb8f-eb463c4a2ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:57:56.883065 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aee510-12bc-42c0-bb8f-eb463c4a2ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:57:56.883593 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aee510-12bc-42c0-bb8f-eb463c4a2ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:57:56.883936 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aee510-12bc-42c0-bb8f-eb463c4a2ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:57:56.884750 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aee510-12bc-42c0-bb8f-eb463c4a2ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:57:56.887086 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aee510-12bc-42c0-bb8f-eb463c4a2ef1 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:57:56.899590 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1144/2295] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:57:56.904089 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab71baa-70ed-4648-8c3b-0ccc4984329a admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:57:56.915036 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab71baa-70ed-4648-8c3b-0ccc4984329a admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:57:56.920933 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e45465-4b66-4012-b053-163570788907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:57:56.922063 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e45465-4b66-4012-b053-163570788907 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:57:56.922552 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e45465-4b66-4012-b053-163570788907 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:57:56.923039 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e45465-4b66-4012-b053-163570788907 admin admin] PATH_INFO: `/v3/projects/c68f3da4024e4347834b3cbc73645738/users/c943369829f8467c898fdb8df29e6c98/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:57:56.944418 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e45465-4b66-4012-b053-163570788907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c68f3da4024e4347834b3cbc73645738, user_id=c943369829f8467c898fdb8df29e6c98, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:57:56.947399 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e45465-4b66-4012-b053-163570788907 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:57:56.967434 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1152/2296] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:57:56 2022] PUT /identity/v3/projects/c68f3da4024e4347834b3cbc73645738/users/c943369829f8467c898fdb8df29e6c98/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:57:56.968347 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aee510-12bc-42c0-bb8f-eb463c4a2ef1 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:57:56.982902 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aee510-12bc-42c0-bb8f-eb463c4a2ef1 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:57:57.053831 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ce6a8-b403-4366-b9d4-573515c7f04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:57:57.054505 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ce6a8-b403-4366-b9d4-573515c7f04e admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:57:57.055181 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ce6a8-b403-4366-b9d4-573515c7f04e admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:57:57.055181 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ce6a8-b403-4366-b9d4-573515c7f04e admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:57:57.055792 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ce6a8-b403-4366-b9d4-573515c7f04e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:57:57.057418 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ce6a8-b403-4366-b9d4-573515c7f04e admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:57:57.077667 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1145/2297] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:57:57.080064 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e45465-4b66-4012-b053-163570788907 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:57:57.092042 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e45465-4b66-4012-b053-163570788907 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:57:57.098669 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59e783-19d8-40f7-bac6-dedfcd61c8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:57:57.099364 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59e783-19d8-40f7-bac6-dedfcd61c8d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:57:57.099641 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59e783-19d8-40f7-bac6-dedfcd61c8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:57:57.099918 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59e783-19d8-40f7-bac6-dedfcd61c8d9 admin admin] PATH_INFO: `/v3/projects/c68f3da4024e4347834b3cbc73645738/users/c943369829f8467c898fdb8df29e6c98/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:57:57.101913 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59e783-19d8-40f7-bac6-dedfcd61c8d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c68f3da4024e4347834b3cbc73645738, user_id=c943369829f8467c898fdb8df29e6c98, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:57:57.104676 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59e783-19d8-40f7-bac6-dedfcd61c8d9 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:57:57.117755 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1153/2298] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:57:57 2022] PUT /identity/v3/projects/c68f3da4024e4347834b3cbc73645738/users/c943369829f8467c898fdb8df29e6c98/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:57:57.129618 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add127e3-9459-4edf-a4c0-becceacf3385 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:57:57.130001 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add127e3-9459-4edf-a4c0-becceacf3385 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:57:57.130273 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add127e3-9459-4edf-a4c0-becceacf3385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:57:57.160250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-add127e3-9459-4edf-a4c0-becceacf3385 None None] MFA Rules not processed for user `c943369829f8467c898fdb8df29e6c98`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:57:57.161584 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-add127e3-9459-4edf-a4c0-becceacf3385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:57:57.181750 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:57:57.238860 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1146/2299] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:57:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:57:57.250168 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59e783-19d8-40f7-bac6-dedfcd61c8d9 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:57:57.251869 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-2c59e783-19d8-40f7-bac6-dedfcd61c8d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:57:57.326568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59e783-19d8-40f7-bac6-dedfcd61c8d9 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:57:57.330384 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312982f-af65-42f0-bb9e-db17461b10f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:57:57.331057 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312982f-af65-42f0-bb9e-db17461b10f7 service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:57:57.331330 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312982f-af65-42f0-bb9e-db17461b10f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:57:57.331605 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2312982f-af65-42f0-bb9e-db17461b10f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:57:57.398438 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2312982f-af65-42f0-bb9e-db17461b10f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:57:57.400087 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2312982f-af65-42f0-bb9e-db17461b10f7 service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:57:57.410551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1154/2300] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:57:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:58:00.016885 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add127e3-9459-4edf-a4c0-becceacf3385 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:00.032687 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add127e3-9459-4edf-a4c0-becceacf3385 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:00.037924 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780c22f-be04-4c68-8f51-dcfda77d18a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:00.038570 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780c22f-be04-4c68-8f51-dcfda77d18a9 service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:00.038846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780c22f-be04-4c68-8f51-dcfda77d18a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:00.039128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780c22f-be04-4c68-8f51-dcfda77d18a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:00.048932 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780c22f-be04-4c68-8f51-dcfda77d18a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:00.050429 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780c22f-be04-4c68-8f51-dcfda77d18a9 service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:00.060275 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1147/2301] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:58:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:58:05.669265 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312982f-af65-42f0-bb9e-db17461b10f7 service cinder] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:05.670756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-2312982f-af65-42f0-bb9e-db17461b10f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:05.748032 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2312982f-af65-42f0-bb9e-db17461b10f7 service cinder] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:05.753092 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736971fe-e8de-4ccc-a6a7-f408965223c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21dfe7b4d6524ec2885224d77395b00b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:05.753971 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736971fe-e8de-4ccc-a6a7-f408965223c5 service placement] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:05.753971 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736971fe-e8de-4ccc-a6a7-f408965223c5 service placement] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:05.754323 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736971fe-e8de-4ccc-a6a7-f408965223c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:05.756188 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-736971fe-e8de-4ccc-a6a7-f408965223c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:05.768950 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736971fe-e8de-4ccc-a6a7-f408965223c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:05.771072 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736971fe-e8de-4ccc-a6a7-f408965223c5 service placement] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:05.782064 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1155/2302] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:58:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:58:09.492534 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780c22f-be04-4c68-8f51-dcfda77d18a9 service cinder] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:09.495306 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-0780c22f-be04-4c68-8f51-dcfda77d18a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:09.559208 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780c22f-be04-4c68-8f51-dcfda77d18a9 service cinder] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:09.562770 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c5761-4a11-4b26-bff3-179f97592955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:09.563390 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c5761-4a11-4b26-bff3-179f97592955 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:09.563667 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c5761-4a11-4b26-bff3-179f97592955 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:09.563935 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c5761-4a11-4b26-bff3-179f97592955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:09.565831 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-dc8c5761-4a11-4b26-bff3-179f97592955 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:09.577053 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c5761-4a11-4b26-bff3-179f97592955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:09.578716 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c5761-4a11-4b26-bff3-179f97592955 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:09.587609 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1148/2303] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:58:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:58:12.369903 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c98f2-992a-436a-a20c-b9c813f68cb5 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:12.370415 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c98f2-992a-436a-a20c-b9c813f68cb5 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:12.370536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432c98f2-992a-436a-a20c-b9c813f68cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:12.378628 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:12.396798 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-432c98f2-992a-436a-a20c-b9c813f68cb5 None None] MFA Rules not processed for user `b613dee1148c4822af2e7847b28cf4aa`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:58:12.398585 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-432c98f2-992a-436a-a20c-b9c813f68cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:12.464236 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1156/2304] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Jul 26 04:58:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:58:12.529438 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c5761-4a11-4b26-bff3-179f97592955 service neutron] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:12.531090 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-dc8c5761-4a11-4b26-bff3-179f97592955 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:12.610972 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c5761-4a11-4b26-bff3-179f97592955 service neutron] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:12.616193 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803961d9-d852-4beb-b133-bfecce8e7ca1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e089e39e9de419b9e2fb1d7fc2d245a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:12.616836 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803961d9-d852-4beb-b133-bfecce8e7ca1 service swift] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:12.617122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803961d9-d852-4beb-b133-bfecce8e7ca1 service swift] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:12.617398 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803961d9-d852-4beb-b133-bfecce8e7ca1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:12.627621 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803961d9-d852-4beb-b133-bfecce8e7ca1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:12.629317 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803961d9-d852-4beb-b133-bfecce8e7ca1 service swift] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:12.640133 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1149/2305] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 04:58:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 04:58:12.791979 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c98f2-992a-436a-a20c-b9c813f68cb5 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:12.890292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432c98f2-992a-436a-a20c-b9c813f68cb5 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:12.895779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34852bc3-b9e7-4cd8-adb4-3f3be951c6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:12.896952 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34852bc3-b9e7-4cd8-adb4-3f3be951c6e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:12.897408 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34852bc3-b9e7-4cd8-adb4-3f3be951c6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:12.897853 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34852bc3-b9e7-4cd8-adb4-3f3be951c6e0 admin admin] PATH_INFO: `/v3/users/05eb0335379e47b19934b3b26f427365` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:12.899484 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34852bc3-b9e7-4cd8-adb4-3f3be951c6e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05eb0335379e47b19934b3b26f427365)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:12.901875 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34852bc3-b9e7-4cd8-adb4-3f3be951c6e0 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:12.986350 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-34852bc3-b9e7-4cd8-adb4-3f3be951c6e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05eb0335379e47b19934b3b26f427365'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:12.987203 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-34852bc3-b9e7-4cd8-adb4-3f3be951c6e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05eb0335379e47b19934b3b26f427365'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:13.002485 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-34852bc3-b9e7-4cd8-adb4-3f3be951c6e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05eb0335379e47b19934b3b26f427365'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:13.027932 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-34852bc3-b9e7-4cd8-adb4-3f3be951c6e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05eb0335379e47b19934b3b26f427365'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:13.058921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-34852bc3-b9e7-4cd8-adb4-3f3be951c6e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05eb0335379e47b19934b3b26f427365'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:13.068349 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1157/2306] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:58:12 2022] DELETE /identity/v3/users/05eb0335379e47b19934b3b26f427365 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:58:13.073084 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5444ff-a0c4-445e-9afd-6dd37f52816a None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:13.073541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5444ff-a0c4-445e-9afd-6dd37f52816a None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:13.073819 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5444ff-a0c4-445e-9afd-6dd37f52816a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:13.097126 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-5a5444ff-a0c4-445e-9afd-6dd37f52816a None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:58:13.098885 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-5a5444ff-a0c4-445e-9afd-6dd37f52816a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:13.141522 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:13.174195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1150/2307] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:58:13.184625 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34852bc3-b9e7-4cd8-adb4-3f3be951c6e0 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:13.186287 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-34852bc3-b9e7-4cd8-adb4-3f3be951c6e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:13.230871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:13.271384 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34852bc3-b9e7-4cd8-adb4-3f3be951c6e0 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:13.275660 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335b59e-dc5d-4145-8f30-50f15cff7440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:13.276295 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335b59e-dc5d-4145-8f30-50f15cff7440 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:13.276862 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335b59e-dc5d-4145-8f30-50f15cff7440 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:13.277152 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335b59e-dc5d-4145-8f30-50f15cff7440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:13.292097 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335b59e-dc5d-4145-8f30-50f15cff7440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:13.293875 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335b59e-dc5d-4145-8f30-50f15cff7440 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:13.305611 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1158/2308] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:58:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:58:13.693727 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5444ff-a0c4-445e-9afd-6dd37f52816a None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:13.695293 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-5a5444ff-a0c4-445e-9afd-6dd37f52816a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:13.712740 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5444ff-a0c4-445e-9afd-6dd37f52816a None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:13.721272 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1f799-71a5-4f39-b542-e9dac88d8ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:13.723372 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1f799-71a5-4f39-b542-e9dac88d8ab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:13.723921 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1f799-71a5-4f39-b542-e9dac88d8ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:13.724317 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1f799-71a5-4f39-b542-e9dac88d8ab5 admin admin] PATH_INFO: `/v3/projects/68253a25ff5d42ada38ca21f4c5b7147` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:13.725962 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1f799-71a5-4f39-b542-e9dac88d8ab5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68253a25ff5d42ada38ca21f4c5b7147)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:13.728779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1f799-71a5-4f39-b542-e9dac88d8ab5 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:13.790872 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-fca1f799-71a5-4f39-b542-e9dac88d8ab5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68253a25ff5d42ada38ca21f4c5b7147', 'request_id': 'req-fca1f799-71a5-4f39-b542-e9dac88d8ab5'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:13.801893 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-fca1f799-71a5-4f39-b542-e9dac88d8ab5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68253a25ff5d42ada38ca21f4c5b7147', 'request_id': 'req-fca1f799-71a5-4f39-b542-e9dac88d8ab5'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:13.808489 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-fca1f799-71a5-4f39-b542-e9dac88d8ab5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68253a25ff5d42ada38ca21f4c5b7147', 'request_id': 'req-fca1f799-71a5-4f39-b542-e9dac88d8ab5'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:13.820191 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-fca1f799-71a5-4f39-b542-e9dac88d8ab5 admin admin] The token cache is being invalidate because project 68253a25ff5d42ada38ca21f4c5b7147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:58:13.820477 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-fca1f799-71a5-4f39-b542-e9dac88d8ab5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:13.821261 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-fca1f799-71a5-4f39-b542-e9dac88d8ab5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:13.823143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1151/2309] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:58:13 2022] DELETE /identity/v3/projects/68253a25ff5d42ada38ca21f4c5b7147 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:58:13.827073 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335b59e-dc5d-4145-8f30-50f15cff7440 service neutron] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:13.842177 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335b59e-dc5d-4145-8f30-50f15cff7440 service neutron] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:13.917420 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24e05b-23e5-4b7e-9dcb-e6b6562d4ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:13.918117 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24e05b-23e5-4b7e-9dcb-e6b6562d4ae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:13.918400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24e05b-23e5-4b7e-9dcb-e6b6562d4ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:13.918676 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24e05b-23e5-4b7e-9dcb-e6b6562d4ae6 admin admin] PATH_INFO: `/v3/users/c943369829f8467c898fdb8df29e6c98` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:13.919976 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24e05b-23e5-4b7e-9dcb-e6b6562d4ae6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c943369829f8467c898fdb8df29e6c98)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:13.922171 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24e05b-23e5-4b7e-9dcb-e6b6562d4ae6 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:13.979631 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-1c24e05b-23e5-4b7e-9dcb-e6b6562d4ae6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c943369829f8467c898fdb8df29e6c98'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:13.980320 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-1c24e05b-23e5-4b7e-9dcb-e6b6562d4ae6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c943369829f8467c898fdb8df29e6c98'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:13.991742 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-1c24e05b-23e5-4b7e-9dcb-e6b6562d4ae6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c943369829f8467c898fdb8df29e6c98'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:14.009147 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-1c24e05b-23e5-4b7e-9dcb-e6b6562d4ae6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c943369829f8467c898fdb8df29e6c98'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:14.024069 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-1c24e05b-23e5-4b7e-9dcb-e6b6562d4ae6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c943369829f8467c898fdb8df29e6c98'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:14.030986 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1159/2310] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:58:13 2022] DELETE /identity/v3/users/c943369829f8467c898fdb8df29e6c98 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:58:14.365642 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1f799-71a5-4f39-b542-e9dac88d8ab5 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:14.367100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-fca1f799-71a5-4f39-b542-e9dac88d8ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:14.395741 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1f799-71a5-4f39-b542-e9dac88d8ab5 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:14.479176 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac91c8-e8f9-4084-a831-d70452c1d7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:14.480250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac91c8-e8f9-4084-a831-d70452c1d7c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:14.480712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac91c8-e8f9-4084-a831-d70452c1d7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:14.481162 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac91c8-e8f9-4084-a831-d70452c1d7c9 admin admin] PATH_INFO: `/v3/projects/c68f3da4024e4347834b3cbc73645738` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:14.482588 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac91c8-e8f9-4084-a831-d70452c1d7c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c68f3da4024e4347834b3cbc73645738)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:14.484514 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac91c8-e8f9-4084-a831-d70452c1d7c9 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:14.565693 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-92ac91c8-e8f9-4084-a831-d70452c1d7c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c68f3da4024e4347834b3cbc73645738', 'request_id': 'req-92ac91c8-e8f9-4084-a831-d70452c1d7c9'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:14.577723 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-92ac91c8-e8f9-4084-a831-d70452c1d7c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c68f3da4024e4347834b3cbc73645738', 'request_id': 'req-92ac91c8-e8f9-4084-a831-d70452c1d7c9'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:14.588314 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:14.589836 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-92ac91c8-e8f9-4084-a831-d70452c1d7c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c68f3da4024e4347834b3cbc73645738', 'request_id': 'req-92ac91c8-e8f9-4084-a831-d70452c1d7c9'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:14.633354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-92ac91c8-e8f9-4084-a831-d70452c1d7c9 admin admin] The token cache is being invalidate because project c68f3da4024e4347834b3cbc73645738 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:58:14.633990 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-92ac91c8-e8f9-4084-a831-d70452c1d7c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:14.634966 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-92ac91c8-e8f9-4084-a831-d70452c1d7c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:14.637296 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1152/2311] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:58:14 2022] DELETE /identity/v3/projects/c68f3da4024e4347834b3cbc73645738 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:58:14.644387 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862485cc-f558-4b16-99e8-fa709550411e None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:14.644687 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862485cc-f558-4b16-99e8-fa709550411e None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:14.644967 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862485cc-f558-4b16-99e8-fa709550411e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:14.690782 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-862485cc-f558-4b16-99e8-fa709550411e None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:58:14.692072 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-862485cc-f558-4b16-99e8-fa709550411e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:14.745232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:14.774346 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1160/2312] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:58:14.778171 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d1b8f-547e-45b0-9ff6-4cc0eecd69ef None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:14.778789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d1b8f-547e-45b0-9ff6-4cc0eecd69ef None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:14.779382 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d1b8f-547e-45b0-9ff6-4cc0eecd69ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:14.805255 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-902d1b8f-547e-45b0-9ff6-4cc0eecd69ef None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:58:14.806896 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-902d1b8f-547e-45b0-9ff6-4cc0eecd69ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:14.826608 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862485cc-f558-4b16-99e8-fa709550411e None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:14.827353 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1153/2313] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:58:14.837482 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862485cc-f558-4b16-99e8-fa709550411e None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:14.843547 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4d34d-08b0-4f69-a9cc-1c804d39eecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:14.844136 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4d34d-08b0-4f69-a9cc-1c804d39eecb admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:14.844418 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4d34d-08b0-4f69-a9cc-1c804d39eecb admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:14.844834 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd4d34d-08b0-4f69-a9cc-1c804d39eecb admin admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:14.845554 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4d34d-08b0-4f69-a9cc-1c804d39eecb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:58:14.846614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4d34d-08b0-4f69-a9cc-1c804d39eecb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:14.847535 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd4d34d-08b0-4f69-a9cc-1c804d39eecb admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:14.861863 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1161/2314] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:58:14.868008 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d1b8f-547e-45b0-9ff6-4cc0eecd69ef None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:14.879253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d1b8f-547e-45b0-9ff6-4cc0eecd69ef None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:14.887766 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e86d4-2f75-4346-8df2-497bd712769b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:14.888425 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e86d4-2f75-4346-8df2-497bd712769b admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:14.888706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e86d4-2f75-4346-8df2-497bd712769b admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:14.888982 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e86d4-2f75-4346-8df2-497bd712769b admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:14.889668 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e86d4-2f75-4346-8df2-497bd712769b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:14.891723 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e86d4-2f75-4346-8df2-497bd712769b admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:14.935262 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1154/2315] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:58:14 2022] POST /identity/v3/projects => generated 393 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:58:14.936649 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4d34d-08b0-4f69-a9cc-1c804d39eecb admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:14.947774 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd4d34d-08b0-4f69-a9cc-1c804d39eecb admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:15.015337 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f199a-b52d-4c3f-a738-112af51ba0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:15.015885 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f199a-b52d-4c3f-a738-112af51ba0bb admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:15.016186 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f199a-b52d-4c3f-a738-112af51ba0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:15.016463 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f199a-b52d-4c3f-a738-112af51ba0bb admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:15.017216 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f199a-b52d-4c3f-a738-112af51ba0bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:15.019217 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f199a-b52d-4c3f-a738-112af51ba0bb admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:15.045412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1162/2316] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:58:14 2022] POST /identity/v3/users => generated 297 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:58:15.049746 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e86d4-2f75-4346-8df2-497bd712769b admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:15.061224 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e86d4-2f75-4346-8df2-497bd712769b admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:15.067482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06da2cd-a082-423b-9066-f239be7ce366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:15.068104 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06da2cd-a082-423b-9066-f239be7ce366 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:15.068661 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06da2cd-a082-423b-9066-f239be7ce366 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:15.068661 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06da2cd-a082-423b-9066-f239be7ce366 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:15.069533 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06da2cd-a082-423b-9066-f239be7ce366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:15.071207 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06da2cd-a082-423b-9066-f239be7ce366 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:15.089526 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f199a-b52d-4c3f-a738-112af51ba0bb admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:15.089734 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1155/2317] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:58:15.100743 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f199a-b52d-4c3f-a738-112af51ba0bb admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:15.109422 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a907f-c525-4ccb-bb56-3147d2daa969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:15.110116 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a907f-c525-4ccb-bb56-3147d2daa969 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:15.112796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a907f-c525-4ccb-bb56-3147d2daa969 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:15.113219 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a907f-c525-4ccb-bb56-3147d2daa969 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:15.114158 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a907f-c525-4ccb-bb56-3147d2daa969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:15.115829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a907f-c525-4ccb-bb56-3147d2daa969 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:15.134511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1163/2318] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:58:15.140874 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06da2cd-a082-423b-9066-f239be7ce366 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:15.154976 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06da2cd-a082-423b-9066-f239be7ce366 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:15.160219 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd12ba-7847-44e6-9a9b-9eb4036f7f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:15.161103 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd12ba-7847-44e6-9a9b-9eb4036f7f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:15.161384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd12ba-7847-44e6-9a9b-9eb4036f7f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:15.161659 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd12ba-7847-44e6-9a9b-9eb4036f7f09 admin admin] PATH_INFO: `/v3/projects/c4acbfccef2b4f66818f50ff3bc59860/users/bea0f4526485481f984cac4d1f1d51b1/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:15.182801 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd12ba-7847-44e6-9a9b-9eb4036f7f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4acbfccef2b4f66818f50ff3bc59860, user_id=bea0f4526485481f984cac4d1f1d51b1, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:15.185646 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd12ba-7847-44e6-9a9b-9eb4036f7f09 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:15.202172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1156/2319] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:58:15 2022] PUT /identity/v3/projects/c4acbfccef2b4f66818f50ff3bc59860/users/bea0f4526485481f984cac4d1f1d51b1/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:58:15.214984 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc0e1c-e458-41af-be9b-e3c301244f07 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:15.215375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc0e1c-e458-41af-be9b-e3c301244f07 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:15.215736 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc0e1c-e458-41af-be9b-e3c301244f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:15.250932 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-11bc0e1c-e458-41af-be9b-e3c301244f07 None None] MFA Rules not processed for user `bea0f4526485481f984cac4d1f1d51b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:58:15.252241 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-11bc0e1c-e458-41af-be9b-e3c301244f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:15.338661 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1164/2320] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:58:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:58:15.346068 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd12ba-7847-44e6-9a9b-9eb4036f7f09 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:15.421755 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd12ba-7847-44e6-9a9b-9eb4036f7f09 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:15.435878 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c08804-1cd9-4d55-9097-2f090add7218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:15.436535 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c08804-1cd9-4d55-9097-2f090add7218 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:15.437004 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c08804-1cd9-4d55-9097-2f090add7218 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:15.437270 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c08804-1cd9-4d55-9097-2f090add7218 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:15.437952 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c08804-1cd9-4d55-9097-2f090add7218 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:15.439905 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c08804-1cd9-4d55-9097-2f090add7218 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:15.475198 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1157/2321] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:58:15 2022] POST /identity/v3/projects => generated 393 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:58:15.479242 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc0e1c-e458-41af-be9b-e3c301244f07 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:15.494934 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc0e1c-e458-41af-be9b-e3c301244f07 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:15.552929 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:15.574288 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c23f8-4642-473e-be2f-c083ff83feea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:15.575051 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c23f8-4642-473e-be2f-c083ff83feea admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:15.575398 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c23f8-4642-473e-be2f-c083ff83feea admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:15.575744 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c23f8-4642-473e-be2f-c083ff83feea admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:15.576454 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c23f8-4642-473e-be2f-c083ff83feea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:15.578499 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c23f8-4642-473e-be2f-c083ff83feea admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:15.606065 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1165/2322] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:58:15 2022] POST /identity/v3/users => generated 303 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:58:15.608225 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c08804-1cd9-4d55-9097-2f090add7218 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:15.620250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c08804-1cd9-4d55-9097-2f090add7218 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:15.625055 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060c228-dae9-4209-baa0-d68eead39069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:15.625713 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060c228-dae9-4209-baa0-d68eead39069 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:15.626015 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060c228-dae9-4209-baa0-d68eead39069 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:15.626301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060c228-dae9-4209-baa0-d68eead39069 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:15.627142 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060c228-dae9-4209-baa0-d68eead39069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:15.628797 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9060c228-dae9-4209-baa0-d68eead39069 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:15.642719 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1158/2323] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:58:15.647348 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c23f8-4642-473e-be2f-c083ff83feea admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:15.659167 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c23f8-4642-473e-be2f-c083ff83feea admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:15.665055 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721bd24-ef9f-40f8-a942-2d87f1edee4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:15.666255 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721bd24-ef9f-40f8-a942-2d87f1edee4f admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:15.666671 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721bd24-ef9f-40f8-a942-2d87f1edee4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:15.667104 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721bd24-ef9f-40f8-a942-2d87f1edee4f admin admin] PATH_INFO: `/v3/projects/575f2c9e56ed484c9b666cd436887f52/users/195573549e7e420fb5ca710b1fef2b57/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:15.689226 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721bd24-ef9f-40f8-a942-2d87f1edee4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=575f2c9e56ed484c9b666cd436887f52, user_id=195573549e7e420fb5ca710b1fef2b57, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:15.692198 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721bd24-ef9f-40f8-a942-2d87f1edee4f admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:15.714359 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1166/2324] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:58:15 2022] PUT /identity/v3/projects/575f2c9e56ed484c9b666cd436887f52/users/195573549e7e420fb5ca710b1fef2b57/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:58:15.718448 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060c228-dae9-4209-baa0-d68eead39069 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:15.735196 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060c228-dae9-4209-baa0-d68eead39069 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:15.847736 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be78013-8cdb-4fdb-aac3-d5fa5d5fe49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:15.848588 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be78013-8cdb-4fdb-aac3-d5fa5d5fe49d admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:15.848803 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be78013-8cdb-4fdb-aac3-d5fa5d5fe49d admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:15.849140 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be78013-8cdb-4fdb-aac3-d5fa5d5fe49d admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:15.850115 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be78013-8cdb-4fdb-aac3-d5fa5d5fe49d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:15.852332 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be78013-8cdb-4fdb-aac3-d5fa5d5fe49d admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:15.853918 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:15.867940 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1159/2325] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:58:15.873813 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721bd24-ef9f-40f8-a942-2d87f1edee4f admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:15.886389 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721bd24-ef9f-40f8-a942-2d87f1edee4f admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:15.891130 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3fd8c-ce92-42e6-a74e-378ebcec780a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:15.891814 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3fd8c-ce92-42e6-a74e-378ebcec780a admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:15.892090 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3fd8c-ce92-42e6-a74e-378ebcec780a admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:15.892360 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3fd8c-ce92-42e6-a74e-378ebcec780a admin admin] PATH_INFO: `/v3/projects/575f2c9e56ed484c9b666cd436887f52/users/195573549e7e420fb5ca710b1fef2b57/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:15.894615 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3fd8c-ce92-42e6-a74e-378ebcec780a admin admin] RBAC: Authorizing `identity:create_grant(project_id=575f2c9e56ed484c9b666cd436887f52, user_id=195573549e7e420fb5ca710b1fef2b57, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:15.897359 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3fd8c-ce92-42e6-a74e-378ebcec780a admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:15.910575 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1167/2326] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:58:15 2022] PUT /identity/v3/projects/575f2c9e56ed484c9b666cd436887f52/users/195573549e7e420fb5ca710b1fef2b57/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:58:15.922126 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0107e9-29c2-4e65-8339-07e296f72d8c None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:15.922319 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0107e9-29c2-4e65-8339-07e296f72d8c None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:15.922590 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0107e9-29c2-4e65-8339-07e296f72d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:15.957042 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-cd0107e9-29c2-4e65-8339-07e296f72d8c None None] MFA Rules not processed for user `195573549e7e420fb5ca710b1fef2b57`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:58:15.963899 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-cd0107e9-29c2-4e65-8339-07e296f72d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:16.060680 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1160/2327] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:58:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:58:16.072186 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3fd8c-ce92-42e6-a74e-378ebcec780a admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:16.074044 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-13c3fd8c-ce92-42e6-a74e-378ebcec780a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:16.150731 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3fd8c-ce92-42e6-a74e-378ebcec780a admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:16.156956 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13350c34-ea97-4145-a202-20079b022d06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:16.158147 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13350c34-ea97-4145-a202-20079b022d06 service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:16.158744 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13350c34-ea97-4145-a202-20079b022d06 service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:16.159251 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13350c34-ea97-4145-a202-20079b022d06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:16.171616 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13350c34-ea97-4145-a202-20079b022d06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:16.173423 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13350c34-ea97-4145-a202-20079b022d06 service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:16.186281 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1168/2328] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:58:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:58:16.237744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0107e9-29c2-4e65-8339-07e296f72d8c None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:16.239399 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-cd0107e9-29c2-4e65-8339-07e296f72d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:16.257000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0107e9-29c2-4e65-8339-07e296f72d8c None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:16.260608 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c9838-18b1-4c73-a9e0-59351390f6ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:16.261249 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c9838-18b1-4c73-a9e0-59351390f6ed service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:16.261515 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c9838-18b1-4c73-a9e0-59351390f6ed service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:16.261782 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c9838-18b1-4c73-a9e0-59351390f6ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:16.336686 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c9838-18b1-4c73-a9e0-59351390f6ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:16.338312 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c9838-18b1-4c73-a9e0-59351390f6ed service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:16.348944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1161/2329] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:58:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:58:19.987938 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13350c34-ea97-4145-a202-20079b022d06 service cinder] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:20.057581 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13350c34-ea97-4145-a202-20079b022d06 service cinder] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:20.062705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c13e0-d224-4ccf-86a2-7324bf48ca56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:20.063449 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c13e0-d224-4ccf-86a2-7324bf48ca56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:20.063803 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c13e0-d224-4ccf-86a2-7324bf48ca56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:20.064143 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c13e0-d224-4ccf-86a2-7324bf48ca56 admin admin] PATH_INFO: `/v3/users/bea0f4526485481f984cac4d1f1d51b1` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:20.065480 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c13e0-d224-4ccf-86a2-7324bf48ca56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bea0f4526485481f984cac4d1f1d51b1)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:20.067649 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c13e0-d224-4ccf-86a2-7324bf48ca56 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:20.116315 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:20.123529 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-986c13e0-d224-4ccf-86a2-7324bf48ca56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bea0f4526485481f984cac4d1f1d51b1'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:20.124747 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-986c13e0-d224-4ccf-86a2-7324bf48ca56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bea0f4526485481f984cac4d1f1d51b1'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:20.133371 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-986c13e0-d224-4ccf-86a2-7324bf48ca56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bea0f4526485481f984cac4d1f1d51b1'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:20.154193 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-986c13e0-d224-4ccf-86a2-7324bf48ca56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bea0f4526485481f984cac4d1f1d51b1'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:20.162388 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-986c13e0-d224-4ccf-86a2-7324bf48ca56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bea0f4526485481f984cac4d1f1d51b1'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:20.175877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1169/2330] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:58:19 2022] DELETE /identity/v3/users/bea0f4526485481f984cac4d1f1d51b1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:58:20.181140 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67b956-1dfb-4671-9378-c936b03fd74c None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:20.181725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67b956-1dfb-4671-9378-c936b03fd74c None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:20.181725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da67b956-1dfb-4671-9378-c936b03fd74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:20.208584 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-da67b956-1dfb-4671-9378-c936b03fd74c None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:58:20.209932 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-da67b956-1dfb-4671-9378-c936b03fd74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:20.311455 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1162/2331] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:58:20.321229 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c13e0-d224-4ccf-86a2-7324bf48ca56 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:20.322909 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-986c13e0-d224-4ccf-86a2-7324bf48ca56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:20.386866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c13e0-d224-4ccf-86a2-7324bf48ca56 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:20.391504 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ffddd-a35e-440a-a5ae-e50542fab99f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:20.392143 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ffddd-a35e-440a-a5ae-e50542fab99f service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:20.392423 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ffddd-a35e-440a-a5ae-e50542fab99f service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:20.392814 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ffddd-a35e-440a-a5ae-e50542fab99f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:20.403557 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ffddd-a35e-440a-a5ae-e50542fab99f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:20.405028 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ffddd-a35e-440a-a5ae-e50542fab99f service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:20.415979 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1170/2332] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:58:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:58:20.747376 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67b956-1dfb-4671-9378-c936b03fd74c None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:20.749057 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-da67b956-1dfb-4671-9378-c936b03fd74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:20.770243 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da67b956-1dfb-4671-9378-c936b03fd74c None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:20.784148 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8c124-db3b-429b-bb0c-c5a73dadb317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:20.785103 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8c124-db3b-429b-bb0c-c5a73dadb317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:20.785630 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8c124-db3b-429b-bb0c-c5a73dadb317 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:20.785905 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8c124-db3b-429b-bb0c-c5a73dadb317 admin admin] PATH_INFO: `/v3/projects/c4acbfccef2b4f66818f50ff3bc59860` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:20.788640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8c124-db3b-429b-bb0c-c5a73dadb317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4acbfccef2b4f66818f50ff3bc59860)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:20.792933 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b8c124-db3b-429b-bb0c-c5a73dadb317 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:20.823004 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:20.866499 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-d4b8c124-db3b-429b-bb0c-c5a73dadb317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4acbfccef2b4f66818f50ff3bc59860', 'request_id': 'req-d4b8c124-db3b-429b-bb0c-c5a73dadb317'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:20.879311 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-d4b8c124-db3b-429b-bb0c-c5a73dadb317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4acbfccef2b4f66818f50ff3bc59860', 'request_id': 'req-d4b8c124-db3b-429b-bb0c-c5a73dadb317'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:20.888034 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-d4b8c124-db3b-429b-bb0c-c5a73dadb317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4acbfccef2b4f66818f50ff3bc59860', 'request_id': 'req-d4b8c124-db3b-429b-bb0c-c5a73dadb317'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:20.904786 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-d4b8c124-db3b-429b-bb0c-c5a73dadb317 admin admin] The token cache is being invalidate because project c4acbfccef2b4f66818f50ff3bc59860 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:58:20.905107 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-d4b8c124-db3b-429b-bb0c-c5a73dadb317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:20.905744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-d4b8c124-db3b-429b-bb0c-c5a73dadb317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:20.907582 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1163/2333] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:58:20 2022] DELETE /identity/v3/projects/c4acbfccef2b4f66818f50ff3bc59860 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:58:20.911849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ffddd-a35e-440a-a5ae-e50542fab99f service neutron] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:20.922525 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ffddd-a35e-440a-a5ae-e50542fab99f service neutron] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:20.988412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac14753-fde7-4cb6-b230-57033674e303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:20.989129 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac14753-fde7-4cb6-b230-57033674e303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:20.989400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac14753-fde7-4cb6-b230-57033674e303 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:20.989668 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac14753-fde7-4cb6-b230-57033674e303 admin admin] PATH_INFO: `/v3/users/195573549e7e420fb5ca710b1fef2b57` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:20.990997 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac14753-fde7-4cb6-b230-57033674e303 admin admin] RBAC: Authorizing `identity:delete_user(user_id=195573549e7e420fb5ca710b1fef2b57)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:20.992980 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac14753-fde7-4cb6-b230-57033674e303 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:21.048064 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-3ac14753-fde7-4cb6-b230-57033674e303 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '195573549e7e420fb5ca710b1fef2b57'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:21.049378 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-3ac14753-fde7-4cb6-b230-57033674e303 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '195573549e7e420fb5ca710b1fef2b57'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:21.058987 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-3ac14753-fde7-4cb6-b230-57033674e303 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '195573549e7e420fb5ca710b1fef2b57'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:21.067446 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:21.073682 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-3ac14753-fde7-4cb6-b230-57033674e303 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '195573549e7e420fb5ca710b1fef2b57'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:21.080591 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-3ac14753-fde7-4cb6-b230-57033674e303 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '195573549e7e420fb5ca710b1fef2b57'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:21.086756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1171/2334] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:58:20 2022] DELETE /identity/v3/users/195573549e7e420fb5ca710b1fef2b57 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:58:21.406735 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8c124-db3b-429b-bb0c-c5a73dadb317 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:21.408922 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-d4b8c124-db3b-429b-bb0c-c5a73dadb317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:21.429870 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b8c124-db3b-429b-bb0c-c5a73dadb317 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:21.499264 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f5fb0-4094-4726-bc62-5957314a0d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:21.500139 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f5fb0-4094-4726-bc62-5957314a0d7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:21.500509 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f5fb0-4094-4726-bc62-5957314a0d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:21.500871 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f5fb0-4094-4726-bc62-5957314a0d7f admin admin] PATH_INFO: `/v3/projects/575f2c9e56ed484c9b666cd436887f52` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:21.502186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f5fb0-4094-4726-bc62-5957314a0d7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=575f2c9e56ed484c9b666cd436887f52)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:21.504215 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f5fb0-4094-4726-bc62-5957314a0d7f admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:21.557915 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-030f5fb0-4094-4726-bc62-5957314a0d7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '575f2c9e56ed484c9b666cd436887f52', 'request_id': 'req-030f5fb0-4094-4726-bc62-5957314a0d7f'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:21.566861 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-030f5fb0-4094-4726-bc62-5957314a0d7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '575f2c9e56ed484c9b666cd436887f52', 'request_id': 'req-030f5fb0-4094-4726-bc62-5957314a0d7f'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:21.574856 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-030f5fb0-4094-4726-bc62-5957314a0d7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '575f2c9e56ed484c9b666cd436887f52', 'request_id': 'req-030f5fb0-4094-4726-bc62-5957314a0d7f'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:21.587460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-030f5fb0-4094-4726-bc62-5957314a0d7f admin admin] The token cache is being invalidate because project 575f2c9e56ed484c9b666cd436887f52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:58:21.587833 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-030f5fb0-4094-4726-bc62-5957314a0d7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:21.588539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-030f5fb0-4094-4726-bc62-5957314a0d7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:21.593416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1164/2335] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:58:21 2022] DELETE /identity/v3/projects/575f2c9e56ed484c9b666cd436887f52 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:58:21.595073 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c689b4-4914-4116-b40e-2c657f93814f None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:21.595363 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c689b4-4914-4116-b40e-2c657f93814f None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:21.595645 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c689b4-4914-4116-b40e-2c657f93814f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:21.615890 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-82c689b4-4914-4116-b40e-2c657f93814f None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:58:21.617127 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-82c689b4-4914-4116-b40e-2c657f93814f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:21.702660 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1172/2336] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:58:21.704658 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5418296-b1e0-463b-a533-ceec0a59793a None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:21.705033 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5418296-b1e0-463b-a533-ceec0a59793a None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:21.705546 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5418296-b1e0-463b-a533-ceec0a59793a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:21.729307 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-b5418296-b1e0-463b-a533-ceec0a59793a None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:58:21.730586 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-b5418296-b1e0-463b-a533-ceec0a59793a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:21.741889 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1165/2337] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:58:21.743200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c689b4-4914-4116-b40e-2c657f93814f None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:21.753895 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c689b4-4914-4116-b40e-2c657f93814f None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:21.759029 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef178ca6-4ac1-4eeb-87db-e616e86b7adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:21.759668 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef178ca6-4ac1-4eeb-87db-e616e86b7adf admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:21.759954 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef178ca6-4ac1-4eeb-87db-e616e86b7adf admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:21.760233 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef178ca6-4ac1-4eeb-87db-e616e86b7adf admin admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:21.760956 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef178ca6-4ac1-4eeb-87db-e616e86b7adf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:58:21.761262 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef178ca6-4ac1-4eeb-87db-e616e86b7adf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:21.762942 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef178ca6-4ac1-4eeb-87db-e616e86b7adf admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:21.778546 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1173/2338] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:58:21.779988 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5418296-b1e0-463b-a533-ceec0a59793a None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:21.789931 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5418296-b1e0-463b-a533-ceec0a59793a None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:21.794816 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732948e0-8f80-48b6-9d27-fe13917b3c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:21.795480 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732948e0-8f80-48b6-9d27-fe13917b3c18 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:21.795737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732948e0-8f80-48b6-9d27-fe13917b3c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:21.796123 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732948e0-8f80-48b6-9d27-fe13917b3c18 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:21.796835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732948e0-8f80-48b6-9d27-fe13917b3c18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:21.798903 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732948e0-8f80-48b6-9d27-fe13917b3c18 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:21.834775 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1166/2339] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:58:21 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:58:21.836420 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef178ca6-4ac1-4eeb-87db-e616e86b7adf admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:21.859834 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef178ca6-4ac1-4eeb-87db-e616e86b7adf admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:21.938934 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817711fb-23bc-40c1-998d-b3a13e613e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:21.939601 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817711fb-23bc-40c1-998d-b3a13e613e7f admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:21.939879 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817711fb-23bc-40c1-998d-b3a13e613e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:21.940149 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817711fb-23bc-40c1-998d-b3a13e613e7f admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:21.940822 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817711fb-23bc-40c1-998d-b3a13e613e7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:21.942878 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817711fb-23bc-40c1-998d-b3a13e613e7f admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:21.969123 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1174/2340] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:58:21 2022] POST /identity/v3/users => generated 292 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:58:21.972983 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732948e0-8f80-48b6-9d27-fe13917b3c18 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:21.980685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:21.985377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732948e0-8f80-48b6-9d27-fe13917b3c18 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:21.994870 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ade54-8111-410b-8633-ceddf09a1b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:21.995348 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ade54-8111-410b-8633-ceddf09a1b7b admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:21.996274 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ade54-8111-410b-8633-ceddf09a1b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:21.996722 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ade54-8111-410b-8633-ceddf09a1b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:21.997867 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ade54-8111-410b-8633-ceddf09a1b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:22.000241 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ade54-8111-410b-8633-ceddf09a1b7b admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:22.022231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1167/2341] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:58:22.022380 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817711fb-23bc-40c1-998d-b3a13e613e7f admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:22.029678 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817711fb-23bc-40c1-998d-b3a13e613e7f admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:22.035172 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679ea48-af1d-4a27-a860-d70580cbf794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:22.035796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679ea48-af1d-4a27-a860-d70580cbf794 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:22.036099 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679ea48-af1d-4a27-a860-d70580cbf794 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:22.036358 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679ea48-af1d-4a27-a860-d70580cbf794 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:22.037054 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679ea48-af1d-4a27-a860-d70580cbf794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:22.038718 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679ea48-af1d-4a27-a860-d70580cbf794 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:22.050096 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1175/2342] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:58:22.054496 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ade54-8111-410b-8633-ceddf09a1b7b admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:22.065202 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ade54-8111-410b-8633-ceddf09a1b7b admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:22.070558 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a395d3-7ae9-458d-affc-d4319406d6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:22.071260 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a395d3-7ae9-458d-affc-d4319406d6fa admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:22.071543 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a395d3-7ae9-458d-affc-d4319406d6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:22.071817 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a395d3-7ae9-458d-affc-d4319406d6fa admin admin] PATH_INFO: `/v3/projects/82b2c0937d4e40e8b0b2a76038ea084c/users/694ab66f4acd4336a88e8034b59222e0/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:22.088937 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a395d3-7ae9-458d-affc-d4319406d6fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=82b2c0937d4e40e8b0b2a76038ea084c, user_id=694ab66f4acd4336a88e8034b59222e0, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:22.091679 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a395d3-7ae9-458d-affc-d4319406d6fa admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:22.107726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1168/2343] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:58:22 2022] PUT /identity/v3/projects/82b2c0937d4e40e8b0b2a76038ea084c/users/694ab66f4acd4336a88e8034b59222e0/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:58:22.120076 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ae43e-3621-46af-999f-f1cb20a76ec0 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:22.120362 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ae43e-3621-46af-999f-f1cb20a76ec0 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:22.120636 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ae43e-3621-46af-999f-f1cb20a76ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:22.156398 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-ba2ae43e-3621-46af-999f-f1cb20a76ec0 None None] MFA Rules not processed for user `694ab66f4acd4336a88e8034b59222e0`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:58:22.158196 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-ba2ae43e-3621-46af-999f-f1cb20a76ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:22.198006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:22.232030 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1176/2344] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:58:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:58:22.236652 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a395d3-7ae9-458d-affc-d4319406d6fa admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:22.310008 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a395d3-7ae9-458d-affc-d4319406d6fa admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:22.317547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bae279-cb54-418c-a318-cdf996c1e62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:22.318160 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bae279-cb54-418c-a318-cdf996c1e62c admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:22.318442 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bae279-cb54-418c-a318-cdf996c1e62c admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:22.318717 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bae279-cb54-418c-a318-cdf996c1e62c admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:22.319393 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bae279-cb54-418c-a318-cdf996c1e62c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:22.321303 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bae279-cb54-418c-a318-cdf996c1e62c admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:22.356974 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1169/2345] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:58:22 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:58:22.362878 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ae43e-3621-46af-999f-f1cb20a76ec0 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:22.375173 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ae43e-3621-46af-999f-f1cb20a76ec0 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:22.434700 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063ef8a-b4e4-4337-80a2-b9a941a0f4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:22.435645 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063ef8a-b4e4-4337-80a2-b9a941a0f4e8 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:22.435926 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063ef8a-b4e4-4337-80a2-b9a941a0f4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:22.436201 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063ef8a-b4e4-4337-80a2-b9a941a0f4e8 admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:22.436875 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063ef8a-b4e4-4337-80a2-b9a941a0f4e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:22.438912 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063ef8a-b4e4-4337-80a2-b9a941a0f4e8 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:22.469147 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1177/2346] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:58:22 2022] POST /identity/v3/users => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:58:22.471545 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bae279-cb54-418c-a318-cdf996c1e62c admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:22.485292 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bae279-cb54-418c-a318-cdf996c1e62c admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:22.491993 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ba3c0-5a23-45a8-bda9-35efe4c0199e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:22.492993 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ba3c0-5a23-45a8-bda9-35efe4c0199e admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:22.493321 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ba3c0-5a23-45a8-bda9-35efe4c0199e admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:22.493587 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ba3c0-5a23-45a8-bda9-35efe4c0199e admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:22.494727 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ba3c0-5a23-45a8-bda9-35efe4c0199e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:22.497298 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ba3c0-5a23-45a8-bda9-35efe4c0199e admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:22.510400 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1170/2347] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:58:22.515383 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063ef8a-b4e4-4337-80a2-b9a941a0f4e8 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:22.525960 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063ef8a-b4e4-4337-80a2-b9a941a0f4e8 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:22.531060 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156b793-168b-4e8e-a173-9319a35b3a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:22.531738 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156b793-168b-4e8e-a173-9319a35b3a35 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:22.532015 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156b793-168b-4e8e-a173-9319a35b3a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:22.532311 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156b793-168b-4e8e-a173-9319a35b3a35 admin admin] PATH_INFO: `/v3/projects/f18929c3956348fd84d71afa5e1f58a6/users/950e2e765cf44500bb0bcf2a107373ca/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:22.547878 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156b793-168b-4e8e-a173-9319a35b3a35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f18929c3956348fd84d71afa5e1f58a6, user_id=950e2e765cf44500bb0bcf2a107373ca, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:22.550649 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156b793-168b-4e8e-a173-9319a35b3a35 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:22.568491 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1178/2348] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:58:22 2022] PUT /identity/v3/projects/f18929c3956348fd84d71afa5e1f58a6/users/950e2e765cf44500bb0bcf2a107373ca/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:58:22.572688 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ba3c0-5a23-45a8-bda9-35efe4c0199e admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:22.583931 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ba3c0-5a23-45a8-bda9-35efe4c0199e admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:22.641650 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef302bc-a39c-4f91-b242-8702b9768366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:22.642207 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef302bc-a39c-4f91-b242-8702b9768366 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:22.642477 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef302bc-a39c-4f91-b242-8702b9768366 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:22.642739 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef302bc-a39c-4f91-b242-8702b9768366 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:22.643434 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef302bc-a39c-4f91-b242-8702b9768366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:22.645030 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef302bc-a39c-4f91-b242-8702b9768366 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:22.655190 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1171/2349] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:58:22.659549 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156b793-168b-4e8e-a173-9319a35b3a35 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:22.670634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156b793-168b-4e8e-a173-9319a35b3a35 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:22.676254 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c3d04-c3cf-4245-a631-c899742b4cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:22.676968 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c3d04-c3cf-4245-a631-c899742b4cc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:22.677246 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c3d04-c3cf-4245-a631-c899742b4cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:22.677516 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c3d04-c3cf-4245-a631-c899742b4cc3 admin admin] PATH_INFO: `/v3/projects/f18929c3956348fd84d71afa5e1f58a6/users/950e2e765cf44500bb0bcf2a107373ca/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:22.679731 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c3d04-c3cf-4245-a631-c899742b4cc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f18929c3956348fd84d71afa5e1f58a6, user_id=950e2e765cf44500bb0bcf2a107373ca, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:22.682477 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c3d04-c3cf-4245-a631-c899742b4cc3 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:22.693995 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1179/2350] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:58:22 2022] PUT /identity/v3/projects/f18929c3956348fd84d71afa5e1f58a6/users/950e2e765cf44500bb0bcf2a107373ca/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:58:22.704924 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077900c5-7b61-44c2-ae53-b42db0f6edb4 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:22.705242 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077900c5-7b61-44c2-ae53-b42db0f6edb4 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:22.705537 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077900c5-7b61-44c2-ae53-b42db0f6edb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:22.737835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-077900c5-7b61-44c2-ae53-b42db0f6edb4 None None] MFA Rules not processed for user `950e2e765cf44500bb0bcf2a107373ca`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:58:22.739179 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-077900c5-7b61-44c2-ae53-b42db0f6edb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:22.778365 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:22.820753 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1172/2351] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:58:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:58:22.832488 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c3d04-c3cf-4245-a631-c899742b4cc3 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:22.834812 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-386c3d04-c3cf-4245-a631-c899742b4cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:22.895224 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c3d04-c3cf-4245-a631-c899742b4cc3 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:22.899182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892efb86-a80f-4096-9a21-2f05d9a8f889 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:22.899813 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892efb86-a80f-4096-9a21-2f05d9a8f889 service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:22.900094 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892efb86-a80f-4096-9a21-2f05d9a8f889 service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:22.900380 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892efb86-a80f-4096-9a21-2f05d9a8f889 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:22.910896 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892efb86-a80f-4096-9a21-2f05d9a8f889 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:22.912433 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892efb86-a80f-4096-9a21-2f05d9a8f889 service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:22.922801 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1180/2352] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:58:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:58:23.000408 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077900c5-7b61-44c2-ae53-b42db0f6edb4 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:23.010521 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077900c5-7b61-44c2-ae53-b42db0f6edb4 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:23.014318 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e172f-158b-443b-8add-811eabf3878f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:23.014945 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e172f-158b-443b-8add-811eabf3878f service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:23.015225 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e172f-158b-443b-8add-811eabf3878f service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:23.015494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e172f-158b-443b-8add-811eabf3878f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:23.079068 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e172f-158b-443b-8add-811eabf3878f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:23.080552 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e172f-158b-443b-8add-811eabf3878f service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:23.090302 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1173/2353] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:58:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:58:23.387347 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892efb86-a80f-4096-9a21-2f05d9a8f889 service cinder] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:23.422207 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:23.460645 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892efb86-a80f-4096-9a21-2f05d9a8f889 service cinder] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:23.466552 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b350f6-c633-472f-9064-6682efca501d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:23.467210 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b350f6-c633-472f-9064-6682efca501d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:23.467488 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b350f6-c633-472f-9064-6682efca501d admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:23.467760 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b350f6-c633-472f-9064-6682efca501d admin admin] PATH_INFO: `/v3/users/694ab66f4acd4336a88e8034b59222e0` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:23.469038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b350f6-c633-472f-9064-6682efca501d admin admin] RBAC: Authorizing `identity:delete_user(user_id=694ab66f4acd4336a88e8034b59222e0)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:23.471058 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b350f6-c633-472f-9064-6682efca501d admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:23.520345 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-b8b350f6-c633-472f-9064-6682efca501d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '694ab66f4acd4336a88e8034b59222e0'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:23.520954 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-b8b350f6-c633-472f-9064-6682efca501d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '694ab66f4acd4336a88e8034b59222e0'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:23.529502 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-b8b350f6-c633-472f-9064-6682efca501d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '694ab66f4acd4336a88e8034b59222e0'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:23.541617 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-b8b350f6-c633-472f-9064-6682efca501d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '694ab66f4acd4336a88e8034b59222e0'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:23.548582 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-b8b350f6-c633-472f-9064-6682efca501d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '694ab66f4acd4336a88e8034b59222e0'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:23.555412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1181/2354] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:58:23 2022] DELETE /identity/v3/users/694ab66f4acd4336a88e8034b59222e0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:58:23.560097 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e2741-f5c6-4465-a771-69794665b7b7 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:23.560576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e2741-f5c6-4465-a771-69794665b7b7 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:23.560694 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e2741-f5c6-4465-a771-69794665b7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:23.580496 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-649e2741-f5c6-4465-a771-69794665b7b7 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:58:23.581701 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-649e2741-f5c6-4465-a771-69794665b7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:23.642907 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1174/2355] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:58:23.653078 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b350f6-c633-472f-9064-6682efca501d admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:23.654558 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-b8b350f6-c633-472f-9064-6682efca501d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:23.721871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b350f6-c633-472f-9064-6682efca501d admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:23.726712 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ec533-cf3a-4f31-9a8c-94b66f8be6dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:23.727556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ec533-cf3a-4f31-9a8c-94b66f8be6dd service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:23.727835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ec533-cf3a-4f31-9a8c-94b66f8be6dd service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:23.728091 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776ec533-cf3a-4f31-9a8c-94b66f8be6dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:23.739625 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ec533-cf3a-4f31-9a8c-94b66f8be6dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:23.741144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776ec533-cf3a-4f31-9a8c-94b66f8be6dd service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:23.751519 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1182/2356] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:58:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:58:24.050319 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e2741-f5c6-4465-a771-69794665b7b7 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:24.051939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-649e2741-f5c6-4465-a771-69794665b7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:24.065826 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e2741-f5c6-4465-a771-69794665b7b7 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:24.070779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38013d1b-336e-42e9-9fc0-8b8d1eb5520c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:24.071566 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38013d1b-336e-42e9-9fc0-8b8d1eb5520c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:24.071847 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38013d1b-336e-42e9-9fc0-8b8d1eb5520c admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:24.072121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38013d1b-336e-42e9-9fc0-8b8d1eb5520c admin admin] PATH_INFO: `/v3/projects/82b2c0937d4e40e8b0b2a76038ea084c` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:24.073497 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38013d1b-336e-42e9-9fc0-8b8d1eb5520c admin admin] RBAC: Authorizing `identity:delete_project(project_id=82b2c0937d4e40e8b0b2a76038ea084c)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:24.075403 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38013d1b-336e-42e9-9fc0-8b8d1eb5520c admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:24.127934 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-38013d1b-336e-42e9-9fc0-8b8d1eb5520c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82b2c0937d4e40e8b0b2a76038ea084c', 'request_id': 'req-38013d1b-336e-42e9-9fc0-8b8d1eb5520c'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:24.136154 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-38013d1b-336e-42e9-9fc0-8b8d1eb5520c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82b2c0937d4e40e8b0b2a76038ea084c', 'request_id': 'req-38013d1b-336e-42e9-9fc0-8b8d1eb5520c'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:24.138302 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:24.142588 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-38013d1b-336e-42e9-9fc0-8b8d1eb5520c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82b2c0937d4e40e8b0b2a76038ea084c', 'request_id': 'req-38013d1b-336e-42e9-9fc0-8b8d1eb5520c'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:24.157204 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-38013d1b-336e-42e9-9fc0-8b8d1eb5520c admin admin] The token cache is being invalidate because project 82b2c0937d4e40e8b0b2a76038ea084c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:58:24.157495 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-38013d1b-336e-42e9-9fc0-8b8d1eb5520c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:24.158287 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-38013d1b-336e-42e9-9fc0-8b8d1eb5520c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:24.159996 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1175/2357] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:58:24 2022] DELETE /identity/v3/projects/82b2c0937d4e40e8b0b2a76038ea084c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:58:24.164319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ec533-cf3a-4f31-9a8c-94b66f8be6dd service neutron] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:24.176224 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776ec533-cf3a-4f31-9a8c-94b66f8be6dd service neutron] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:24.241873 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:24.252813 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9b2e3-18f9-413b-a09c-9a0c82d70e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:24.253854 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9b2e3-18f9-413b-a09c-9a0c82d70e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:24.254175 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9b2e3-18f9-413b-a09c-9a0c82d70e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:24.254448 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9b2e3-18f9-413b-a09c-9a0c82d70e3c admin admin] PATH_INFO: `/v3/users/950e2e765cf44500bb0bcf2a107373ca` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:24.255634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9b2e3-18f9-413b-a09c-9a0c82d70e3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=950e2e765cf44500bb0bcf2a107373ca)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:24.257571 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9b2e3-18f9-413b-a09c-9a0c82d70e3c admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:24.309696 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-92a9b2e3-18f9-413b-a09c-9a0c82d70e3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '950e2e765cf44500bb0bcf2a107373ca'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:24.310394 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-92a9b2e3-18f9-413b-a09c-9a0c82d70e3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '950e2e765cf44500bb0bcf2a107373ca'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:24.319061 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-92a9b2e3-18f9-413b-a09c-9a0c82d70e3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '950e2e765cf44500bb0bcf2a107373ca'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:24.332988 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-92a9b2e3-18f9-413b-a09c-9a0c82d70e3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '950e2e765cf44500bb0bcf2a107373ca'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:24.340976 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-92a9b2e3-18f9-413b-a09c-9a0c82d70e3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '950e2e765cf44500bb0bcf2a107373ca'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:24.347702 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1183/2358] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:58:24 2022] DELETE /identity/v3/users/950e2e765cf44500bb0bcf2a107373ca => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:58:24.716668 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38013d1b-336e-42e9-9fc0-8b8d1eb5520c admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:24.718316 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-38013d1b-336e-42e9-9fc0-8b8d1eb5520c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:24.735042 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38013d1b-336e-42e9-9fc0-8b8d1eb5520c admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:24.797003 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a8e60-0d53-41f8-b04f-748289107ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:24.797609 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a8e60-0d53-41f8-b04f-748289107ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:24.797890 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a8e60-0d53-41f8-b04f-748289107ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:24.798191 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a8e60-0d53-41f8-b04f-748289107ff7 admin admin] PATH_INFO: `/v3/projects/f18929c3956348fd84d71afa5e1f58a6` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:24.799410 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a8e60-0d53-41f8-b04f-748289107ff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f18929c3956348fd84d71afa5e1f58a6)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:24.801376 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a8e60-0d53-41f8-b04f-748289107ff7 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:24.851906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-638a8e60-0d53-41f8-b04f-748289107ff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f18929c3956348fd84d71afa5e1f58a6', 'request_id': 'req-638a8e60-0d53-41f8-b04f-748289107ff7'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:24.860328 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-638a8e60-0d53-41f8-b04f-748289107ff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f18929c3956348fd84d71afa5e1f58a6', 'request_id': 'req-638a8e60-0d53-41f8-b04f-748289107ff7'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:24.865924 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-638a8e60-0d53-41f8-b04f-748289107ff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f18929c3956348fd84d71afa5e1f58a6', 'request_id': 'req-638a8e60-0d53-41f8-b04f-748289107ff7'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:24.877681 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-638a8e60-0d53-41f8-b04f-748289107ff7 admin admin] The token cache is being invalidate because project f18929c3956348fd84d71afa5e1f58a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:58:24.878006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-638a8e60-0d53-41f8-b04f-748289107ff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:24.878852 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-638a8e60-0d53-41f8-b04f-748289107ff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:24.880415 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1176/2359] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:58:24 2022] DELETE /identity/v3/projects/f18929c3956348fd84d71afa5e1f58a6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:58:24.885510 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2602e4d-0aa6-4a23-beac-073b8b1f89dd None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:24.886025 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2602e4d-0aa6-4a23-beac-073b8b1f89dd None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:24.886123 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2602e4d-0aa6-4a23-beac-073b8b1f89dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:24.906873 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-e2602e4d-0aa6-4a23-beac-073b8b1f89dd None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:58:24.908090 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-e2602e4d-0aa6-4a23-beac-073b8b1f89dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:24.976291 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1184/2360] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:58:24.985284 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fb782-ee49-4802-aa66-c85af209fca4 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:24.985567 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fb782-ee49-4802-aa66-c85af209fca4 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:24.985838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fb782-ee49-4802-aa66-c85af209fca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:25.008057 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-689fb782-ee49-4802-aa66-c85af209fca4 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:58:25.009264 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-689fb782-ee49-4802-aa66-c85af209fca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:25.019127 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1177/2361] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:58:25.024073 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2602e4d-0aa6-4a23-beac-073b8b1f89dd None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:25.035783 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2602e4d-0aa6-4a23-beac-073b8b1f89dd None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:25.040685 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e21abe-fd85-421d-bb00-b42b91061de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:25.041310 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e21abe-fd85-421d-bb00-b42b91061de6 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:25.041584 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e21abe-fd85-421d-bb00-b42b91061de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:25.041850 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e21abe-fd85-421d-bb00-b42b91061de6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:25.042586 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e21abe-fd85-421d-bb00-b42b91061de6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:58:25.042887 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e21abe-fd85-421d-bb00-b42b91061de6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:25.044525 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e21abe-fd85-421d-bb00-b42b91061de6 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:25.056990 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1185/2362] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:58:25.061449 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689fb782-ee49-4802-aa66-c85af209fca4 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:25.071158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689fb782-ee49-4802-aa66-c85af209fca4 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:25.076948 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcb7d7-65f9-4dcc-a2e4-c50f7d09a4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:25.077566 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcb7d7-65f9-4dcc-a2e4-c50f7d09a4a9 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:25.077830 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcb7d7-65f9-4dcc-a2e4-c50f7d09a4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:25.078290 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bcb7d7-65f9-4dcc-a2e4-c50f7d09a4a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:25.078803 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bcb7d7-65f9-4dcc-a2e4-c50f7d09a4a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:25.080738 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bcb7d7-65f9-4dcc-a2e4-c50f7d09a4a9 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:25.111740 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1178/2363] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:58:25 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:58:25.119964 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e21abe-fd85-421d-bb00-b42b91061de6 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:25.136054 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e21abe-fd85-421d-bb00-b42b91061de6 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:25.197969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821edb0-4095-4416-b619-22958c68352c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:25.198633 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821edb0-4095-4416-b619-22958c68352c admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:25.198912 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821edb0-4095-4416-b619-22958c68352c admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:25.199187 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821edb0-4095-4416-b619-22958c68352c admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:25.199872 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821edb0-4095-4416-b619-22958c68352c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:25.201792 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821edb0-4095-4416-b619-22958c68352c admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:25.210024 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:25.225417 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1186/2364] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:58:25 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:58:25.229584 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcb7d7-65f9-4dcc-a2e4-c50f7d09a4a9 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:25.240172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bcb7d7-65f9-4dcc-a2e4-c50f7d09a4a9 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:25.245198 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ddcffe-57dc-49d1-b27c-803ed36b49d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:25.245851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddcffe-57dc-49d1-b27c-803ed36b49d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:25.246207 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddcffe-57dc-49d1-b27c-803ed36b49d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:25.246438 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddcffe-57dc-49d1-b27c-803ed36b49d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:25.247151 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ddcffe-57dc-49d1-b27c-803ed36b49d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:25.248812 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ddcffe-57dc-49d1-b27c-803ed36b49d8 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:25.260454 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1179/2365] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:58:25.264811 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821edb0-4095-4416-b619-22958c68352c admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:25.276262 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821edb0-4095-4416-b619-22958c68352c admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:25.282934 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fd443-bb0e-42e8-b4e3-278b2ebedf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:25.283571 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fd443-bb0e-42e8-b4e3-278b2ebedf04 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:25.283849 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fd443-bb0e-42e8-b4e3-278b2ebedf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:25.284120 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fd443-bb0e-42e8-b4e3-278b2ebedf04 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:25.284819 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fd443-bb0e-42e8-b4e3-278b2ebedf04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:25.286488 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fd443-bb0e-42e8-b4e3-278b2ebedf04 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:25.298277 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1187/2366] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:58:25.302539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ddcffe-57dc-49d1-b27c-803ed36b49d8 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:25.317543 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ddcffe-57dc-49d1-b27c-803ed36b49d8 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:25.323140 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad3580-a11f-4a11-8b55-6f32f83d9e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:25.323808 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad3580-a11f-4a11-8b55-6f32f83d9e6d admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:25.324085 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad3580-a11f-4a11-8b55-6f32f83d9e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:25.324353 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad3580-a11f-4a11-8b55-6f32f83d9e6d admin admin] PATH_INFO: `/v3/projects/188a6b52938b45d88c97fd72896bca3e/users/d9e0168811ee4f5e87b8b9277336c52b/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:25.340794 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad3580-a11f-4a11-8b55-6f32f83d9e6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=188a6b52938b45d88c97fd72896bca3e, user_id=d9e0168811ee4f5e87b8b9277336c52b, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:25.343488 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad3580-a11f-4a11-8b55-6f32f83d9e6d admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:25.362615 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1180/2367] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:58:25 2022] PUT /identity/v3/projects/188a6b52938b45d88c97fd72896bca3e/users/d9e0168811ee4f5e87b8b9277336c52b/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:58:25.373534 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bd90a-9ba3-46b6-a322-44d16253f88f None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:25.373816 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bd90a-9ba3-46b6-a322-44d16253f88f None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:25.374124 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9bd90a-9ba3-46b6-a322-44d16253f88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:25.402941 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-3b9bd90a-9ba3-46b6-a322-44d16253f88f None None] MFA Rules not processed for user `d9e0168811ee4f5e87b8b9277336c52b`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:58:25.404166 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-3b9bd90a-9ba3-46b6-a322-44d16253f88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:25.476444 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1188/2368] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:58:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:58:25.483192 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad3580-a11f-4a11-8b55-6f32f83d9e6d admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:25.504934 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:25.569189 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad3580-a11f-4a11-8b55-6f32f83d9e6d admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:25.573945 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e92c6-ade9-4fdf-9ed5-130c34eb6f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:25.574613 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e92c6-ade9-4fdf-9ed5-130c34eb6f77 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:25.574895 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e92c6-ade9-4fdf-9ed5-130c34eb6f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:25.575170 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e92c6-ade9-4fdf-9ed5-130c34eb6f77 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:25.575848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e92c6-ade9-4fdf-9ed5-130c34eb6f77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:25.577766 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e92c6-ade9-4fdf-9ed5-130c34eb6f77 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:25.607604 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1181/2369] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:58:25 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:58:25.611890 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bd90a-9ba3-46b6-a322-44d16253f88f None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:25.623972 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9bd90a-9ba3-46b6-a322-44d16253f88f None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:25.688033 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a6a7d-e56d-4116-bb9d-37a374a26a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:25.688935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a6a7d-e56d-4116-bb9d-37a374a26a41 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:25.690099 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a6a7d-e56d-4116-bb9d-37a374a26a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:25.690690 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795a6a7d-e56d-4116-bb9d-37a374a26a41 admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:25.691432 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a6a7d-e56d-4116-bb9d-37a374a26a41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:25.693468 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795a6a7d-e56d-4116-bb9d-37a374a26a41 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:25.728026 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1189/2370] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:58:25 2022] POST /identity/v3/users => generated 294 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:58:25.729229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e92c6-ade9-4fdf-9ed5-130c34eb6f77 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:25.739961 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e92c6-ade9-4fdf-9ed5-130c34eb6f77 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:25.745000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdade5e-d197-444e-b01f-8c86f180a227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:25.745628 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdade5e-d197-444e-b01f-8c86f180a227 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:25.745909 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdade5e-d197-444e-b01f-8c86f180a227 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:25.746722 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdade5e-d197-444e-b01f-8c86f180a227 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:25.747428 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdade5e-d197-444e-b01f-8c86f180a227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:25.749066 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdade5e-d197-444e-b01f-8c86f180a227 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:25.762112 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1182/2371] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:58:25.767407 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a6a7d-e56d-4116-bb9d-37a374a26a41 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:25.779868 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795a6a7d-e56d-4116-bb9d-37a374a26a41 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:25.784952 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44200ea9-6e38-499c-8404-49acfbd2ecc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:25.785844 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44200ea9-6e38-499c-8404-49acfbd2ecc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:25.786159 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44200ea9-6e38-499c-8404-49acfbd2ecc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:25.786432 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44200ea9-6e38-499c-8404-49acfbd2ecc9 admin admin] PATH_INFO: `/v3/projects/c7d35e30f9ac4b2eb26f3a38152fb8ba/users/adf34af336c64ae1b670c5541568b63a/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:25.802699 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44200ea9-6e38-499c-8404-49acfbd2ecc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d35e30f9ac4b2eb26f3a38152fb8ba, user_id=adf34af336c64ae1b670c5541568b63a, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:25.805499 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44200ea9-6e38-499c-8404-49acfbd2ecc9 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:25.820016 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1190/2372] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:58:25 2022] PUT /identity/v3/projects/c7d35e30f9ac4b2eb26f3a38152fb8ba/users/adf34af336c64ae1b670c5541568b63a/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:58:25.824125 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdade5e-d197-444e-b01f-8c86f180a227 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:25.835988 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdade5e-d197-444e-b01f-8c86f180a227 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:25.897618 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94b85b-5712-449b-ae28-5b1b50caf708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:25.898358 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94b85b-5712-449b-ae28-5b1b50caf708 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:25.898634 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94b85b-5712-449b-ae28-5b1b50caf708 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:25.899201 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94b85b-5712-449b-ae28-5b1b50caf708 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:25.899885 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94b85b-5712-449b-ae28-5b1b50caf708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:25.901513 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94b85b-5712-449b-ae28-5b1b50caf708 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:25.912047 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1183/2373] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:58:25.916523 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44200ea9-6e38-499c-8404-49acfbd2ecc9 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:25.927009 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44200ea9-6e38-499c-8404-49acfbd2ecc9 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:25.932918 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554469c-efb6-4ffa-8fa9-28de908652f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:25.933632 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554469c-efb6-4ffa-8fa9-28de908652f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:25.933906 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554469c-efb6-4ffa-8fa9-28de908652f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:25.934208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554469c-efb6-4ffa-8fa9-28de908652f5 admin admin] PATH_INFO: `/v3/projects/c7d35e30f9ac4b2eb26f3a38152fb8ba/users/adf34af336c64ae1b670c5541568b63a/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:25.936430 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554469c-efb6-4ffa-8fa9-28de908652f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d35e30f9ac4b2eb26f3a38152fb8ba, user_id=adf34af336c64ae1b670c5541568b63a, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:25.939420 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554469c-efb6-4ffa-8fa9-28de908652f5 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:25.951775 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1191/2374] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:58:25 2022] PUT /identity/v3/projects/c7d35e30f9ac4b2eb26f3a38152fb8ba/users/adf34af336c64ae1b670c5541568b63a/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:58:25.962462 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c8637-1ee3-4127-9792-d94d6da33784 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:25.962748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c8637-1ee3-4127-9792-d94d6da33784 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:25.963023 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c8637-1ee3-4127-9792-d94d6da33784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:25.992643 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-e66c8637-1ee3-4127-9792-d94d6da33784 None None] MFA Rules not processed for user `adf34af336c64ae1b670c5541568b63a`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:58:25.994229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-e66c8637-1ee3-4127-9792-d94d6da33784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:26.071387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1184/2375] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:58:25 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:58:26.080644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554469c-efb6-4ffa-8fa9-28de908652f5 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:26.082539 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-9554469c-efb6-4ffa-8fa9-28de908652f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:26.105960 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:26.151281 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554469c-efb6-4ffa-8fa9-28de908652f5 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:26.155397 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845acf4a-88cb-40be-8b9f-5177d2882905 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:26.155998 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845acf4a-88cb-40be-8b9f-5177d2882905 service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:26.156279 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845acf4a-88cb-40be-8b9f-5177d2882905 service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:26.156658 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845acf4a-88cb-40be-8b9f-5177d2882905 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:26.220588 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845acf4a-88cb-40be-8b9f-5177d2882905 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:26.222122 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845acf4a-88cb-40be-8b9f-5177d2882905 service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:26.231244 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1192/2376] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:58:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:58:26.600603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c8637-1ee3-4127-9792-d94d6da33784 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:26.602950 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-e66c8637-1ee3-4127-9792-d94d6da33784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:26.613788 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845acf4a-88cb-40be-8b9f-5177d2882905 service cinder] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:26.614840 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:26.615570 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-845acf4a-88cb-40be-8b9f-5177d2882905 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:26.673836 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c8637-1ee3-4127-9792-d94d6da33784 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:26.677602 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e3ca3-9e1a-42a0-9f93-3a746cd1f045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:26.678416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e3ca3-9e1a-42a0-9f93-3a746cd1f045 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:26.678717 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e3ca3-9e1a-42a0-9f93-3a746cd1f045 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:26.678972 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e3ca3-9e1a-42a0-9f93-3a746cd1f045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:26.680812 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-7a0e3ca3-9e1a-42a0-9f93-3a746cd1f045 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:26.690962 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e3ca3-9e1a-42a0-9f93-3a746cd1f045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:26.692413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e3ca3-9e1a-42a0-9f93-3a746cd1f045 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:26.697093 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845acf4a-88cb-40be-8b9f-5177d2882905 service cinder] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:26.700640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1185/2377] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:58:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:58:26.702896 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536bba6-8cb9-4aa6-8c61-ddef34fd5f1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:26.703524 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536bba6-8cb9-4aa6-8c61-ddef34fd5f1f service nova] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:26.703801 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536bba6-8cb9-4aa6-8c61-ddef34fd5f1f service nova] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:26.704068 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536bba6-8cb9-4aa6-8c61-ddef34fd5f1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:26.705903 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-8536bba6-8cb9-4aa6-8c61-ddef34fd5f1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:26.718950 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8536bba6-8cb9-4aa6-8c61-ddef34fd5f1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:26.720590 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8536bba6-8cb9-4aa6-8c61-ddef34fd5f1f service nova] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:26.732635 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1193/2378] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:58:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:58:26.807366 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f2631-bd09-4582-ba6e-2652a91e5705 None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:26.807919 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f2631-bd09-4582-ba6e-2652a91e5705 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:26.807919 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34f2631-bd09-4582-ba6e-2652a91e5705 None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:26.809265 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1186/2379] 10.222.0.39 () {54 vars in 921 bytes} [Tue Jul 26 04:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:58:26.816163 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d55985-532a-420c-94cc-84fc83ba1bbf None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:26.816561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d55985-532a-420c-94cc-84fc83ba1bbf None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:26.817060 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d55985-532a-420c-94cc-84fc83ba1bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:26.838539 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-03d55985-532a-420c-94cc-84fc83ba1bbf None None] MFA Rules not processed for user `ae8593e125da4b208dd100608aa2b462`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:58:26.839647 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-03d55985-532a-420c-94cc-84fc83ba1bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:26.849771 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1194/2380] 10.222.0.39 () {58 vars in 1018 bytes} [Tue Jul 26 04:58:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:58:26.861699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f2631-bd09-4582-ba6e-2652a91e5705 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:26.863738 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-e34f2631-bd09-4582-ba6e-2652a91e5705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:26.935780 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34f2631-bd09-4582-ba6e-2652a91e5705 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:26.939362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c98fb0-1ab1-43e6-81e5-61de2a7e7523 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfbf2c03eb740ed8b72c4825cffc341', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:26.940043 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c98fb0-1ab1-43e6-81e5-61de2a7e7523 service glance] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:26.940325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c98fb0-1ab1-43e6-81e5-61de2a7e7523 service glance] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:26.940601 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c98fb0-1ab1-43e6-81e5-61de2a7e7523 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:26.951403 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c98fb0-1ab1-43e6-81e5-61de2a7e7523 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:26.952842 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c98fb0-1ab1-43e6-81e5-61de2a7e7523 service glance] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:26.963788 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1187/2381] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:58:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:58:27.039961 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e93d7-44af-48d6-8e99-7c2056ef4092 None None] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:27.040651 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e93d7-44af-48d6-8e99-7c2056ef4092 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:27.040651 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e93d7-44af-48d6-8e99-7c2056ef4092 None None] PATH_INFO: `/` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:27.041945 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1195/2382] 10.222.0.39 () {54 vars in 921 bytes} [Tue Jul 26 04:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:58:27.046930 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dca69b-1611-4887-aadd-13dc3813f70b None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:27.047210 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dca69b-1611-4887-aadd-13dc3813f70b None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:27.047482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dca69b-1611-4887-aadd-13dc3813f70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:27.068620 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-43dca69b-1611-4887-aadd-13dc3813f70b None None] MFA Rules not processed for user `74fee029d5214ce18b4b9ddc2df72a23`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:58:27.069913 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-43dca69b-1611-4887-aadd-13dc3813f70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:27.077577 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1188/2383] 10.222.0.39 () {58 vars in 1018 bytes} [Tue Jul 26 04:58:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:58:27.089688 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e93d7-44af-48d6-8e99-7c2056ef4092 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:27.103352 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e93d7-44af-48d6-8e99-7c2056ef4092 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:27.107671 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c31c9-955e-42e7-b19b-b6818334366b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:27.108279 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c31c9-955e-42e7-b19b-b6818334366b service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:27.108554 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c31c9-955e-42e7-b19b-b6818334366b service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:27.108819 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c31c9-955e-42e7-b19b-b6818334366b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:27.117413 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c31c9-955e-42e7-b19b-b6818334366b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:27.119654 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c31c9-955e-42e7-b19b-b6818334366b service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:27.127676 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1196/2384] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:58:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:58:27.230840 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fd445-7bc1-463b-91a5-d3693249e85a None None] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:27.231152 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fd445-7bc1-463b-91a5-d3693249e85a None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:27.231427 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fd445-7bc1-463b-91a5-d3693249e85a None None] PATH_INFO: `/` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:27.233191 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1189/2385] 10.222.0.39 () {54 vars in 921 bytes} [Tue Jul 26 04:58:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 26 04:58:27.239645 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69373707-f1fd-4a9a-b63e-ce1ff84b9f7f None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:27.239930 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69373707-f1fd-4a9a-b63e-ce1ff84b9f7f None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:27.240282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69373707-f1fd-4a9a-b63e-ce1ff84b9f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:27.266721 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-69373707-f1fd-4a9a-b63e-ce1ff84b9f7f None None] MFA Rules not processed for user `ae8593e125da4b208dd100608aa2b462`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:58:27.267955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-69373707-f1fd-4a9a-b63e-ce1ff84b9f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:27.281338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1197/2386] 10.222.0.39 () {58 vars in 1018 bytes} [Tue Jul 26 04:58:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:58:27.292652 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fd445-7bc1-463b-91a5-d3693249e85a None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:27.294797 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-e20fd445-7bc1-463b-91a5-d3693249e85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:27.311597 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fd445-7bc1-463b-91a5-d3693249e85a None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:27.315509 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafe1c7-e2b0-4d7c-b337-c30d0ae611dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:27.316126 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafe1c7-e2b0-4d7c-b337-c30d0ae611dc service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:27.316403 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafe1c7-e2b0-4d7c-b337-c30d0ae611dc service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:27.316669 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafe1c7-e2b0-4d7c-b337-c30d0ae611dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:27.327189 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafe1c7-e2b0-4d7c-b337-c30d0ae611dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:27.328624 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafe1c7-e2b0-4d7c-b337-c30d0ae611dc service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:27.339397 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1190/2387] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:58:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:58:28.809940 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69373707-f1fd-4a9a-b63e-ce1ff84b9f7f None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:28.845504 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:28.876321 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69373707-f1fd-4a9a-b63e-ce1ff84b9f7f None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:28.881071 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82889336-c076-44b3-90a4-d4e92fa980c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:28.881664 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82889336-c076-44b3-90a4-d4e92fa980c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:28.881942 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82889336-c076-44b3-90a4-d4e92fa980c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:28.882257 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82889336-c076-44b3-90a4-d4e92fa980c1 admin admin] PATH_INFO: `/v3/users/d9e0168811ee4f5e87b8b9277336c52b` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:28.883475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82889336-c076-44b3-90a4-d4e92fa980c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9e0168811ee4f5e87b8b9277336c52b)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:28.885452 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82889336-c076-44b3-90a4-d4e92fa980c1 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:28.933959 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-82889336-c076-44b3-90a4-d4e92fa980c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9e0168811ee4f5e87b8b9277336c52b'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:28.934663 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-82889336-c076-44b3-90a4-d4e92fa980c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9e0168811ee4f5e87b8b9277336c52b'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:28.943098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-82889336-c076-44b3-90a4-d4e92fa980c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9e0168811ee4f5e87b8b9277336c52b'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:28.954904 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-82889336-c076-44b3-90a4-d4e92fa980c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9e0168811ee4f5e87b8b9277336c52b'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:28.962361 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-82889336-c076-44b3-90a4-d4e92fa980c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9e0168811ee4f5e87b8b9277336c52b'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:28.968760 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1198/2388] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:58:28 2022] DELETE /identity/v3/users/d9e0168811ee4f5e87b8b9277336c52b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:58:28.973520 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f19ca-3e6a-429e-8876-6bab9904c039 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:28.974069 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f19ca-3e6a-429e-8876-6bab9904c039 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:28.974199 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f19ca-3e6a-429e-8876-6bab9904c039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:28.993895 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-da1f19ca-3e6a-429e-8876-6bab9904c039 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:58:28.995515 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-da1f19ca-3e6a-429e-8876-6bab9904c039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:29.059164 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1191/2389] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:58:29.069331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82889336-c076-44b3-90a4-d4e92fa980c1 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:29.071113 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-82889336-c076-44b3-90a4-d4e92fa980c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:29.131921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82889336-c076-44b3-90a4-d4e92fa980c1 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:29.136583 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e02a3f-8b1b-42fc-9801-29b33dcd2f62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:29.137223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e02a3f-8b1b-42fc-9801-29b33dcd2f62 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:29.137602 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e02a3f-8b1b-42fc-9801-29b33dcd2f62 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:29.137892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e02a3f-8b1b-42fc-9801-29b33dcd2f62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:29.150425 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e02a3f-8b1b-42fc-9801-29b33dcd2f62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:29.152057 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e02a3f-8b1b-42fc-9801-29b33dcd2f62 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:29.163588 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1199/2390] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:58:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:58:29.209671 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736b18f-2029-4e2f-baff-4331a665c9f3 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:29.210621 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736b18f-2029-4e2f-baff-4331a665c9f3 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:29.211109 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736b18f-2029-4e2f-baff-4331a665c9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:29.234273 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-5736b18f-2029-4e2f-baff-4331a665c9f3 None None] MFA Rules not processed for user `b613dee1148c4822af2e7847b28cf4aa`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:58:29.235504 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-5736b18f-2029-4e2f-baff-4331a665c9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:29.284825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:29.325184 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1192/2391] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Jul 26 04:58:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:58:29.339836 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e02a3f-8b1b-42fc-9801-29b33dcd2f62 service neutron] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:29.341342 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-87e02a3f-8b1b-42fc-9801-29b33dcd2f62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:29.403103 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:29.419275 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e02a3f-8b1b-42fc-9801-29b33dcd2f62 service neutron] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:29.426830 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc845a13-38d1-4bcc-b9bc-3b90f6401e6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e089e39e9de419b9e2fb1d7fc2d245a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:29.428324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc845a13-38d1-4bcc-b9bc-3b90f6401e6c service swift] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:29.428324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc845a13-38d1-4bcc-b9bc-3b90f6401e6c service swift] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:29.428540 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc845a13-38d1-4bcc-b9bc-3b90f6401e6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:29.440300 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc845a13-38d1-4bcc-b9bc-3b90f6401e6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:29.442111 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc845a13-38d1-4bcc-b9bc-3b90f6401e6c service swift] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:29.450653 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1200/2392] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 04:58:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 04:58:29.458008 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736b18f-2029-4e2f-baff-4331a665c9f3 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:29.459812 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-5736b18f-2029-4e2f-baff-4331a665c9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:29.474894 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736b18f-2029-4e2f-baff-4331a665c9f3 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:29.480075 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45399471-f546-42e5-9c10-0afd9c98d9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:29.481010 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45399471-f546-42e5-9c10-0afd9c98d9ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:29.481294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45399471-f546-42e5-9c10-0afd9c98d9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:29.481735 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45399471-f546-42e5-9c10-0afd9c98d9ed admin admin] PATH_INFO: `/v3/projects/188a6b52938b45d88c97fd72896bca3e` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:29.483147 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45399471-f546-42e5-9c10-0afd9c98d9ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=188a6b52938b45d88c97fd72896bca3e)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:29.485414 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45399471-f546-42e5-9c10-0afd9c98d9ed admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:29.545576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-45399471-f546-42e5-9c10-0afd9c98d9ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '188a6b52938b45d88c97fd72896bca3e', 'request_id': 'req-45399471-f546-42e5-9c10-0afd9c98d9ed'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:29.558016 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-45399471-f546-42e5-9c10-0afd9c98d9ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '188a6b52938b45d88c97fd72896bca3e', 'request_id': 'req-45399471-f546-42e5-9c10-0afd9c98d9ed'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:29.572991 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-45399471-f546-42e5-9c10-0afd9c98d9ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '188a6b52938b45d88c97fd72896bca3e', 'request_id': 'req-45399471-f546-42e5-9c10-0afd9c98d9ed'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:29.594369 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-45399471-f546-42e5-9c10-0afd9c98d9ed admin admin] The token cache is being invalidate because project 188a6b52938b45d88c97fd72896bca3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:58:29.595142 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-45399471-f546-42e5-9c10-0afd9c98d9ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:29.596417 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-45399471-f546-42e5-9c10-0afd9c98d9ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:29.600328 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1193/2393] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:58:29 2022] DELETE /identity/v3/projects/188a6b52938b45d88c97fd72896bca3e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:58:29.605374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc845a13-38d1-4bcc-b9bc-3b90f6401e6c service swift] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:29.628100 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc845a13-38d1-4bcc-b9bc-3b90f6401e6c service swift] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:29.709239 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73621734-faef-41bb-ab66-b2a366c40035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:29.710197 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73621734-faef-41bb-ab66-b2a366c40035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:29.710697 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73621734-faef-41bb-ab66-b2a366c40035 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:29.711262 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73621734-faef-41bb-ab66-b2a366c40035 admin admin] PATH_INFO: `/v3/users/adf34af336c64ae1b670c5541568b63a` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:29.713023 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73621734-faef-41bb-ab66-b2a366c40035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adf34af336c64ae1b670c5541568b63a)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:29.715132 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73621734-faef-41bb-ab66-b2a366c40035 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:29.770725 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-73621734-faef-41bb-ab66-b2a366c40035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adf34af336c64ae1b670c5541568b63a'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:29.771373 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-73621734-faef-41bb-ab66-b2a366c40035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adf34af336c64ae1b670c5541568b63a'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:29.780532 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-73621734-faef-41bb-ab66-b2a366c40035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adf34af336c64ae1b670c5541568b63a'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:29.796696 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-73621734-faef-41bb-ab66-b2a366c40035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adf34af336c64ae1b670c5541568b63a'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:29.804804 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-73621734-faef-41bb-ab66-b2a366c40035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adf34af336c64ae1b670c5541568b63a'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:29.811683 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1201/2394] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:58:29 2022] DELETE /identity/v3/users/adf34af336c64ae1b670c5541568b63a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:58:30.125785 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45399471-f546-42e5-9c10-0afd9c98d9ed admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:30.127599 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-45399471-f546-42e5-9c10-0afd9c98d9ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:30.154195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45399471-f546-42e5-9c10-0afd9c98d9ed admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:30.226347 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a899499-e07e-4c9f-8490-01392e0ae2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:30.226959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a899499-e07e-4c9f-8490-01392e0ae2c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:30.227241 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a899499-e07e-4c9f-8490-01392e0ae2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:30.227517 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a899499-e07e-4c9f-8490-01392e0ae2c0 admin admin] PATH_INFO: `/v3/projects/c7d35e30f9ac4b2eb26f3a38152fb8ba` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:30.228661 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a899499-e07e-4c9f-8490-01392e0ae2c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7d35e30f9ac4b2eb26f3a38152fb8ba)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:30.230746 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a899499-e07e-4c9f-8490-01392e0ae2c0 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:30.296284 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-9a899499-e07e-4c9f-8490-01392e0ae2c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7d35e30f9ac4b2eb26f3a38152fb8ba', 'request_id': 'req-9a899499-e07e-4c9f-8490-01392e0ae2c0'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:30.316508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-9a899499-e07e-4c9f-8490-01392e0ae2c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7d35e30f9ac4b2eb26f3a38152fb8ba', 'request_id': 'req-9a899499-e07e-4c9f-8490-01392e0ae2c0'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:30.324796 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-9a899499-e07e-4c9f-8490-01392e0ae2c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7d35e30f9ac4b2eb26f3a38152fb8ba', 'request_id': 'req-9a899499-e07e-4c9f-8490-01392e0ae2c0'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:30.326031 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:30.339611 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-9a899499-e07e-4c9f-8490-01392e0ae2c0 admin admin] The token cache is being invalidate because project c7d35e30f9ac4b2eb26f3a38152fb8ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:58:30.339611 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-9a899499-e07e-4c9f-8490-01392e0ae2c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:30.340577 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-9a899499-e07e-4c9f-8490-01392e0ae2c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:30.342543 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1194/2395] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:58:30 2022] DELETE /identity/v3/projects/c7d35e30f9ac4b2eb26f3a38152fb8ba => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:58:30.348435 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710ae35-d035-4c18-bdb6-3b18fe0aeafc None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:30.348986 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710ae35-d035-4c18-bdb6-3b18fe0aeafc None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:30.349490 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710ae35-d035-4c18-bdb6-3b18fe0aeafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:30.383412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-1710ae35-d035-4c18-bdb6-3b18fe0aeafc None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:58:30.385298 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-1710ae35-d035-4c18-bdb6-3b18fe0aeafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:30.498061 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1202/2396] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:58:30.574117 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82111bbc-9778-4987-80a6-dff237ed9d2b None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:30.574409 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82111bbc-9778-4987-80a6-dff237ed9d2b None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:30.574824 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82111bbc-9778-4987-80a6-dff237ed9d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:30.602542 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-82111bbc-9778-4987-80a6-dff237ed9d2b None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:58:30.603792 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-82111bbc-9778-4987-80a6-dff237ed9d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:30.612555 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1195/2397] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:58:30.617236 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710ae35-d035-4c18-bdb6-3b18fe0aeafc None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:30.624095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:30.628527 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710ae35-d035-4c18-bdb6-3b18fe0aeafc None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:30.635925 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b43fc-6426-4faa-b8c4-808aa0fae669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:30.636645 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b43fc-6426-4faa-b8c4-808aa0fae669 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:30.636996 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b43fc-6426-4faa-b8c4-808aa0fae669 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:30.637416 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b43fc-6426-4faa-b8c4-808aa0fae669 admin admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:30.638205 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b43fc-6426-4faa-b8c4-808aa0fae669 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:58:30.638999 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b43fc-6426-4faa-b8c4-808aa0fae669 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:30.641104 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b43fc-6426-4faa-b8c4-808aa0fae669 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:30.654728 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1203/2398] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:58:30.659745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82111bbc-9778-4987-80a6-dff237ed9d2b None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:30.669913 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82111bbc-9778-4987-80a6-dff237ed9d2b None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:30.674991 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076fba2-fe77-48e3-a7ce-30273178d4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:30.675726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076fba2-fe77-48e3-a7ce-30273178d4b3 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:30.676019 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076fba2-fe77-48e3-a7ce-30273178d4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:30.676285 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9076fba2-fe77-48e3-a7ce-30273178d4b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:30.677021 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076fba2-fe77-48e3-a7ce-30273178d4b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:30.679201 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9076fba2-fe77-48e3-a7ce-30273178d4b3 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:30.716556 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1196/2399] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:58:30 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:58:30.721591 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b43fc-6426-4faa-b8c4-808aa0fae669 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:30.748398 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b43fc-6426-4faa-b8c4-808aa0fae669 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:30.810637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92dd478-eae5-4650-9752-71f12e190bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:30.811271 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92dd478-eae5-4650-9752-71f12e190bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:30.811542 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92dd478-eae5-4650-9752-71f12e190bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:30.811810 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92dd478-eae5-4650-9752-71f12e190bf7 admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:30.812502 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92dd478-eae5-4650-9752-71f12e190bf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:30.814504 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92dd478-eae5-4650-9752-71f12e190bf7 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:30.840622 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1204/2400] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:58:30 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:58:30.845056 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076fba2-fe77-48e3-a7ce-30273178d4b3 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:30.856473 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9076fba2-fe77-48e3-a7ce-30273178d4b3 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:30.861717 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9cd41-954f-4b70-a533-db17ce06e5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:30.862410 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9cd41-954f-4b70-a533-db17ce06e5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:30.862687 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9cd41-954f-4b70-a533-db17ce06e5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:30.862961 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9cd41-954f-4b70-a533-db17ce06e5a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:30.863681 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9cd41-954f-4b70-a533-db17ce06e5a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:30.865323 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9cd41-954f-4b70-a533-db17ce06e5a7 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:30.881288 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1197/2401] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:58:30.883695 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92dd478-eae5-4650-9752-71f12e190bf7 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:30.894648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92dd478-eae5-4650-9752-71f12e190bf7 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:30.899589 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79794f68-ba1a-4d26-adf0-0e0c90b400dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:30.900222 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79794f68-ba1a-4d26-adf0-0e0c90b400dc admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:30.900499 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79794f68-ba1a-4d26-adf0-0e0c90b400dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:30.900767 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79794f68-ba1a-4d26-adf0-0e0c90b400dc admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:30.901468 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79794f68-ba1a-4d26-adf0-0e0c90b400dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:30.903162 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79794f68-ba1a-4d26-adf0-0e0c90b400dc admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:30.918362 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1205/2402] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:58:30.919367 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9cd41-954f-4b70-a533-db17ce06e5a7 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:30.931000 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9cd41-954f-4b70-a533-db17ce06e5a7 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:30.936307 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebb838-a991-48c3-a2e7-5bb9b4a0c177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:30.937032 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebb838-a991-48c3-a2e7-5bb9b4a0c177 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:30.937314 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebb838-a991-48c3-a2e7-5bb9b4a0c177 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:30.937587 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebb838-a991-48c3-a2e7-5bb9b4a0c177 admin admin] PATH_INFO: `/v3/projects/49ae77be2b874df4b2205b5382465755/users/9c32c3e03ef14a8ab412af56cf446433/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:30.958506 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ebb838-a991-48c3-a2e7-5bb9b4a0c177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49ae77be2b874df4b2205b5382465755, user_id=9c32c3e03ef14a8ab412af56cf446433, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:30.961575 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ebb838-a991-48c3-a2e7-5bb9b4a0c177 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:30.977661 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1198/2403] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:58:30 2022] PUT /identity/v3/projects/49ae77be2b874df4b2205b5382465755/users/9c32c3e03ef14a8ab412af56cf446433/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:58:30.988144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b6685-5479-4672-9a4d-c417bb1ce926 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:30.988425 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b6685-5479-4672-9a4d-c417bb1ce926 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:30.988695 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b6685-5479-4672-9a4d-c417bb1ce926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:31.020629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-a37b6685-5479-4672-9a4d-c417bb1ce926 None None] MFA Rules not processed for user `9c32c3e03ef14a8ab412af56cf446433`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:58:31.021747 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-a37b6685-5479-4672-9a4d-c417bb1ce926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:31.092474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1206/2404] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:58:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:58:31.103981 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebb838-a991-48c3-a2e7-5bb9b4a0c177 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:31.105703 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-50ebb838-a991-48c3-a2e7-5bb9b4a0c177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:31.168705 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebb838-a991-48c3-a2e7-5bb9b4a0c177 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:31.173157 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896798f-b0f1-41f9-b283-bf2596eaaaa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:31.173803 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896798f-b0f1-41f9-b283-bf2596eaaaa5 service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:31.174072 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896798f-b0f1-41f9-b283-bf2596eaaaa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:31.174381 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896798f-b0f1-41f9-b283-bf2596eaaaa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:31.199008 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896798f-b0f1-41f9-b283-bf2596eaaaa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:31.200486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896798f-b0f1-41f9-b283-bf2596eaaaa5 service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:31.210577 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1199/2405] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:58:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:58:33.845467 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b6685-5479-4672-9a4d-c417bb1ce926 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:33.911124 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b6685-5479-4672-9a4d-c417bb1ce926 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:33.923775 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd13bb-86f0-4b14-8723-2bda80012fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:33.924459 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd13bb-86f0-4b14-8723-2bda80012fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:33.924732 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd13bb-86f0-4b14-8723-2bda80012fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:33.924999 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd13bb-86f0-4b14-8723-2bda80012fb8 admin admin] PATH_INFO: `/v3/users/9c32c3e03ef14a8ab412af56cf446433` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:33.926314 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd13bb-86f0-4b14-8723-2bda80012fb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c32c3e03ef14a8ab412af56cf446433)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:33.928308 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd13bb-86f0-4b14-8723-2bda80012fb8 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:33.930191 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:34.018660 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-b7bd13bb-86f0-4b14-8723-2bda80012fb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c32c3e03ef14a8ab412af56cf446433'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:34.019338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-b7bd13bb-86f0-4b14-8723-2bda80012fb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c32c3e03ef14a8ab412af56cf446433'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:34.043702 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-b7bd13bb-86f0-4b14-8723-2bda80012fb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c32c3e03ef14a8ab412af56cf446433'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:34.082729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-b7bd13bb-86f0-4b14-8723-2bda80012fb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c32c3e03ef14a8ab412af56cf446433'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:34.094597 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-b7bd13bb-86f0-4b14-8723-2bda80012fb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c32c3e03ef14a8ab412af56cf446433'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:34.104318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1207/2406] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:58:33 2022] DELETE /identity/v3/users/9c32c3e03ef14a8ab412af56cf446433 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:58:34.115613 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a1aea-6d23-4f43-99cc-1154ff1166dd None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:34.116086 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a1aea-6d23-4f43-99cc-1154ff1166dd None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:34.116288 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a1aea-6d23-4f43-99cc-1154ff1166dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:34.144385 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-190a1aea-6d23-4f43-99cc-1154ff1166dd None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:58:34.145770 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-190a1aea-6d23-4f43-99cc-1154ff1166dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:34.209439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1200/2407] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:58:34.219497 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd13bb-86f0-4b14-8723-2bda80012fb8 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:34.221000 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-b7bd13bb-86f0-4b14-8723-2bda80012fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:34.292526 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd13bb-86f0-4b14-8723-2bda80012fb8 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:34.296367 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a6dc1-e188-4daa-9995-012052ab014c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:34.297049 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a6dc1-e188-4daa-9995-012052ab014c service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:34.297334 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a6dc1-e188-4daa-9995-012052ab014c service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:34.297598 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a6dc1-e188-4daa-9995-012052ab014c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:34.307919 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a6dc1-e188-4daa-9995-012052ab014c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:34.309540 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a6dc1-e188-4daa-9995-012052ab014c service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:34.320510 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1208/2408] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:58:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:58:34.620469 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a1aea-6d23-4f43-99cc-1154ff1166dd None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:34.621959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-190a1aea-6d23-4f43-99cc-1154ff1166dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:34.636122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a1aea-6d23-4f43-99cc-1154ff1166dd None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:34.659731 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6f616-f5d2-44eb-bbed-e0cb2a233843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:34.661501 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6f616-f5d2-44eb-bbed-e0cb2a233843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:34.662681 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6f616-f5d2-44eb-bbed-e0cb2a233843 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:34.663193 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6f616-f5d2-44eb-bbed-e0cb2a233843 admin admin] PATH_INFO: `/v3/projects/49ae77be2b874df4b2205b5382465755` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:34.666655 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6f616-f5d2-44eb-bbed-e0cb2a233843 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49ae77be2b874df4b2205b5382465755)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:34.670695 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6f616-f5d2-44eb-bbed-e0cb2a233843 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:34.705972 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:34.723705 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2ac6f616-f5d2-44eb-bbed-e0cb2a233843 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49ae77be2b874df4b2205b5382465755', 'request_id': 'req-2ac6f616-f5d2-44eb-bbed-e0cb2a233843'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:34.734361 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2ac6f616-f5d2-44eb-bbed-e0cb2a233843 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49ae77be2b874df4b2205b5382465755', 'request_id': 'req-2ac6f616-f5d2-44eb-bbed-e0cb2a233843'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:34.743195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2ac6f616-f5d2-44eb-bbed-e0cb2a233843 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49ae77be2b874df4b2205b5382465755', 'request_id': 'req-2ac6f616-f5d2-44eb-bbed-e0cb2a233843'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:34.758266 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2ac6f616-f5d2-44eb-bbed-e0cb2a233843 admin admin] The token cache is being invalidate because project 49ae77be2b874df4b2205b5382465755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:58:34.758691 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2ac6f616-f5d2-44eb-bbed-e0cb2a233843 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:34.759426 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2ac6f616-f5d2-44eb-bbed-e0cb2a233843 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:58:34.761897 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1201/2409] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:58:34 2022] DELETE /identity/v3/projects/49ae77be2b874df4b2205b5382465755 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:58:34.767352 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db7e18-bee0-4a8e-8eca-f49c8d2a3d48 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:34.767697 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db7e18-bee0-4a8e-8eca-f49c8d2a3d48 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:34.767957 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db7e18-bee0-4a8e-8eca-f49c8d2a3d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:34.788035 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-f7db7e18-bee0-4a8e-8eca-f49c8d2a3d48 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:58:34.789221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-f7db7e18-bee0-4a8e-8eca-f49c8d2a3d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:34.848988 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1209/2410] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:58:34.857168 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4b530-a6c3-4e1f-a67e-9a4b16b7b3c3 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:34.857586 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4b530-a6c3-4e1f-a67e-9a4b16b7b3c3 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:34.858220 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4b530-a6c3-4e1f-a67e-9a4b16b7b3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:34.880859 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-35f4b530-a6c3-4e1f-a67e-9a4b16b7b3c3 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:58:34.882161 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-35f4b530-a6c3-4e1f-a67e-9a4b16b7b3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:34.890838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1202/2411] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:58:34.895512 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db7e18-bee0-4a8e-8eca-f49c8d2a3d48 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:34.905927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db7e18-bee0-4a8e-8eca-f49c8d2a3d48 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:34.910634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299b08f-3950-462a-804c-f5e1c2783f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:34.911269 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299b08f-3950-462a-804c-f5e1c2783f45 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:34.911553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299b08f-3950-462a-804c-f5e1c2783f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:34.911816 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299b08f-3950-462a-804c-f5e1c2783f45 admin admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:34.912526 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299b08f-3950-462a-804c-f5e1c2783f45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:58:34.912847 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299b08f-3950-462a-804c-f5e1c2783f45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:34.914499 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299b08f-3950-462a-804c-f5e1c2783f45 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:34.926831 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1210/2412] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:58:34.931985 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4b530-a6c3-4e1f-a67e-9a4b16b7b3c3 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:34.942733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4b530-a6c3-4e1f-a67e-9a4b16b7b3c3 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:34.947289 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afc9de-ac6e-47f5-ad6b-4cac575a58a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:34.947916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afc9de-ac6e-47f5-ad6b-4cac575a58a9 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:34.948188 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afc9de-ac6e-47f5-ad6b-4cac575a58a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:34.948452 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afc9de-ac6e-47f5-ad6b-4cac575a58a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:34.949135 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7afc9de-ac6e-47f5-ad6b-4cac575a58a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:34.951121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7afc9de-ac6e-47f5-ad6b-4cac575a58a9 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:34.983510 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1203/2413] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:58:34 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:58:34.987918 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299b08f-3950-462a-804c-f5e1c2783f45 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:34.999628 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299b08f-3950-462a-804c-f5e1c2783f45 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:35.005054 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:35.064663 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7989a-62a3-466a-b508-66eeafbb63ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:35.065305 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7989a-62a3-466a-b508-66eeafbb63ad admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:35.065586 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7989a-62a3-466a-b508-66eeafbb63ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:35.065861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7989a-62a3-466a-b508-66eeafbb63ad admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:35.066585 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c7989a-62a3-466a-b508-66eeafbb63ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:35.068547 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c7989a-62a3-466a-b508-66eeafbb63ad admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:35.093751 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1211/2414] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:58:34 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:58:35.098292 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afc9de-ac6e-47f5-ad6b-4cac575a58a9 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:35.111255 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afc9de-ac6e-47f5-ad6b-4cac575a58a9 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:35.117497 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7e140-6429-4025-bc12-529d61a34d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:35.118192 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7e140-6429-4025-bc12-529d61a34d12 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:35.118444 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7e140-6429-4025-bc12-529d61a34d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:35.118707 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7e140-6429-4025-bc12-529d61a34d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:35.119774 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7e140-6429-4025-bc12-529d61a34d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:35.121411 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7e140-6429-4025-bc12-529d61a34d12 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:35.133253 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1204/2415] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:58:35.137732 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7989a-62a3-466a-b508-66eeafbb63ad admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:35.156098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7989a-62a3-466a-b508-66eeafbb63ad admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:35.167196 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a554664-9040-4a01-bd84-a5a0f9e354e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:35.167875 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a554664-9040-4a01-bd84-a5a0f9e354e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:35.169537 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a554664-9040-4a01-bd84-a5a0f9e354e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:35.169537 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a554664-9040-4a01-bd84-a5a0f9e354e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:35.169537 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a554664-9040-4a01-bd84-a5a0f9e354e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:35.170987 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a554664-9040-4a01-bd84-a5a0f9e354e4 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:35.184795 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1212/2416] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:58:35.189076 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7e140-6429-4025-bc12-529d61a34d12 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:35.200288 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7e140-6429-4025-bc12-529d61a34d12 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:35.211334 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d7216-5fe0-413c-b8b4-22b9832c78bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:35.212250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d7216-5fe0-413c-b8b4-22b9832c78bf admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:35.212618 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d7216-5fe0-413c-b8b4-22b9832c78bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:35.213009 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d7216-5fe0-413c-b8b4-22b9832c78bf admin admin] PATH_INFO: `/v3/projects/cff1cc1ac1624886af7e64f38e56677c/users/ec90471b053540e898c8b48051cb7ec3/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:35.229656 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d7216-5fe0-413c-b8b4-22b9832c78bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cff1cc1ac1624886af7e64f38e56677c, user_id=ec90471b053540e898c8b48051cb7ec3, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:35.232573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d7216-5fe0-413c-b8b4-22b9832c78bf admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:35.249269 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1205/2417] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:58:35 2022] PUT /identity/v3/projects/cff1cc1ac1624886af7e64f38e56677c/users/ec90471b053540e898c8b48051cb7ec3/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:58:35.263078 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e656f-0a26-4517-8822-0f958cf7c888 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:35.263452 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e656f-0a26-4517-8822-0f958cf7c888 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:35.264503 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e656f-0a26-4517-8822-0f958cf7c888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:35.305756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-226e656f-0a26-4517-8822-0f958cf7c888 None None] MFA Rules not processed for user `ec90471b053540e898c8b48051cb7ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:58:35.307317 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-226e656f-0a26-4517-8822-0f958cf7c888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:35.397737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1213/2418] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:58:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:58:35.408394 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d7216-5fe0-413c-b8b4-22b9832c78bf admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:35.410152 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-504d7216-5fe0-413c-b8b4-22b9832c78bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:35.471885 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d7216-5fe0-413c-b8b4-22b9832c78bf admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:35.475525 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b0dd4-3e99-48d8-902f-dd433f149c2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:35.476183 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b0dd4-3e99-48d8-902f-dd433f149c2b service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:35.476461 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b0dd4-3e99-48d8-902f-dd433f149c2b service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:35.476730 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b0dd4-3e99-48d8-902f-dd433f149c2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:35.486080 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b0dd4-3e99-48d8-902f-dd433f149c2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:35.487563 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b0dd4-3e99-48d8-902f-dd433f149c2b service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:35.497486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1206/2419] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:58:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:58:36.525299 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e656f-0a26-4517-8822-0f958cf7c888 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:36.527474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-226e656f-0a26-4517-8822-0f958cf7c888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:36.614484 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e656f-0a26-4517-8822-0f958cf7c888 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:36.620496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e195025-16ca-46fe-bc12-7c607e2c9302 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:36.621141 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e195025-16ca-46fe-bc12-7c607e2c9302 service nova] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:36.621484 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e195025-16ca-46fe-bc12-7c607e2c9302 service nova] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:36.621903 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e195025-16ca-46fe-bc12-7c607e2c9302 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:36.623891 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-0e195025-16ca-46fe-bc12-7c607e2c9302 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:36.638376 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:36.701928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e195025-16ca-46fe-bc12-7c607e2c9302 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:36.704405 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e195025-16ca-46fe-bc12-7c607e2c9302 service nova] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:36.714559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1214/2420] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:58:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:58:36.893117 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaaabe6-b9b1-4083-919a-fadec6ad49ae None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:36.893656 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaaabe6-b9b1-4083-919a-fadec6ad49ae None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:36.893755 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaaabe6-b9b1-4083-919a-fadec6ad49ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:36.914940 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-beaaabe6-b9b1-4083-919a-fadec6ad49ae None None] MFA Rules not processed for user `ec90471b053540e898c8b48051cb7ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:58:36.916182 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-beaaabe6-b9b1-4083-919a-fadec6ad49ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:36.924792 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1207/2421] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:58:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:58:44.223247 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e195025-16ca-46fe-bc12-7c607e2c9302 service nova] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:44.225013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-0e195025-16ca-46fe-bc12-7c607e2c9302 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:44.259170 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e195025-16ca-46fe-bc12-7c607e2c9302 service nova] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:44.270682 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984e0ca-dd21-4468-940a-3cd9b67796af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:44.271349 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984e0ca-dd21-4468-940a-3cd9b67796af service nova] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:44.271621 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984e0ca-dd21-4468-940a-3cd9b67796af service nova] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:44.271891 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f984e0ca-dd21-4468-940a-3cd9b67796af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:44.273774 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-f984e0ca-dd21-4468-940a-3cd9b67796af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:44.290084 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984e0ca-dd21-4468-940a-3cd9b67796af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:44.291795 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f984e0ca-dd21-4468-940a-3cd9b67796af service nova] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:44.304198 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1215/2422] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:58:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:58:46.908810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=70,keystone:DELETE=5,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:48.872056 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585da9bf-ed15-4cc5-af8e-eca2eaf08d48 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:48.872633 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585da9bf-ed15-4cc5-af8e-eca2eaf08d48 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:48.872633 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585da9bf-ed15-4cc5-af8e-eca2eaf08d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:48.892213 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-585da9bf-ed15-4cc5-af8e-eca2eaf08d48 None None] MFA Rules not processed for user `b613dee1148c4822af2e7847b28cf4aa`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:58:48.893482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-585da9bf-ed15-4cc5-af8e-eca2eaf08d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:48.951746 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1208/2423] 10.222.0.39 () {58 vars in 967 bytes} [Tue Jul 26 04:58:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:58:48.965752 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984e0ca-dd21-4468-940a-3cd9b67796af service nova] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:48.967399 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-f984e0ca-dd21-4468-940a-3cd9b67796af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:49.048242 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f984e0ca-dd21-4468-940a-3cd9b67796af service nova] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:49.054014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93028b8f-12af-4e72-9c75-d5c6db413977 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e089e39e9de419b9e2fb1d7fc2d245a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:49.054647 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93028b8f-12af-4e72-9c75-d5c6db413977 service swift] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:49.054931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93028b8f-12af-4e72-9c75-d5c6db413977 service swift] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:49.055204 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93028b8f-12af-4e72-9c75-d5c6db413977 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:49.063949 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93028b8f-12af-4e72-9c75-d5c6db413977 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:49.065587 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93028b8f-12af-4e72-9c75-d5c6db413977 service swift] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:49.073930 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1216/2424] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 04:58:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 04:58:58.943760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=25 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:59.071578 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=59 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:58:59.221557 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585da9bf-ed15-4cc5-af8e-eca2eaf08d48 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:58:59.223060 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-585da9bf-ed15-4cc5-af8e-eca2eaf08d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:59.309175 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585da9bf-ed15-4cc5-af8e-eca2eaf08d48 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:58:59.320568 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7fb74-cfa7-49e4-a874-d632f1615a89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:58:59.321432 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7fb74-cfa7-49e4-a874-d632f1615a89 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:58:59.321854 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7fb74-cfa7-49e4-a874-d632f1615a89 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:58:59.322424 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7fb74-cfa7-49e4-a874-d632f1615a89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:58:59.324613 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-3bf7fb74-cfa7-49e4-a874-d632f1615a89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:58:59.404879 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7fb74-cfa7-49e4-a874-d632f1615a89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:58:59.406458 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7fb74-cfa7-49e4-a874-d632f1615a89 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:58:59.419101 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1209/2425] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:58:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:59:01.072176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb9e6a-0a67-4024-9f71-d463489cc761 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:01.072759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb9e6a-0a67-4024-9f71-d463489cc761 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:01.073059 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb9e6a-0a67-4024-9f71-d463489cc761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:01.097532 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-c1bb9e6a-0a67-4024-9f71-d463489cc761 None None] MFA Rules not processed for user `b613dee1148c4822af2e7847b28cf4aa`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:01.099576 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-c1bb9e6a-0a67-4024-9f71-d463489cc761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:01.111425 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1217/2426] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Jul 26 04:59:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:59:01.127027 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7fb74-cfa7-49e4-a874-d632f1615a89 service neutron] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:01.141205 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7fb74-cfa7-49e4-a874-d632f1615a89 service neutron] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:01.147006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0add25-e0b8-4789-a671-c8f169d9b9a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e089e39e9de419b9e2fb1d7fc2d245a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:01.147733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0add25-e0b8-4789-a671-c8f169d9b9a2 service swift] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:01.148021 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0add25-e0b8-4789-a671-c8f169d9b9a2 service swift] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:01.148302 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0add25-e0b8-4789-a671-c8f169d9b9a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:01.157549 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0add25-e0b8-4789-a671-c8f169d9b9a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:01.159746 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0add25-e0b8-4789-a671-c8f169d9b9a2 service swift] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:01.169432 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1210/2427] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 04:59:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 04:59:01.838831 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08888e-d3ca-41d2-97f3-2e7427afdce5 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:01.839214 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08888e-d3ca-41d2-97f3-2e7427afdce5 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:01.839564 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08888e-d3ca-41d2-97f3-2e7427afdce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:01.867027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-8d08888e-d3ca-41d2-97f3-2e7427afdce5 None None] MFA Rules not processed for user `b613dee1148c4822af2e7847b28cf4aa`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:01.869562 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-8d08888e-d3ca-41d2-97f3-2e7427afdce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:01.878391 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1218/2428] 10.222.0.39 () {58 vars in 967 bytes} [Tue Jul 26 04:59:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:01.893659 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0add25-e0b8-4789-a671-c8f169d9b9a2 service swift] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:01.907211 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0add25-e0b8-4789-a671-c8f169d9b9a2 service swift] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:01.914509 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6efdeb5-944a-437a-b69d-412f85153bc6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e089e39e9de419b9e2fb1d7fc2d245a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:01.915134 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efdeb5-944a-437a-b69d-412f85153bc6 service swift] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:01.915731 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efdeb5-944a-437a-b69d-412f85153bc6 service swift] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:01.916269 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efdeb5-944a-437a-b69d-412f85153bc6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:01.928232 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6efdeb5-944a-437a-b69d-412f85153bc6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:01.930632 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6efdeb5-944a-437a-b69d-412f85153bc6 service swift] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:01.944243 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1211/2429] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 04:59:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 04:59:02.270735 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a20960-be47-4c46-be2f-620247200ed3 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:02.271443 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a20960-be47-4c46-be2f-620247200ed3 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:02.271443 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a20960-be47-4c46-be2f-620247200ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:02.293165 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-b9a20960-be47-4c46-be2f-620247200ed3 None None] MFA Rules not processed for user `b613dee1148c4822af2e7847b28cf4aa`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:02.294625 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-b9a20960-be47-4c46-be2f-620247200ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:02.302686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1219/2430] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Jul 26 04:59:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:02.315755 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6efdeb5-944a-437a-b69d-412f85153bc6 service swift] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:02.328505 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6efdeb5-944a-437a-b69d-412f85153bc6 service swift] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:02.335151 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a368f-05bf-4c4e-b3c0-67fb289cfe82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e089e39e9de419b9e2fb1d7fc2d245a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:02.335875 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a368f-05bf-4c4e-b3c0-67fb289cfe82 service swift] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:02.336158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a368f-05bf-4c4e-b3c0-67fb289cfe82 service swift] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:02.336435 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a368f-05bf-4c4e-b3c0-67fb289cfe82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:02.347221 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a368f-05bf-4c4e-b3c0-67fb289cfe82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:02.349019 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a368f-05bf-4c4e-b3c0-67fb289cfe82 service swift] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:02.359975 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1212/2431] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 04:59:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 04:59:02.736720 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbf1af-f909-4b48-a332-0c43ff6a29f1 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:02.737303 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbf1af-f909-4b48-a332-0c43ff6a29f1 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:02.737588 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbf1af-f909-4b48-a332-0c43ff6a29f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:02.762567 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-41dbf1af-f909-4b48-a332-0c43ff6a29f1 None None] MFA Rules not processed for user `b613dee1148c4822af2e7847b28cf4aa`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:02.763993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-41dbf1af-f909-4b48-a332-0c43ff6a29f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:02.772053 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1220/2432] 10.222.0.39 () {58 vars in 967 bytes} [Tue Jul 26 04:59:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:02.784840 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a368f-05bf-4c4e-b3c0-67fb289cfe82 service swift] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:02.796420 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a368f-05bf-4c4e-b3c0-67fb289cfe82 service swift] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:02.801878 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a1ca5-b07e-4c91-94a1-e1868f90ce20 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e089e39e9de419b9e2fb1d7fc2d245a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:02.802766 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a1ca5-b07e-4c91-94a1-e1868f90ce20 service swift] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:02.803240 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a1ca5-b07e-4c91-94a1-e1868f90ce20 service swift] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:02.803508 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a1ca5-b07e-4c91-94a1-e1868f90ce20 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:02.812384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a1ca5-b07e-4c91-94a1-e1868f90ce20 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:02.814106 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a1ca5-b07e-4c91-94a1-e1868f90ce20 service swift] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:02.822828 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1213/2433] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 04:59:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 26 04:59:03.392266 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbf1af-f909-4b48-a332-0c43ff6a29f1 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:03.399102 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-41dbf1af-f909-4b48-a332-0c43ff6a29f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:03.488446 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbf1af-f909-4b48-a332-0c43ff6a29f1 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:03.499951 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a1ca5-b07e-4c91-94a1-e1868f90ce20 service swift] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:03.501958 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-117a1ca5-b07e-4c91-94a1-e1868f90ce20 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:03.503588 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc445f3a-26be-4f95-af8b-180796cebadf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21dfe7b4d6524ec2885224d77395b00b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:03.504377 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc445f3a-26be-4f95-af8b-180796cebadf service placement] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:03.504522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc445f3a-26be-4f95-af8b-180796cebadf service placement] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:03.504855 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc445f3a-26be-4f95-af8b-180796cebadf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:03.507424 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-dc445f3a-26be-4f95-af8b-180796cebadf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:03.520651 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a1ca5-b07e-4c91-94a1-e1868f90ce20 service swift] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:03.521386 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc445f3a-26be-4f95-af8b-180796cebadf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:03.523111 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc445f3a-26be-4f95-af8b-180796cebadf service placement] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:03.525957 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99690c2-5564-45ce-afa7-ddcd658e8a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:03.526727 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99690c2-5564-45ce-afa7-ddcd658e8a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:03.527013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99690c2-5564-45ce-afa7-ddcd658e8a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:03.527396 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99690c2-5564-45ce-afa7-ddcd658e8a2e admin admin] PATH_INFO: `/v3/users/c3274391c65b4eeab0fcf22ca4f8b791` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:03.530456 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99690c2-5564-45ce-afa7-ddcd658e8a2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3274391c65b4eeab0fcf22ca4f8b791)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:03.532624 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99690c2-5564-45ce-afa7-ddcd658e8a2e admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:03.537756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1221/2434] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:59:03.600394 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-d99690c2-5564-45ce-afa7-ddcd658e8a2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3274391c65b4eeab0fcf22ca4f8b791'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:03.604499 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:03.610058 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-d99690c2-5564-45ce-afa7-ddcd658e8a2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3274391c65b4eeab0fcf22ca4f8b791'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:03.625709 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-d99690c2-5564-45ce-afa7-ddcd658e8a2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3274391c65b4eeab0fcf22ca4f8b791'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:03.633475 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-d99690c2-5564-45ce-afa7-ddcd658e8a2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3274391c65b4eeab0fcf22ca4f8b791'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:03.634339 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-d99690c2-5564-45ce-afa7-ddcd658e8a2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3274391c65b4eeab0fcf22ca4f8b791'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:03.641840 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1214/2435] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:59:03 2022] DELETE /identity/v3/users/c3274391c65b4eeab0fcf22ca4f8b791 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:03.864245 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc445f3a-26be-4f95-af8b-180796cebadf service placement] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:03.881003 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc445f3a-26be-4f95-af8b-180796cebadf service placement] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:03.956395 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57954b8-702a-46a7-b3fd-649fdbd6d5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:03.957456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57954b8-702a-46a7-b3fd-649fdbd6d5e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:03.958018 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57954b8-702a-46a7-b3fd-649fdbd6d5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:03.958575 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57954b8-702a-46a7-b3fd-649fdbd6d5e5 admin admin] PATH_INFO: `/v3/projects/4f326b7087404003a78eb6cd91822e5f` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:03.960316 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57954b8-702a-46a7-b3fd-649fdbd6d5e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f326b7087404003a78eb6cd91822e5f)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:03.963660 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57954b8-702a-46a7-b3fd-649fdbd6d5e5 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:04.050824 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-c57954b8-702a-46a7-b3fd-649fdbd6d5e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f326b7087404003a78eb6cd91822e5f', 'request_id': 'req-c57954b8-702a-46a7-b3fd-649fdbd6d5e5'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:04.074955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-c57954b8-702a-46a7-b3fd-649fdbd6d5e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f326b7087404003a78eb6cd91822e5f', 'request_id': 'req-c57954b8-702a-46a7-b3fd-649fdbd6d5e5'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:04.091262 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-c57954b8-702a-46a7-b3fd-649fdbd6d5e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f326b7087404003a78eb6cd91822e5f', 'request_id': 'req-c57954b8-702a-46a7-b3fd-649fdbd6d5e5'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:04.093835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:04.133457 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-c57954b8-702a-46a7-b3fd-649fdbd6d5e5 admin admin] The token cache is being invalidate because project 4f326b7087404003a78eb6cd91822e5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:59:04.133783 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-c57954b8-702a-46a7-b3fd-649fdbd6d5e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:04.135511 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-c57954b8-702a-46a7-b3fd-649fdbd6d5e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:04.139266 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1222/2436] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:59:03 2022] DELETE /identity/v3/projects/4f326b7087404003a78eb6cd91822e5f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:04.149603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f78e49-39c7-4eab-a7bb-327761d3c824 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:04.149897 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f78e49-39c7-4eab-a7bb-327761d3c824 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:04.150284 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f78e49-39c7-4eab-a7bb-327761d3c824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:04.185416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-91f78e49-39c7-4eab-a7bb-327761d3c824 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:04.186704 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-91f78e49-39c7-4eab-a7bb-327761d3c824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:04.313198 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1215/2437] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:59:04.315151 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e90b2-622c-4f21-ae83-57b341302541 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:04.315452 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e90b2-622c-4f21-ae83-57b341302541 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:04.315710 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e90b2-622c-4f21-ae83-57b341302541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:04.341369 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-6e9e90b2-622c-4f21-ae83-57b341302541 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:04.343012 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-6e9e90b2-622c-4f21-ae83-57b341302541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:04.355769 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1223/2438] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:59:04.362838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f78e49-39c7-4eab-a7bb-327761d3c824 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:04.373783 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f78e49-39c7-4eab-a7bb-327761d3c824 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:04.379745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a994a-fef2-48b5-b594-c5bd719ad4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:04.380391 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a994a-fef2-48b5-b594-c5bd719ad4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:04.380739 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a994a-fef2-48b5-b594-c5bd719ad4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:04.381023 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a994a-fef2-48b5-b594-c5bd719ad4d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:04.381883 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a994a-fef2-48b5-b594-c5bd719ad4d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:59:04.382229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a994a-fef2-48b5-b594-c5bd719ad4d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:04.383965 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a994a-fef2-48b5-b594-c5bd719ad4d2 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:04.398094 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1216/2439] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:59:04.402776 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e90b2-622c-4f21-ae83-57b341302541 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:04.412045 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e90b2-622c-4f21-ae83-57b341302541 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:04.416745 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268ee8c-0fdf-48e1-882a-cd92ca2264f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:04.417405 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268ee8c-0fdf-48e1-882a-cd92ca2264f8 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:04.417600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268ee8c-0fdf-48e1-882a-cd92ca2264f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:04.417862 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268ee8c-0fdf-48e1-882a-cd92ca2264f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:04.418593 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268ee8c-0fdf-48e1-882a-cd92ca2264f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:04.420509 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268ee8c-0fdf-48e1-882a-cd92ca2264f8 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:04.455448 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1224/2440] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:59:04 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:04.460044 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a994a-fef2-48b5-b594-c5bd719ad4d2 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:04.471491 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a994a-fef2-48b5-b594-c5bd719ad4d2 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:04.540146 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470002f-486f-41dc-9d5e-f11445d2e27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:04.540833 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470002f-486f-41dc-9d5e-f11445d2e27b admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:04.541068 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470002f-486f-41dc-9d5e-f11445d2e27b admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:04.541337 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470002f-486f-41dc-9d5e-f11445d2e27b admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:04.542079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470002f-486f-41dc-9d5e-f11445d2e27b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:04.544142 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470002f-486f-41dc-9d5e-f11445d2e27b admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:04.570179 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1217/2441] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:59:04 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:04.575655 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268ee8c-0fdf-48e1-882a-cd92ca2264f8 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:04.588001 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268ee8c-0fdf-48e1-882a-cd92ca2264f8 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:04.594383 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc58e3a-6ce7-484c-a772-6b1ba91b85ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:04.595185 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc58e3a-6ce7-484c-a772-6b1ba91b85ac admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:04.595520 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc58e3a-6ce7-484c-a772-6b1ba91b85ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:04.595783 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc58e3a-6ce7-484c-a772-6b1ba91b85ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:04.596515 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc58e3a-6ce7-484c-a772-6b1ba91b85ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:04.598793 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc58e3a-6ce7-484c-a772-6b1ba91b85ac admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:04.610325 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1225/2442] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:04.614724 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470002f-486f-41dc-9d5e-f11445d2e27b admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:04.626414 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470002f-486f-41dc-9d5e-f11445d2e27b admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:04.631567 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13b88c-0c25-41c2-8b32-ea8e4758f707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:04.632244 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13b88c-0c25-41c2-8b32-ea8e4758f707 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:04.632553 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13b88c-0c25-41c2-8b32-ea8e4758f707 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:04.632869 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13b88c-0c25-41c2-8b32-ea8e4758f707 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:04.633629 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13b88c-0c25-41c2-8b32-ea8e4758f707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:04.635339 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13b88c-0c25-41c2-8b32-ea8e4758f707 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:04.647362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1218/2443] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:04.653173 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc58e3a-6ce7-484c-a772-6b1ba91b85ac admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:04.663439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc58e3a-6ce7-484c-a772-6b1ba91b85ac admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:04.670876 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d868ae-fd10-447a-b1ba-6a0596f4708c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:04.671766 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d868ae-fd10-447a-b1ba-6a0596f4708c admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:04.672015 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d868ae-fd10-447a-b1ba-6a0596f4708c admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:04.672319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d868ae-fd10-447a-b1ba-6a0596f4708c admin admin] PATH_INFO: `/v3/projects/39950440180c4caa920ccd4df5467832/users/5e3b4843285e4cf2907e82e476f73f7d/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:04.690151 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d868ae-fd10-447a-b1ba-6a0596f4708c admin admin] RBAC: Authorizing `identity:create_grant(project_id=39950440180c4caa920ccd4df5467832, user_id=5e3b4843285e4cf2907e82e476f73f7d, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:04.692904 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d868ae-fd10-447a-b1ba-6a0596f4708c admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:04.708043 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1226/2444] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:59:04 2022] PUT /identity/v3/projects/39950440180c4caa920ccd4df5467832/users/5e3b4843285e4cf2907e82e476f73f7d/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:59:04.718770 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476bc97-4959-4b7c-9f13-c3974eb9667d None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:04.719158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476bc97-4959-4b7c-9f13-c3974eb9667d None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:04.719583 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476bc97-4959-4b7c-9f13-c3974eb9667d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:04.753020 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-9476bc97-4959-4b7c-9f13-c3974eb9667d None None] MFA Rules not processed for user `5e3b4843285e4cf2907e82e476f73f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:04.754399 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-9476bc97-4959-4b7c-9f13-c3974eb9667d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:04.780536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:04.826189 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1219/2445] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:59:04.837760 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d868ae-fd10-447a-b1ba-6a0596f4708c admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:04.839562 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-b2d868ae-fd10-447a-b1ba-6a0596f4708c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:04.923699 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d868ae-fd10-447a-b1ba-6a0596f4708c admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:04.929742 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e129f-a0be-4553-a348-ba2f71448b97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:04.930399 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e129f-a0be-4553-a348-ba2f71448b97 service nova] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:04.930682 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e129f-a0be-4553-a348-ba2f71448b97 service nova] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:04.930953 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e129f-a0be-4553-a348-ba2f71448b97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:04.939785 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e129f-a0be-4553-a348-ba2f71448b97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:04.941423 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e129f-a0be-4553-a348-ba2f71448b97 service nova] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:04.951225 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1227/2446] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:59:05.182087 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476bc97-4959-4b7c-9f13-c3974eb9667d None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:05.251161 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476bc97-4959-4b7c-9f13-c3974eb9667d None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:05.256408 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904761e-834d-4e6d-9ab8-0db2577b79e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:05.257091 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904761e-834d-4e6d-9ab8-0db2577b79e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:05.257367 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904761e-834d-4e6d-9ab8-0db2577b79e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:05.257636 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904761e-834d-4e6d-9ab8-0db2577b79e3 admin admin] PATH_INFO: `/v3/users/5e3b4843285e4cf2907e82e476f73f7d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:05.259014 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904761e-834d-4e6d-9ab8-0db2577b79e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e3b4843285e4cf2907e82e476f73f7d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:05.261027 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904761e-834d-4e6d-9ab8-0db2577b79e3 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:05.316427 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-0904761e-834d-4e6d-9ab8-0db2577b79e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e3b4843285e4cf2907e82e476f73f7d'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:05.325934 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-0904761e-834d-4e6d-9ab8-0db2577b79e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e3b4843285e4cf2907e82e476f73f7d'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:05.338893 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-0904761e-834d-4e6d-9ab8-0db2577b79e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e3b4843285e4cf2907e82e476f73f7d'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:05.345776 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-0904761e-834d-4e6d-9ab8-0db2577b79e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e3b4843285e4cf2907e82e476f73f7d'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:05.346533 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-0904761e-834d-4e6d-9ab8-0db2577b79e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e3b4843285e4cf2907e82e476f73f7d'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:05.352885 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1220/2447] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:59:05 2022] DELETE /identity/v3/users/5e3b4843285e4cf2907e82e476f73f7d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:05.358575 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1a338-47ca-4c89-941d-b31e5b1a2f72 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:05.358863 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1a338-47ca-4c89-941d-b31e5b1a2f72 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:05.359142 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a1a338-47ca-4c89-941d-b31e5b1a2f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:05.383433 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-d4a1a338-47ca-4c89-941d-b31e5b1a2f72 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:05.385292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-d4a1a338-47ca-4c89-941d-b31e5b1a2f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:05.393847 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904761e-834d-4e6d-9ab8-0db2577b79e3 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:05.395758 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-0904761e-834d-4e6d-9ab8-0db2577b79e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:05.461412 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:05.492944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904761e-834d-4e6d-9ab8-0db2577b79e3 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:05.494830 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1228/2448] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:05.502594 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657a26c-dcca-4b72-ac05-6649403fceba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:05.504309 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657a26c-dcca-4b72-ac05-6649403fceba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:05.504309 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657a26c-dcca-4b72-ac05-6649403fceba admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:05.504309 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7657a26c-dcca-4b72-ac05-6649403fceba admin admin] PATH_INFO: `/v3/users/ec90471b053540e898c8b48051cb7ec3` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:05.505525 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657a26c-dcca-4b72-ac05-6649403fceba admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec90471b053540e898c8b48051cb7ec3)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:05.507565 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7657a26c-dcca-4b72-ac05-6649403fceba admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:05.517719 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1a338-47ca-4c89-941d-b31e5b1a2f72 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:05.519397 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-d4a1a338-47ca-4c89-941d-b31e5b1a2f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:05.551715 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:05.567450 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-7657a26c-dcca-4b72-ac05-6649403fceba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec90471b053540e898c8b48051cb7ec3'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:05.576974 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-7657a26c-dcca-4b72-ac05-6649403fceba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec90471b053540e898c8b48051cb7ec3'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:05.593679 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-7657a26c-dcca-4b72-ac05-6649403fceba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec90471b053540e898c8b48051cb7ec3'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:05.601031 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a1a338-47ca-4c89-941d-b31e5b1a2f72 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:05.601755 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-7657a26c-dcca-4b72-ac05-6649403fceba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec90471b053540e898c8b48051cb7ec3'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:05.602514 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-7657a26c-dcca-4b72-ac05-6649403fceba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec90471b053540e898c8b48051cb7ec3'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:05.605141 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a59dd-be7b-44e8-aa78-2a6c9bffa8cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:05.605788 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a59dd-be7b-44e8-aa78-2a6c9bffa8cd service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:05.606105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a59dd-be7b-44e8-aa78-2a6c9bffa8cd service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:05.606392 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a59dd-be7b-44e8-aa78-2a6c9bffa8cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:05.609940 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-598a59dd-be7b-44e8-aa78-2a6c9bffa8cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:05.610200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1221/2449] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:59:05 2022] DELETE /identity/v3/users/ec90471b053540e898c8b48051cb7ec3 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:05.610654 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657a26c-dcca-4b72-ac05-6649403fceba admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:05.612047 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-7657a26c-dcca-4b72-ac05-6649403fceba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:05.624156 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a59dd-be7b-44e8-aa78-2a6c9bffa8cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:05.625710 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a59dd-be7b-44e8-aa78-2a6c9bffa8cd service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:05.636438 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1229/2450] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:59:05.643918 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7764cf4-d091-4fdb-8da8-a99348019514 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:05.644351 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7764cf4-d091-4fdb-8da8-a99348019514 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:05.644802 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7764cf4-d091-4fdb-8da8-a99348019514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:05.668744 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-f7764cf4-d091-4fdb-8da8-a99348019514 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:05.670006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-f7764cf4-d091-4fdb-8da8-a99348019514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:05.698519 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7657a26c-dcca-4b72-ac05-6649403fceba admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:05.705748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52e92e-0f8e-4eb5-931c-2e155b3ff876 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:05.707025 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52e92e-0f8e-4eb5-931c-2e155b3ff876 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:05.707538 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52e92e-0f8e-4eb5-931c-2e155b3ff876 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:05.708040 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52e92e-0f8e-4eb5-931c-2e155b3ff876 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:05.711307 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-7d52e92e-0f8e-4eb5-931c-2e155b3ff876 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:05.753645 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1230/2451] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:05.763827 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7764cf4-d091-4fdb-8da8-a99348019514 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:05.774494 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7764cf4-d091-4fdb-8da8-a99348019514 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:05.778423 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f7d11-0e53-4640-8e17-a3f19a848a45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:05.779064 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f7d11-0e53-4640-8e17-a3f19a848a45 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:05.779398 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f7d11-0e53-4640-8e17-a3f19a848a45 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:05.779687 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f7d11-0e53-4640-8e17-a3f19a848a45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:05.790385 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f7d11-0e53-4640-8e17-a3f19a848a45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:05.792114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f7d11-0e53-4640-8e17-a3f19a848a45 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:05.807102 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1231/2452] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:59:05.808334 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52e92e-0f8e-4eb5-931c-2e155b3ff876 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:05.809830 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52e92e-0f8e-4eb5-931c-2e155b3ff876 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:05.821437 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1222/2453] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:59:06.030370 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f7d11-0e53-4640-8e17-a3f19a848a45 service neutron] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:06.032166 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-b20f7d11-0e53-4640-8e17-a3f19a848a45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:06.049083 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f7d11-0e53-4640-8e17-a3f19a848a45 service neutron] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:06.057420 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9c917-cc85-41d3-830d-a9de735f6e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:06.058191 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9c917-cc85-41d3-830d-a9de735f6e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:06.058476 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9c917-cc85-41d3-830d-a9de735f6e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:06.058751 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9c917-cc85-41d3-830d-a9de735f6e29 admin admin] PATH_INFO: `/v3/projects/39950440180c4caa920ccd4df5467832` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:06.060444 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9c917-cc85-41d3-830d-a9de735f6e29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39950440180c4caa920ccd4df5467832)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:06.062577 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9c917-cc85-41d3-830d-a9de735f6e29 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:06.141314 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52e92e-0f8e-4eb5-931c-2e155b3ff876 service neutron] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:06.143606 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-7d52e92e-0f8e-4eb5-931c-2e155b3ff876 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:06.154655 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-63a9c917-cc85-41d3-830d-a9de735f6e29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39950440180c4caa920ccd4df5467832', 'request_id': 'req-63a9c917-cc85-41d3-830d-a9de735f6e29'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:06.168140 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-63a9c917-cc85-41d3-830d-a9de735f6e29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39950440180c4caa920ccd4df5467832', 'request_id': 'req-63a9c917-cc85-41d3-830d-a9de735f6e29'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:06.173251 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52e92e-0f8e-4eb5-931c-2e155b3ff876 service neutron] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:06.179766 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-63a9c917-cc85-41d3-830d-a9de735f6e29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39950440180c4caa920ccd4df5467832', 'request_id': 'req-63a9c917-cc85-41d3-830d-a9de735f6e29'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:06.185962 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:06.197799 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-63a9c917-cc85-41d3-830d-a9de735f6e29 admin admin] The token cache is being invalidate because project 39950440180c4caa920ccd4df5467832 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:59:06.198286 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-63a9c917-cc85-41d3-830d-a9de735f6e29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:06.199043 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-63a9c917-cc85-41d3-830d-a9de735f6e29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:06.200660 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1232/2454] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:59:06 2022] DELETE /identity/v3/projects/39950440180c4caa920ccd4df5467832 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:06.207713 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01811491-623c-4ce7-a05c-11eb46cd51ff None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:06.208477 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01811491-623c-4ce7-a05c-11eb46cd51ff None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:06.208938 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01811491-623c-4ce7-a05c-11eb46cd51ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:06.232767 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-01811491-623c-4ce7-a05c-11eb46cd51ff None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:06.234387 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-01811491-623c-4ce7-a05c-11eb46cd51ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:06.273296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:06.284814 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2605049-5282-49fc-937f-9bc921fe3de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:06.284814 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2605049-5282-49fc-937f-9bc921fe3de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:06.284814 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2605049-5282-49fc-937f-9bc921fe3de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:06.284814 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2605049-5282-49fc-937f-9bc921fe3de6 admin admin] PATH_INFO: `/v3/projects/cff1cc1ac1624886af7e64f38e56677c` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:06.285279 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2605049-5282-49fc-937f-9bc921fe3de6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cff1cc1ac1624886af7e64f38e56677c)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:06.287218 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2605049-5282-49fc-937f-9bc921fe3de6 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:06.334965 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1233/2455] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:06.336631 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a37801-e8ba-4caa-b744-8c0141a85de8 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:06.336925 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a37801-e8ba-4caa-b744-8c0141a85de8 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:06.337203 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a37801-e8ba-4caa-b744-8c0141a85de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:06.353408 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f2605049-5282-49fc-937f-9bc921fe3de6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cff1cc1ac1624886af7e64f38e56677c', 'request_id': 'req-f2605049-5282-49fc-937f-9bc921fe3de6'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:06.360690 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-d2a37801-e8ba-4caa-b744-8c0141a85de8 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:06.361941 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-d2a37801-e8ba-4caa-b744-8c0141a85de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:06.364785 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f2605049-5282-49fc-937f-9bc921fe3de6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cff1cc1ac1624886af7e64f38e56677c', 'request_id': 'req-f2605049-5282-49fc-937f-9bc921fe3de6'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:06.375489 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f2605049-5282-49fc-937f-9bc921fe3de6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cff1cc1ac1624886af7e64f38e56677c', 'request_id': 'req-f2605049-5282-49fc-937f-9bc921fe3de6'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:06.393158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f2605049-5282-49fc-937f-9bc921fe3de6 admin admin] The token cache is being invalidate because project cff1cc1ac1624886af7e64f38e56677c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:59:06.393873 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f2605049-5282-49fc-937f-9bc921fe3de6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:06.394323 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f2605049-5282-49fc-937f-9bc921fe3de6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:06.396845 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1223/2456] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:59:06 2022] DELETE /identity/v3/projects/cff1cc1ac1624886af7e64f38e56677c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:59:06.402807 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1da9f4-0ed3-4784-b16f-62222d893859 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:06.404085 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1da9f4-0ed3-4784-b16f-62222d893859 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:06.404557 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1da9f4-0ed3-4784-b16f-62222d893859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:06.437591 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-4c1da9f4-0ed3-4784-b16f-62222d893859 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:06.439794 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-4c1da9f4-0ed3-4784-b16f-62222d893859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:06.457948 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1234/2457] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:06.462041 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a37801-e8ba-4caa-b744-8c0141a85de8 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:06.472224 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a37801-e8ba-4caa-b744-8c0141a85de8 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:06.477221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa38bfb-8d94-4888-b64f-9459b5cb80f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:06.477936 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa38bfb-8d94-4888-b64f-9459b5cb80f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:06.478354 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa38bfb-8d94-4888-b64f-9459b5cb80f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:06.478703 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa38bfb-8d94-4888-b64f-9459b5cb80f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:06.479483 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa38bfb-8d94-4888-b64f-9459b5cb80f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:59:06.479864 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa38bfb-8d94-4888-b64f-9459b5cb80f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:06.481595 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa38bfb-8d94-4888-b64f-9459b5cb80f0 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:06.502419 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1235/2458] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:59:06.503967 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa38bfb-8d94-4888-b64f-9459b5cb80f0 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:06.516081 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa38bfb-8d94-4888-b64f-9459b5cb80f0 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:06.521216 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9cbee8-d40a-4dfd-b7c4-7fd43aad3262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:06.521861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cbee8-d40a-4dfd-b7c4-7fd43aad3262 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:06.522522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cbee8-d40a-4dfd-b7c4-7fd43aad3262 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:06.523010 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cbee8-d40a-4dfd-b7c4-7fd43aad3262 admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:06.523785 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9cbee8-d40a-4dfd-b7c4-7fd43aad3262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:06.526416 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9cbee8-d40a-4dfd-b7c4-7fd43aad3262 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:06.543567 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1224/2459] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:59:06.553572 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fb567-2efc-4189-bf37-213c046ee0d8 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:06.554095 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fb567-2efc-4189-bf37-213c046ee0d8 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:06.554551 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fb567-2efc-4189-bf37-213c046ee0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:06.565292 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1236/2460] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:59:06 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:59:06.569873 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9cbee8-d40a-4dfd-b7c4-7fd43aad3262 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:06.585364 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-120fb567-2efc-4189-bf37-213c046ee0d8 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:06.587633 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-120fb567-2efc-4189-bf37-213c046ee0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:06.639171 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:06.662468 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9cbee8-d40a-4dfd-b7c4-7fd43aad3262 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:06.662905 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1225/2461] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:59:06.669240 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120fb567-2efc-4189-bf37-213c046ee0d8 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:06.670802 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73aa1d4-9a12-4e72-8429-133b6e236cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:06.672681 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73aa1d4-9a12-4e72-8429-133b6e236cb0 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:06.672681 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73aa1d4-9a12-4e72-8429-133b6e236cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:06.673051 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73aa1d4-9a12-4e72-8429-133b6e236cb0 admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:06.673799 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73aa1d4-9a12-4e72-8429-133b6e236cb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:06.676372 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73aa1d4-9a12-4e72-8429-133b6e236cb0 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:06.685857 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120fb567-2efc-4189-bf37-213c046ee0d8 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:06.694895 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a3383-e2e4-47f2-8c14-ecbcfcd440ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:06.696252 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a3383-e2e4-47f2-8c14-ecbcfcd440ae admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:06.696708 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a3383-e2e4-47f2-8c14-ecbcfcd440ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:06.697165 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a3383-e2e4-47f2-8c14-ecbcfcd440ae admin admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:06.698613 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a3383-e2e4-47f2-8c14-ecbcfcd440ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:59:06.699333 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a3383-e2e4-47f2-8c14-ecbcfcd440ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:06.700551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1237/2462] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:59:06 2022] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:06.703047 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a3383-e2e4-47f2-8c14-ecbcfcd440ae admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:06.704944 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73aa1d4-9a12-4e72-8429-133b6e236cb0 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:06.715556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73aa1d4-9a12-4e72-8429-133b6e236cb0 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:06.721487 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60736aa-917a-4a04-a04e-b2ec13a1339e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:06.722302 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60736aa-917a-4a04-a04e-b2ec13a1339e admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:06.722929 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60736aa-917a-4a04-a04e-b2ec13a1339e admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:06.722929 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60736aa-917a-4a04-a04e-b2ec13a1339e admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:06.723527 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60736aa-917a-4a04-a04e-b2ec13a1339e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:06.725608 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1226/2463] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:59:06.725805 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60736aa-917a-4a04-a04e-b2ec13a1339e admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:06.732182 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a3383-e2e4-47f2-8c14-ecbcfcd440ae admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:06.738249 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1238/2464] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:06.742686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60736aa-917a-4a04-a04e-b2ec13a1339e admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:06.747376 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a3383-e2e4-47f2-8c14-ecbcfcd440ae admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:06.753199 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295620df-8822-4073-8706-4d7451c18c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:06.754088 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295620df-8822-4073-8706-4d7451c18c5a admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:06.754471 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295620df-8822-4073-8706-4d7451c18c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:06.754825 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295620df-8822-4073-8706-4d7451c18c5a admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:06.755057 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60736aa-917a-4a04-a04e-b2ec13a1339e admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:06.755511 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295620df-8822-4073-8706-4d7451c18c5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:06.757624 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295620df-8822-4073-8706-4d7451c18c5a admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:06.760520 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748aa6a7-2727-4531-92c4-74986afeba6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:06.761146 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748aa6a7-2727-4531-92c4-74986afeba6c admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:06.761669 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748aa6a7-2727-4531-92c4-74986afeba6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:06.761956 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748aa6a7-2727-4531-92c4-74986afeba6c admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:06.763002 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748aa6a7-2727-4531-92c4-74986afeba6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:06.765030 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748aa6a7-2727-4531-92c4-74986afeba6c admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:06.780417 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1239/2465] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:59:06.785384 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748aa6a7-2727-4531-92c4-74986afeba6c admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:06.790659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:06.790833 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1227/2466] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:59:06 2022] POST /identity/v3/projects => generated 399 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:06.796030 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748aa6a7-2727-4531-92c4-74986afeba6c admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:06.796229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295620df-8822-4073-8706-4d7451c18c5a admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:06.858194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff5fe5-264d-442f-be25-622474269b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:06.859008 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff5fe5-264d-442f-be25-622474269b83 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:06.859345 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff5fe5-264d-442f-be25-622474269b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:06.859679 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff5fe5-264d-442f-be25-622474269b83 admin admin] PATH_INFO: `/v3/projects/92567817ba7a4deb8801c34a21726232/users/efa189e782b54c68bd48781470349fa6/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:06.870144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295620df-8822-4073-8706-4d7451c18c5a admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:06.875501 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d016d-474f-4b52-a369-a4f08ebfa960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:06.876229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d016d-474f-4b52-a369-a4f08ebfa960 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:06.876376 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff5fe5-264d-442f-be25-622474269b83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92567817ba7a4deb8801c34a21726232, user_id=efa189e782b54c68bd48781470349fa6, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:06.876539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d016d-474f-4b52-a369-a4f08ebfa960 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:06.876783 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d016d-474f-4b52-a369-a4f08ebfa960 admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:06.877452 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d016d-474f-4b52-a369-a4f08ebfa960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:06.879299 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff5fe5-264d-442f-be25-622474269b83 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:06.879511 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d016d-474f-4b52-a369-a4f08ebfa960 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:06.896224 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1240/2467] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:59:06 2022] PUT /identity/v3/projects/92567817ba7a4deb8801c34a21726232/users/efa189e782b54c68bd48781470349fa6/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:59:06.913050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1228/2468] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:59:06 2022] POST /identity/v3/users => generated 300 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:06.913234 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ac516-988e-4601-a2e2-c05a0c9e344e None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:06.913492 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ac516-988e-4601-a2e2-c05a0c9e344e None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:06.913765 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ac516-988e-4601-a2e2-c05a0c9e344e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:06.918443 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d016d-474f-4b52-a369-a4f08ebfa960 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:06.929557 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d016d-474f-4b52-a369-a4f08ebfa960 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:06.945684 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-e63ac516-988e-4601-a2e2-c05a0c9e344e None None] MFA Rules not processed for user `efa189e782b54c68bd48781470349fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:06.946974 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-e63ac516-988e-4601-a2e2-c05a0c9e344e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:07.018368 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255cc90-fe09-4caa-8441-06be91c5fdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:07.019017 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255cc90-fe09-4caa-8441-06be91c5fdae admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:07.019296 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255cc90-fe09-4caa-8441-06be91c5fdae admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:07.019567 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e255cc90-fe09-4caa-8441-06be91c5fdae admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:07.020272 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e255cc90-fe09-4caa-8441-06be91c5fdae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:07.022030 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e255cc90-fe09-4caa-8441-06be91c5fdae admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:07.036305 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1229/2469] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:59:07.037435 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255cc90-fe09-4caa-8441-06be91c5fdae admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:07.039530 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1241/2470] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:07.044118 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ac516-988e-4601-a2e2-c05a0c9e344e None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:07.054675 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e255cc90-fe09-4caa-8441-06be91c5fdae admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:07.060931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ac516-988e-4601-a2e2-c05a0c9e344e None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:07.066387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba424b-b6db-4d04-bfe2-98b350633c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:07.067615 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba424b-b6db-4d04-bfe2-98b350633c18 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:07.068096 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba424b-b6db-4d04-bfe2-98b350633c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:07.068575 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba424b-b6db-4d04-bfe2-98b350633c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:07.069168 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62f801-5c3d-49b5-814d-c098746e3e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:07.070006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62f801-5c3d-49b5-814d-c098746e3e96 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:07.070200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba424b-b6db-4d04-bfe2-98b350633c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:07.070682 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62f801-5c3d-49b5-814d-c098746e3e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:07.071110 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62f801-5c3d-49b5-814d-c098746e3e96 admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:07.072156 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62f801-5c3d-49b5-814d-c098746e3e96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:07.073143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba424b-b6db-4d04-bfe2-98b350633c18 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:07.075327 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62f801-5c3d-49b5-814d-c098746e3e96 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:07.098090 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1230/2471] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:07.099871 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba424b-b6db-4d04-bfe2-98b350633c18 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:07.117140 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1242/2472] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:59:07 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:59:07.122999 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62f801-5c3d-49b5-814d-c098746e3e96 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:07.125077 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba424b-b6db-4d04-bfe2-98b350633c18 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:07.161195 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:07.208403 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:07.224531 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6fbb8-f82f-4404-9440-6a82003d9939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:07.225781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6fbb8-f82f-4404-9440-6a82003d9939 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:07.226571 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6fbb8-f82f-4404-9440-6a82003d9939 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:07.227018 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6fbb8-f82f-4404-9440-6a82003d9939 admin admin] PATH_INFO: `/v3/projects/045faee3a9ab45fb91c942a1e6ac868f/users/ee9843902c7c45df956f8979940a3d2a/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:07.230402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62f801-5c3d-49b5-814d-c098746e3e96 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:07.241626 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0dbb6-5d33-4876-96e0-3040fdf9e77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:07.243436 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0dbb6-5d33-4876-96e0-3040fdf9e77d admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:07.244653 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0dbb6-5d33-4876-96e0-3040fdf9e77d admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:07.245146 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0dbb6-5d33-4876-96e0-3040fdf9e77d admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:07.247479 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe0dbb6-5d33-4876-96e0-3040fdf9e77d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:07.250217 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6fbb8-f82f-4404-9440-6a82003d9939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=045faee3a9ab45fb91c942a1e6ac868f, user_id=ee9843902c7c45df956f8979940a3d2a, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:07.251512 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe0dbb6-5d33-4876-96e0-3040fdf9e77d admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:07.256115 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6fbb8-f82f-4404-9440-6a82003d9939 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:07.282086 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1231/2473] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:59:07 2022] PUT /identity/v3/projects/045faee3a9ab45fb91c942a1e6ac868f/users/ee9843902c7c45df956f8979940a3d2a/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:59:07.291403 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508fac4-df75-4b62-9466-bde49412bca4 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:07.291719 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508fac4-df75-4b62-9466-bde49412bca4 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:07.292042 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508fac4-df75-4b62-9466-bde49412bca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:07.297093 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1243/2474] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:59:07 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:07.303637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0dbb6-5d33-4876-96e0-3040fdf9e77d admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:07.326941 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0dbb6-5d33-4876-96e0-3040fdf9e77d admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:07.336574 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-4508fac4-df75-4b62-9466-bde49412bca4 None None] MFA Rules not processed for user `ee9843902c7c45df956f8979940a3d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:07.338125 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-4508fac4-df75-4b62-9466-bde49412bca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:07.415209 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c26b77-1c42-400f-8c2b-3f8b4c51ef47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:07.416153 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c26b77-1c42-400f-8c2b-3f8b4c51ef47 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:07.416435 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c26b77-1c42-400f-8c2b-3f8b4c51ef47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:07.416708 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c26b77-1c42-400f-8c2b-3f8b4c51ef47 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:07.417455 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c26b77-1c42-400f-8c2b-3f8b4c51ef47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:07.419159 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c26b77-1c42-400f-8c2b-3f8b4c51ef47 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:07.434842 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1244/2475] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:07.438390 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c26b77-1c42-400f-8c2b-3f8b4c51ef47 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:07.453872 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1232/2476] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:59:07.454260 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c26b77-1c42-400f-8c2b-3f8b4c51ef47 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:07.460586 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cda867-378f-41e4-959c-d384c1b7b7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:07.461692 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cda867-378f-41e4-959c-d384c1b7b7f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:07.462200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cda867-378f-41e4-959c-d384c1b7b7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:07.462658 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cda867-378f-41e4-959c-d384c1b7b7f7 admin admin] PATH_INFO: `/v3/projects/f26f48f5d1ad427ea260f9cd64c108a4/users/c62e0f34bbd946e4a79ef6a20e41aaf1/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:07.465835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508fac4-df75-4b62-9466-bde49412bca4 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:07.468229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-4508fac4-df75-4b62-9466-bde49412bca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:07.483392 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cda867-378f-41e4-959c-d384c1b7b7f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f26f48f5d1ad427ea260f9cd64c108a4, user_id=c62e0f34bbd946e4a79ef6a20e41aaf1, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:07.489066 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cda867-378f-41e4-959c-d384c1b7b7f7 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:07.508772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1245/2477] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:59:07 2022] PUT /identity/v3/projects/f26f48f5d1ad427ea260f9cd64c108a4/users/c62e0f34bbd946e4a79ef6a20e41aaf1/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:07.513407 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cda867-378f-41e4-959c-d384c1b7b7f7 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:07.554994 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508fac4-df75-4b62-9466-bde49412bca4 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:07.616766 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cda867-378f-41e4-959c-d384c1b7b7f7 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:07.622978 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99110ed6-1df3-43f6-b3ec-72d4d7d11021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:07.623647 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99110ed6-1df3-43f6-b3ec-72d4d7d11021 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:07.623929 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99110ed6-1df3-43f6-b3ec-72d4d7d11021 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:07.624417 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99110ed6-1df3-43f6-b3ec-72d4d7d11021 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:07.625364 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99110ed6-1df3-43f6-b3ec-72d4d7d11021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:07.627196 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99110ed6-1df3-43f6-b3ec-72d4d7d11021 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:07.642071 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60205d8c-eb14-4d9c-b89a-8d7f0a5bf388 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:07.643094 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60205d8c-eb14-4d9c-b89a-8d7f0a5bf388 service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:07.643536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60205d8c-eb14-4d9c-b89a-8d7f0a5bf388 service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:07.643971 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60205d8c-eb14-4d9c-b89a-8d7f0a5bf388 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:07.651571 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1246/2478] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:07.653718 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99110ed6-1df3-43f6-b3ec-72d4d7d11021 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:07.660164 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:07.671632 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99110ed6-1df3-43f6-b3ec-72d4d7d11021 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:07.678307 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d344221-7fe8-462e-99a4-ffaf26797824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:07.679090 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d344221-7fe8-462e-99a4-ffaf26797824 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:07.679371 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d344221-7fe8-462e-99a4-ffaf26797824 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:07.679653 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d344221-7fe8-462e-99a4-ffaf26797824 admin admin] PATH_INFO: `/v3/projects/f26f48f5d1ad427ea260f9cd64c108a4/users/c62e0f34bbd946e4a79ef6a20e41aaf1/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:07.681858 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d344221-7fe8-462e-99a4-ffaf26797824 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f26f48f5d1ad427ea260f9cd64c108a4, user_id=c62e0f34bbd946e4a79ef6a20e41aaf1, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:07.684644 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d344221-7fe8-462e-99a4-ffaf26797824 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:07.706545 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1247/2479] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:59:07 2022] PUT /identity/v3/projects/f26f48f5d1ad427ea260f9cd64c108a4/users/c62e0f34bbd946e4a79ef6a20e41aaf1/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:07.717098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09809f-e95c-48cf-b071-858eb6147588 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:07.717369 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09809f-e95c-48cf-b071-858eb6147588 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:07.717649 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09809f-e95c-48cf-b071-858eb6147588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:07.751215 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-ad09809f-e95c-48cf-b071-858eb6147588 None None] MFA Rules not processed for user `c62e0f34bbd946e4a79ef6a20e41aaf1`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:07.752643 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-ad09809f-e95c-48cf-b071-858eb6147588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:07.762859 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60205d8c-eb14-4d9c-b89a-8d7f0a5bf388 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:07.764845 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60205d8c-eb14-4d9c-b89a-8d7f0a5bf388 service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:07.784545 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:07.785550 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1233/2480] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:07 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:59:07.844486 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1248/2481] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:07.857769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60205d8c-eb14-4d9c-b89a-8d7f0a5bf388 service cinder] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:07.876404 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60205d8c-eb14-4d9c-b89a-8d7f0a5bf388 service cinder] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:08.023027 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8761a3-2368-4255-b13f-990db19d2f99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:08.023923 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8761a3-2368-4255-b13f-990db19d2f99 service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:08.024478 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8761a3-2368-4255-b13f-990db19d2f99 service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:08.024638 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8761a3-2368-4255-b13f-990db19d2f99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:08.044423 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8761a3-2368-4255-b13f-990db19d2f99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:08.045880 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8761a3-2368-4255-b13f-990db19d2f99 service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:08.059624 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1234/2482] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:59:08.211864 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09809f-e95c-48cf-b071-858eb6147588 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:08.231766 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09809f-e95c-48cf-b071-858eb6147588 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:08.237080 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7a749-d7a8-4bd4-a9c4-bd1ea1d0097d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:08.237501 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7a749-d7a8-4bd4-a9c4-bd1ea1d0097d service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:08.238635 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7a749-d7a8-4bd4-a9c4-bd1ea1d0097d service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:08.238635 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7a749-d7a8-4bd4-a9c4-bd1ea1d0097d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:08.329540 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7a749-d7a8-4bd4-a9c4-bd1ea1d0097d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:08.331111 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f7a749-d7a8-4bd4-a9c4-bd1ea1d0097d service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:08.343225 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1249/2483] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:59:10.284769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8761a3-2368-4255-b13f-990db19d2f99 service cinder] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:10.284769 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-7b8761a3-2368-4255-b13f-990db19d2f99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:10.363907 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7a749-d7a8-4bd4-a9c4-bd1ea1d0097d service cinder] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:10.367156 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-d4f7a749-d7a8-4bd4-a9c4-bd1ea1d0097d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:10.390120 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8761a3-2368-4255-b13f-990db19d2f99 service cinder] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:10.395776 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843675e-d81a-49fd-bda2-3bd01588082c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21dfe7b4d6524ec2885224d77395b00b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:10.396421 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843675e-d81a-49fd-bda2-3bd01588082c service placement] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:10.396704 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843675e-d81a-49fd-bda2-3bd01588082c service placement] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:10.397308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843675e-d81a-49fd-bda2-3bd01588082c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:10.399492 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-d843675e-d81a-49fd-bda2-3bd01588082c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:10.411985 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843675e-d81a-49fd-bda2-3bd01588082c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:10.413597 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843675e-d81a-49fd-bda2-3bd01588082c service placement] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:10.424580 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1235/2484] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:59:10.452255 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7a749-d7a8-4bd4-a9c4-bd1ea1d0097d service cinder] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:10.457057 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834b7cd-db9d-4171-a862-c7b523e57105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:10.457715 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834b7cd-db9d-4171-a862-c7b523e57105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:10.458075 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834b7cd-db9d-4171-a862-c7b523e57105 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:10.458270 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834b7cd-db9d-4171-a862-c7b523e57105 admin admin] PATH_INFO: `/v3/users/1395843934af46cc90694bb1c0fc8a3c` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:10.459440 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834b7cd-db9d-4171-a862-c7b523e57105 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1395843934af46cc90694bb1c0fc8a3c)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:10.461387 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834b7cd-db9d-4171-a862-c7b523e57105 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:10.508163 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-9834b7cd-db9d-4171-a862-c7b523e57105 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1395843934af46cc90694bb1c0fc8a3c'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:10.508801 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-9834b7cd-db9d-4171-a862-c7b523e57105 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1395843934af46cc90694bb1c0fc8a3c'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:10.516825 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-9834b7cd-db9d-4171-a862-c7b523e57105 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1395843934af46cc90694bb1c0fc8a3c'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:10.524407 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:10.530563 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-9834b7cd-db9d-4171-a862-c7b523e57105 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1395843934af46cc90694bb1c0fc8a3c'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:10.538891 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-9834b7cd-db9d-4171-a862-c7b523e57105 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1395843934af46cc90694bb1c0fc8a3c'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:10.545329 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1250/2485] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:59:10 2022] DELETE /identity/v3/users/1395843934af46cc90694bb1c0fc8a3c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:59:10.729035 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843675e-d81a-49fd-bda2-3bd01588082c service placement] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:10.742834 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843675e-d81a-49fd-bda2-3bd01588082c service placement] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:10.786292 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:10.806390 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c31e5b-eca1-4176-9cef-de1347a2890b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:10.807049 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c31e5b-eca1-4176-9cef-de1347a2890b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:10.807329 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c31e5b-eca1-4176-9cef-de1347a2890b admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:10.807601 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c31e5b-eca1-4176-9cef-de1347a2890b admin admin] PATH_INFO: `/v3/projects/3dc8fb1619e243d4b25822821a8c3497` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:10.808869 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c31e5b-eca1-4176-9cef-de1347a2890b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dc8fb1619e243d4b25822821a8c3497)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:10.810815 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c31e5b-eca1-4176-9cef-de1347a2890b admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:10.867142 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-49c31e5b-eca1-4176-9cef-de1347a2890b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dc8fb1619e243d4b25822821a8c3497', 'request_id': 'req-49c31e5b-eca1-4176-9cef-de1347a2890b'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:10.878360 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-49c31e5b-eca1-4176-9cef-de1347a2890b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dc8fb1619e243d4b25822821a8c3497', 'request_id': 'req-49c31e5b-eca1-4176-9cef-de1347a2890b'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:10.886284 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-49c31e5b-eca1-4176-9cef-de1347a2890b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dc8fb1619e243d4b25822821a8c3497', 'request_id': 'req-49c31e5b-eca1-4176-9cef-de1347a2890b'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:10.899037 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-49c31e5b-eca1-4176-9cef-de1347a2890b admin admin] The token cache is being invalidate because project 3dc8fb1619e243d4b25822821a8c3497 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:59:10.899331 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-49c31e5b-eca1-4176-9cef-de1347a2890b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:10.900077 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-49c31e5b-eca1-4176-9cef-de1347a2890b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:10.901760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1236/2486] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:59:10 2022] DELETE /identity/v3/projects/3dc8fb1619e243d4b25822821a8c3497 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:10.907071 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d0bf7-905f-45fe-8a99-2a1633053ad1 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:10.907331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d0bf7-905f-45fe-8a99-2a1633053ad1 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:10.907694 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d0bf7-905f-45fe-8a99-2a1633053ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:10.931397 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-a79d0bf7-905f-45fe-8a99-2a1633053ad1 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:10.932656 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-a79d0bf7-905f-45fe-8a99-2a1633053ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:11.000121 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1251/2487] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:59:11.008324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6638812-31c8-4aae-8939-be641a00c32f None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:11.008612 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6638812-31c8-4aae-8939-be641a00c32f None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:11.008945 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6638812-31c8-4aae-8939-be641a00c32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:11.029547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-e6638812-31c8-4aae-8939-be641a00c32f None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:11.030808 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-e6638812-31c8-4aae-8939-be641a00c32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:11.039214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1237/2488] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:11.043729 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d0bf7-905f-45fe-8a99-2a1633053ad1 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:11.053922 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d0bf7-905f-45fe-8a99-2a1633053ad1 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:11.059985 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e7dff-ec03-46fb-bb73-5669d8265fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:11.060605 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e7dff-ec03-46fb-bb73-5669d8265fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:11.060878 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e7dff-ec03-46fb-bb73-5669d8265fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:11.061144 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e7dff-ec03-46fb-bb73-5669d8265fb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:11.061850 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e7dff-ec03-46fb-bb73-5669d8265fb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:59:11.062196 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e7dff-ec03-46fb-bb73-5669d8265fb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:11.063926 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e7dff-ec03-46fb-bb73-5669d8265fb4 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:11.076337 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1252/2489] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:59:11.081033 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6638812-31c8-4aae-8939-be641a00c32f None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:11.091066 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6638812-31c8-4aae-8939-be641a00c32f None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:11.096132 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449f76d-9da1-4ef4-aa2a-6a8ee7277a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:11.096687 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449f76d-9da1-4ef4-aa2a-6a8ee7277a4f admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:11.096956 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449f76d-9da1-4ef4-aa2a-6a8ee7277a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:11.097224 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449f76d-9da1-4ef4-aa2a-6a8ee7277a4f admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:11.097890 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c449f76d-9da1-4ef4-aa2a-6a8ee7277a4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:11.099868 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c449f76d-9da1-4ef4-aa2a-6a8ee7277a4f admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:11.131978 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1238/2490] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:59:11 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:11.136549 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e7dff-ec03-46fb-bb73-5669d8265fb4 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:11.147344 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e7dff-ec03-46fb-bb73-5669d8265fb4 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:11.204370 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24769710-53b3-4be0-9d05-47a55ff2725e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:11.205000 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24769710-53b3-4be0-9d05-47a55ff2725e admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:11.205275 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24769710-53b3-4be0-9d05-47a55ff2725e admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:11.205547 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24769710-53b3-4be0-9d05-47a55ff2725e admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:11.206288 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24769710-53b3-4be0-9d05-47a55ff2725e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:11.208273 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24769710-53b3-4be0-9d05-47a55ff2725e admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:11.232923 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1253/2491] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:59:11 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:11.234696 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449f76d-9da1-4ef4-aa2a-6a8ee7277a4f admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:11.246975 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449f76d-9da1-4ef4-aa2a-6a8ee7277a4f admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:11.253013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185856b8-d6d6-4e77-b0be-3c437b0c6fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:11.253682 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185856b8-d6d6-4e77-b0be-3c437b0c6fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:11.254003 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185856b8-d6d6-4e77-b0be-3c437b0c6fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:11.254286 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185856b8-d6d6-4e77-b0be-3c437b0c6fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:11.255085 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185856b8-d6d6-4e77-b0be-3c437b0c6fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:11.256670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185856b8-d6d6-4e77-b0be-3c437b0c6fa0 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:11.268526 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1239/2492] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:11.272441 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24769710-53b3-4be0-9d05-47a55ff2725e admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:11.283351 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24769710-53b3-4be0-9d05-47a55ff2725e admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:11.289019 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004aa5f-63cb-4da6-b375-0463fab042d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:11.289663 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004aa5f-63cb-4da6-b375-0463fab042d9 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:11.289938 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004aa5f-63cb-4da6-b375-0463fab042d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:11.290241 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004aa5f-63cb-4da6-b375-0463fab042d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:11.290946 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004aa5f-63cb-4da6-b375-0463fab042d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:11.292589 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004aa5f-63cb-4da6-b375-0463fab042d9 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:11.304125 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1254/2493] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:11.308534 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185856b8-d6d6-4e77-b0be-3c437b0c6fa0 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:11.322758 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185856b8-d6d6-4e77-b0be-3c437b0c6fa0 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:11.324460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6dac46-1794-437b-ae60-f06c51161852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:11.325151 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dac46-1794-437b-ae60-f06c51161852 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:11.325434 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dac46-1794-437b-ae60-f06c51161852 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:11.325710 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dac46-1794-437b-ae60-f06c51161852 admin admin] PATH_INFO: `/v3/projects/0fe497953eee49af904460506acb0242/users/aa0928ca8ac849f8a01cbee9297f6bc5/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:11.343800 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6dac46-1794-437b-ae60-f06c51161852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fe497953eee49af904460506acb0242, user_id=aa0928ca8ac849f8a01cbee9297f6bc5, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:11.346611 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6dac46-1794-437b-ae60-f06c51161852 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:11.364160 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1240/2494] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:59:11 2022] PUT /identity/v3/projects/0fe497953eee49af904460506acb0242/users/aa0928ca8ac849f8a01cbee9297f6bc5/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:11.375194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d483c9-52c7-422e-b701-cd1f248d38eb None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:11.375893 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d483c9-52c7-422e-b701-cd1f248d38eb None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:11.375893 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d483c9-52c7-422e-b701-cd1f248d38eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:11.404790 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-e3d483c9-52c7-422e-b701-cd1f248d38eb None None] MFA Rules not processed for user `aa0928ca8ac849f8a01cbee9297f6bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:11.405699 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-e3d483c9-52c7-422e-b701-cd1f248d38eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:11.454503 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:11.492141 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1255/2495] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:11.497739 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6dac46-1794-437b-ae60-f06c51161852 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:11.566226 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6dac46-1794-437b-ae60-f06c51161852 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:11.571211 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357c81b-d247-4b2d-8ba0-bd5e311cfa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:11.571844 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357c81b-d247-4b2d-8ba0-bd5e311cfa01 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:11.572121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357c81b-d247-4b2d-8ba0-bd5e311cfa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:11.572391 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357c81b-d247-4b2d-8ba0-bd5e311cfa01 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:11.573060 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357c81b-d247-4b2d-8ba0-bd5e311cfa01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:11.575086 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357c81b-d247-4b2d-8ba0-bd5e311cfa01 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:11.586714 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:11.605414 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1241/2496] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:59:11 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:11.609596 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d483c9-52c7-422e-b701-cd1f248d38eb None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:11.621472 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d483c9-52c7-422e-b701-cd1f248d38eb None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:11.688983 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20910929-da15-481d-9c17-837280786dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:11.689913 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20910929-da15-481d-9c17-837280786dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:11.690385 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20910929-da15-481d-9c17-837280786dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:11.690802 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20910929-da15-481d-9c17-837280786dd5 admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:11.691841 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20910929-da15-481d-9c17-837280786dd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:11.695024 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20910929-da15-481d-9c17-837280786dd5 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:11.724811 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1256/2497] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:59:11 2022] POST /identity/v3/users => generated 299 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:59:11.726342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357c81b-d247-4b2d-8ba0-bd5e311cfa01 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:11.739365 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357c81b-d247-4b2d-8ba0-bd5e311cfa01 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:11.744315 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c456b8a-ad90-4a61-a5ad-9590822a4039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:11.744941 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c456b8a-ad90-4a61-a5ad-9590822a4039 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:11.745255 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c456b8a-ad90-4a61-a5ad-9590822a4039 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:11.745898 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c456b8a-ad90-4a61-a5ad-9590822a4039 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:11.746650 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c456b8a-ad90-4a61-a5ad-9590822a4039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:11.748286 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c456b8a-ad90-4a61-a5ad-9590822a4039 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:11.760922 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1242/2498] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:11.765309 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20910929-da15-481d-9c17-837280786dd5 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:11.775815 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20910929-da15-481d-9c17-837280786dd5 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:11.780614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0593e8-adfd-40d7-a491-e5c14ca8934c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:11.781449 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0593e8-adfd-40d7-a491-e5c14ca8934c admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:11.781723 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0593e8-adfd-40d7-a491-e5c14ca8934c admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:11.782007 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0593e8-adfd-40d7-a491-e5c14ca8934c admin admin] PATH_INFO: `/v3/projects/19a5ba743cc84a99b4f69be9d37ab839/users/1f7b8a2d2dc44e79b2815340a2a8bfbe/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:11.798745 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0593e8-adfd-40d7-a491-e5c14ca8934c admin admin] RBAC: Authorizing `identity:create_grant(project_id=19a5ba743cc84a99b4f69be9d37ab839, user_id=1f7b8a2d2dc44e79b2815340a2a8bfbe, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:11.801426 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0593e8-adfd-40d7-a491-e5c14ca8934c admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:11.816119 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1257/2499] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:59:11 2022] PUT /identity/v3/projects/19a5ba743cc84a99b4f69be9d37ab839/users/1f7b8a2d2dc44e79b2815340a2a8bfbe/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:11.820599 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c456b8a-ad90-4a61-a5ad-9590822a4039 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:11.831350 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c456b8a-ad90-4a61-a5ad-9590822a4039 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:11.890788 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c69bb1e-788e-4c39-9112-dd405bd435a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:11.891310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69bb1e-788e-4c39-9112-dd405bd435a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:11.891573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69bb1e-788e-4c39-9112-dd405bd435a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:11.891888 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69bb1e-788e-4c39-9112-dd405bd435a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:11.892580 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c69bb1e-788e-4c39-9112-dd405bd435a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:11.894243 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c69bb1e-788e-4c39-9112-dd405bd435a3 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:11.908990 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1243/2500] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:11.913386 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0593e8-adfd-40d7-a491-e5c14ca8934c admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:11.924349 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0593e8-adfd-40d7-a491-e5c14ca8934c admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:11.929163 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8f58a-3baa-4fd0-81a0-d5626c46df48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:11.929832 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8f58a-3baa-4fd0-81a0-d5626c46df48 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:11.930147 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8f58a-3baa-4fd0-81a0-d5626c46df48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:11.930422 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8f58a-3baa-4fd0-81a0-d5626c46df48 admin admin] PATH_INFO: `/v3/projects/19a5ba743cc84a99b4f69be9d37ab839/users/1f7b8a2d2dc44e79b2815340a2a8bfbe/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:11.932400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b8f58a-3baa-4fd0-81a0-d5626c46df48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19a5ba743cc84a99b4f69be9d37ab839, user_id=1f7b8a2d2dc44e79b2815340a2a8bfbe, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:11.935117 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b8f58a-3baa-4fd0-81a0-d5626c46df48 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:11.945806 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1258/2501] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:59:11 2022] PUT /identity/v3/projects/19a5ba743cc84a99b4f69be9d37ab839/users/1f7b8a2d2dc44e79b2815340a2a8bfbe/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:11.957570 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85eee2-754c-4aa1-b0c1-f5698e3c41ad None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:11.957860 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85eee2-754c-4aa1-b0c1-f5698e3c41ad None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:11.958160 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85eee2-754c-4aa1-b0c1-f5698e3c41ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:11.988022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-eb85eee2-754c-4aa1-b0c1-f5698e3c41ad None None] MFA Rules not processed for user `1f7b8a2d2dc44e79b2815340a2a8bfbe`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:11.989726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-eb85eee2-754c-4aa1-b0c1-f5698e3c41ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:12.069286 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1244/2502] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:12.082428 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8f58a-3baa-4fd0-81a0-d5626c46df48 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:12.084220 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-64b8f58a-3baa-4fd0-81a0-d5626c46df48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:12.158852 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8f58a-3baa-4fd0-81a0-d5626c46df48 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:12.170005 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f1ae1-66a4-4868-a150-e71a68600701 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:12.170738 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f1ae1-66a4-4868-a150-e71a68600701 service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:12.171046 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f1ae1-66a4-4868-a150-e71a68600701 service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:12.171312 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f1ae1-66a4-4868-a150-e71a68600701 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:12.183620 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f1ae1-66a4-4868-a150-e71a68600701 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:12.185755 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f1ae1-66a4-4868-a150-e71a68600701 service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:12.202035 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1259/2503] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:59:12.282510 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85eee2-754c-4aa1-b0c1-f5698e3c41ad None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:12.353092 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85eee2-754c-4aa1-b0c1-f5698e3c41ad None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:12.358694 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82953f-8a6b-4eb0-9af5-8d4531665bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:12.359771 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82953f-8a6b-4eb0-9af5-8d4531665bad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:12.359771 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82953f-8a6b-4eb0-9af5-8d4531665bad admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:12.360020 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82953f-8a6b-4eb0-9af5-8d4531665bad admin admin] PATH_INFO: `/v3/users/aa0928ca8ac849f8a01cbee9297f6bc5` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:12.361202 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82953f-8a6b-4eb0-9af5-8d4531665bad admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa0928ca8ac849f8a01cbee9297f6bc5)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:12.363134 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82953f-8a6b-4eb0-9af5-8d4531665bad admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:12.365939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:12.423025 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-9d82953f-8a6b-4eb0-9af5-8d4531665bad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa0928ca8ac849f8a01cbee9297f6bc5'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:12.431651 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-9d82953f-8a6b-4eb0-9af5-8d4531665bad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa0928ca8ac849f8a01cbee9297f6bc5'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:12.444566 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-9d82953f-8a6b-4eb0-9af5-8d4531665bad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa0928ca8ac849f8a01cbee9297f6bc5'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:12.451696 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-9d82953f-8a6b-4eb0-9af5-8d4531665bad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa0928ca8ac849f8a01cbee9297f6bc5'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:12.452510 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-9d82953f-8a6b-4eb0-9af5-8d4531665bad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa0928ca8ac849f8a01cbee9297f6bc5'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:12.459072 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1245/2504] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:59:12 2022] DELETE /identity/v3/users/aa0928ca8ac849f8a01cbee9297f6bc5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:12.464128 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81051d37-3bd8-4b6c-bb80-b08468c1bcca None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:12.464612 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81051d37-3bd8-4b6c-bb80-b08468c1bcca None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:12.464741 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81051d37-3bd8-4b6c-bb80-b08468c1bcca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:12.484527 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-81051d37-3bd8-4b6c-bb80-b08468c1bcca None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:12.485749 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-81051d37-3bd8-4b6c-bb80-b08468c1bcca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:12.514568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:12.551523 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1260/2505] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:59:12.564526 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82953f-8a6b-4eb0-9af5-8d4531665bad admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:12.566210 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-9d82953f-8a6b-4eb0-9af5-8d4531665bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:12.635042 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82953f-8a6b-4eb0-9af5-8d4531665bad admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:12.638981 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc415b-eab2-4697-93f2-c266e39975fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:12.639696 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc415b-eab2-4697-93f2-c266e39975fb service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:12.640202 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc415b-eab2-4697-93f2-c266e39975fb service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:12.640483 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc415b-eab2-4697-93f2-c266e39975fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:12.651033 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc415b-eab2-4697-93f2-c266e39975fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:12.652509 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc415b-eab2-4697-93f2-c266e39975fb service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:12.665578 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1246/2506] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:59:12.966969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81051d37-3bd8-4b6c-bb80-b08468c1bcca None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:12.968606 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-81051d37-3bd8-4b6c-bb80-b08468c1bcca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:12.983287 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81051d37-3bd8-4b6c-bb80-b08468c1bcca None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:12.988919 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311202ee-aa63-4529-abe2-fac3e1b57179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:12.989665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311202ee-aa63-4529-abe2-fac3e1b57179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:12.989947 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311202ee-aa63-4529-abe2-fac3e1b57179 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:12.990251 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311202ee-aa63-4529-abe2-fac3e1b57179 admin admin] PATH_INFO: `/v3/projects/0fe497953eee49af904460506acb0242` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:12.991619 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311202ee-aa63-4529-abe2-fac3e1b57179 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fe497953eee49af904460506acb0242)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:12.994585 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311202ee-aa63-4529-abe2-fac3e1b57179 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:13.053556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-311202ee-aa63-4529-abe2-fac3e1b57179 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fe497953eee49af904460506acb0242', 'request_id': 'req-311202ee-aa63-4529-abe2-fac3e1b57179'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:13.061514 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-311202ee-aa63-4529-abe2-fac3e1b57179 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fe497953eee49af904460506acb0242', 'request_id': 'req-311202ee-aa63-4529-abe2-fac3e1b57179'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:13.067833 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-311202ee-aa63-4529-abe2-fac3e1b57179 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fe497953eee49af904460506acb0242', 'request_id': 'req-311202ee-aa63-4529-abe2-fac3e1b57179'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:13.079171 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-311202ee-aa63-4529-abe2-fac3e1b57179 admin admin] The token cache is being invalidate because project 0fe497953eee49af904460506acb0242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:59:13.079497 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-311202ee-aa63-4529-abe2-fac3e1b57179 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:13.080143 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-311202ee-aa63-4529-abe2-fac3e1b57179 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:13.081684 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1261/2507] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:59:12 2022] DELETE /identity/v3/projects/0fe497953eee49af904460506acb0242 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:13.085884 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc415b-eab2-4697-93f2-c266e39975fb service neutron] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:13.095568 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc415b-eab2-4697-93f2-c266e39975fb service neutron] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:13.160806 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada54c0-c8b8-4fa1-a6c2-d138d57e193c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:13.161599 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada54c0-c8b8-4fa1-a6c2-d138d57e193c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:13.162015 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada54c0-c8b8-4fa1-a6c2-d138d57e193c admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:13.162398 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada54c0-c8b8-4fa1-a6c2-d138d57e193c admin admin] PATH_INFO: `/v3/users/1f7b8a2d2dc44e79b2815340a2a8bfbe` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:13.163883 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada54c0-c8b8-4fa1-a6c2-d138d57e193c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f7b8a2d2dc44e79b2815340a2a8bfbe)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:13.165933 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada54c0-c8b8-4fa1-a6c2-d138d57e193c admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:13.197758 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311202ee-aa63-4529-abe2-fac3e1b57179 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:13.199413 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-311202ee-aa63-4529-abe2-fac3e1b57179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:13.204706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:13.216393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311202ee-aa63-4529-abe2-fac3e1b57179 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:13.221765 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c967e43-0ce3-4fcf-8514-727fc9d663c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:13.222469 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c967e43-0ce3-4fcf-8514-727fc9d663c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:13.222752 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c967e43-0ce3-4fcf-8514-727fc9d663c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:13.223036 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c967e43-0ce3-4fcf-8514-727fc9d663c1 admin admin] PATH_INFO: `/v3/users/ee9843902c7c45df956f8979940a3d2a` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:13.224390 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c967e43-0ce3-4fcf-8514-727fc9d663c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee9843902c7c45df956f8979940a3d2a)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:13.226379 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c967e43-0ce3-4fcf-8514-727fc9d663c1 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:13.230669 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-7ada54c0-c8b8-4fa1-a6c2-d138d57e193c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f7b8a2d2dc44e79b2815340a2a8bfbe'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:13.247906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-7ada54c0-c8b8-4fa1-a6c2-d138d57e193c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f7b8a2d2dc44e79b2815340a2a8bfbe'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:13.262147 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-7ada54c0-c8b8-4fa1-a6c2-d138d57e193c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f7b8a2d2dc44e79b2815340a2a8bfbe'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:13.271450 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-7ada54c0-c8b8-4fa1-a6c2-d138d57e193c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f7b8a2d2dc44e79b2815340a2a8bfbe'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:13.272216 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-7ada54c0-c8b8-4fa1-a6c2-d138d57e193c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f7b8a2d2dc44e79b2815340a2a8bfbe'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:13.278770 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1247/2508] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:59:13 2022] DELETE /identity/v3/users/1f7b8a2d2dc44e79b2815340a2a8bfbe => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:59:13.291452 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2c967e43-0ce3-4fcf-8514-727fc9d663c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee9843902c7c45df956f8979940a3d2a'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:13.292154 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2c967e43-0ce3-4fcf-8514-727fc9d663c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee9843902c7c45df956f8979940a3d2a'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:13.300415 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2c967e43-0ce3-4fcf-8514-727fc9d663c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee9843902c7c45df956f8979940a3d2a'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:13.313770 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2c967e43-0ce3-4fcf-8514-727fc9d663c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee9843902c7c45df956f8979940a3d2a'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:13.322475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2c967e43-0ce3-4fcf-8514-727fc9d663c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee9843902c7c45df956f8979940a3d2a'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:13.329790 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1262/2509] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:59:13 2022] DELETE /identity/v3/users/ee9843902c7c45df956f8979940a3d2a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:59:13.334596 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017936b3-4e2d-47ff-a380-c6bf83d9ca2a None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:13.334889 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017936b3-4e2d-47ff-a380-c6bf83d9ca2a None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:13.335158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017936b3-4e2d-47ff-a380-c6bf83d9ca2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:13.356092 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-017936b3-4e2d-47ff-a380-c6bf83d9ca2a None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:13.357386 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-017936b3-4e2d-47ff-a380-c6bf83d9ca2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:13.421178 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1248/2510] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:13.432461 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c967e43-0ce3-4fcf-8514-727fc9d663c1 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:13.433902 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-2c967e43-0ce3-4fcf-8514-727fc9d663c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:13.469514 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:13.499123 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c967e43-0ce3-4fcf-8514-727fc9d663c1 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:13.502972 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367e6526-d096-44ab-97e8-d586ff7aa84d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:13.503620 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e6526-d096-44ab-97e8-d586ff7aa84d service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:13.503901 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e6526-d096-44ab-97e8-d586ff7aa84d service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:13.504173 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367e6526-d096-44ab-97e8-d586ff7aa84d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:13.513901 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e6526-d096-44ab-97e8-d586ff7aa84d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:13.515434 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367e6526-d096-44ab-97e8-d586ff7aa84d service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:13.525793 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1263/2511] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:59:13.623342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017936b3-4e2d-47ff-a380-c6bf83d9ca2a None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:13.625143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-017936b3-4e2d-47ff-a380-c6bf83d9ca2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:13.642858 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017936b3-4e2d-47ff-a380-c6bf83d9ca2a None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:13.649139 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2f68a-faf1-4124-bfc8-207de991f5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:13.649813 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2f68a-faf1-4124-bfc8-207de991f5b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:13.650151 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2f68a-faf1-4124-bfc8-207de991f5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:13.650443 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2f68a-faf1-4124-bfc8-207de991f5b3 admin admin] PATH_INFO: `/v3/projects/19a5ba743cc84a99b4f69be9d37ab839` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:13.651786 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2f68a-faf1-4124-bfc8-207de991f5b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19a5ba743cc84a99b4f69be9d37ab839)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:13.654440 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2f68a-faf1-4124-bfc8-207de991f5b3 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:13.707614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-9ec2f68a-faf1-4124-bfc8-207de991f5b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19a5ba743cc84a99b4f69be9d37ab839', 'request_id': 'req-9ec2f68a-faf1-4124-bfc8-207de991f5b3'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:13.716341 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-9ec2f68a-faf1-4124-bfc8-207de991f5b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19a5ba743cc84a99b4f69be9d37ab839', 'request_id': 'req-9ec2f68a-faf1-4124-bfc8-207de991f5b3'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:13.726766 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-9ec2f68a-faf1-4124-bfc8-207de991f5b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19a5ba743cc84a99b4f69be9d37ab839', 'request_id': 'req-9ec2f68a-faf1-4124-bfc8-207de991f5b3'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:13.740175 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-9ec2f68a-faf1-4124-bfc8-207de991f5b3 admin admin] The token cache is being invalidate because project 19a5ba743cc84a99b4f69be9d37ab839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:59:13.740465 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-9ec2f68a-faf1-4124-bfc8-207de991f5b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:13.741191 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-9ec2f68a-faf1-4124-bfc8-207de991f5b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:13.743632 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1249/2512] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:59:13 2022] DELETE /identity/v3/projects/19a5ba743cc84a99b4f69be9d37ab839 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:13.748476 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9d076-31c6-4d16-b804-51714d5441c1 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:13.748999 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9d076-31c6-4d16-b804-51714d5441c1 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:13.749279 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9d076-31c6-4d16-b804-51714d5441c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:13.768941 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-03a9d076-31c6-4d16-b804-51714d5441c1 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:13.770211 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-03a9d076-31c6-4d16-b804-51714d5441c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:13.833852 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1264/2513] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:13.841899 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e20281-1618-4ef0-8a9a-18db862bab67 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:13.842222 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e20281-1618-4ef0-8a9a-18db862bab67 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:13.842500 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e20281-1618-4ef0-8a9a-18db862bab67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:13.865672 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-b8e20281-1618-4ef0-8a9a-18db862bab67 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:13.867065 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-b8e20281-1618-4ef0-8a9a-18db862bab67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:13.876777 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1250/2514] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:13.881295 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9d076-31c6-4d16-b804-51714d5441c1 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:13.891890 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9d076-31c6-4d16-b804-51714d5441c1 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:13.897174 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2586b4-91e8-4dcc-ac2d-a85da5589814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:13.897820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2586b4-91e8-4dcc-ac2d-a85da5589814 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:13.898183 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2586b4-91e8-4dcc-ac2d-a85da5589814 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:13.898457 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2586b4-91e8-4dcc-ac2d-a85da5589814 admin admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:13.899176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2586b4-91e8-4dcc-ac2d-a85da5589814 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:59:13.899478 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2586b4-91e8-4dcc-ac2d-a85da5589814 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:13.901140 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2586b4-91e8-4dcc-ac2d-a85da5589814 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:13.914723 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1265/2515] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:59:13.919626 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e20281-1618-4ef0-8a9a-18db862bab67 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:13.935749 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e20281-1618-4ef0-8a9a-18db862bab67 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:13.941434 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc617af9-7419-41e5-9962-d905c8bce5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:13.942133 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc617af9-7419-41e5-9962-d905c8bce5ec admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:13.942407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc617af9-7419-41e5-9962-d905c8bce5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:13.942676 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc617af9-7419-41e5-9962-d905c8bce5ec admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:13.943360 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc617af9-7419-41e5-9962-d905c8bce5ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:13.945308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc617af9-7419-41e5-9962-d905c8bce5ec admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:13.968120 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:13.980432 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1251/2516] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:59:13 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:13.981430 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2586b4-91e8-4dcc-ac2d-a85da5589814 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:13.992179 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2586b4-91e8-4dcc-ac2d-a85da5589814 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:14.056489 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e6233-c432-4705-b21f-be9ff0b34225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:14.057138 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e6233-c432-4705-b21f-be9ff0b34225 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:14.057418 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e6233-c432-4705-b21f-be9ff0b34225 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:14.057691 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e6233-c432-4705-b21f-be9ff0b34225 admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:14.058413 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e6233-c432-4705-b21f-be9ff0b34225 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:14.060390 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e6233-c432-4705-b21f-be9ff0b34225 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:14.086008 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1266/2517] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:59:13 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:59:14.088059 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc617af9-7419-41e5-9962-d905c8bce5ec admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:14.099493 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc617af9-7419-41e5-9962-d905c8bce5ec admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:14.104294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f0ae0-456e-4e2f-bdf9-e15254f4b943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:14.104941 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f0ae0-456e-4e2f-bdf9-e15254f4b943 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:14.105239 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f0ae0-456e-4e2f-bdf9-e15254f4b943 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:14.105489 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f0ae0-456e-4e2f-bdf9-e15254f4b943 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:14.106368 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f0ae0-456e-4e2f-bdf9-e15254f4b943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:14.108067 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e6233-c432-4705-b21f-be9ff0b34225 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:14.108215 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f0ae0-456e-4e2f-bdf9-e15254f4b943 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:14.111610 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-7e3e6233-c432-4705-b21f-be9ff0b34225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:14.127120 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e6233-c432-4705-b21f-be9ff0b34225 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:14.128192 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1252/2518] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:14.132138 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f0ae0-456e-4e2f-bdf9-e15254f4b943 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:14.137924 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09251fb9-b02d-4b1a-ab4b-29b354192a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:14.138735 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09251fb9-b02d-4b1a-ab4b-29b354192a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:14.139017 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09251fb9-b02d-4b1a-ab4b-29b354192a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:14.139302 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09251fb9-b02d-4b1a-ab4b-29b354192a7e admin admin] PATH_INFO: `/v3/projects/045faee3a9ab45fb91c942a1e6ac868f` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:14.141097 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09251fb9-b02d-4b1a-ab4b-29b354192a7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=045faee3a9ab45fb91c942a1e6ac868f)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:14.143571 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09251fb9-b02d-4b1a-ab4b-29b354192a7e admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:14.145285 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f0ae0-456e-4e2f-bdf9-e15254f4b943 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:14.150633 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fc494-50a9-419e-bc16-130064e71474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:14.151367 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fc494-50a9-419e-bc16-130064e71474 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:14.151736 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fc494-50a9-419e-bc16-130064e71474 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:14.152099 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fc494-50a9-419e-bc16-130064e71474 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:14.152903 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436fc494-50a9-419e-bc16-130064e71474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:14.154773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436fc494-50a9-419e-bc16-130064e71474 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:14.165886 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1253/2519] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:59:14.169841 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fc494-50a9-419e-bc16-130064e71474 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:14.181340 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fc494-50a9-419e-bc16-130064e71474 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:14.186023 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81027e63-c871-4c8f-a013-f493fa0c2c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:14.186707 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81027e63-c871-4c8f-a013-f493fa0c2c93 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:14.186986 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81027e63-c871-4c8f-a013-f493fa0c2c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:14.187262 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81027e63-c871-4c8f-a013-f493fa0c2c93 admin admin] PATH_INFO: `/v3/projects/b6893b7ffa4543afb40fc118a28d3021/users/8cdcfef37ec44c90b02fb970559cceda/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:14.193594 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:14.201125 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-09251fb9-b02d-4b1a-ab4b-29b354192a7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '045faee3a9ab45fb91c942a1e6ac868f', 'request_id': 'req-09251fb9-b02d-4b1a-ab4b-29b354192a7e'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:14.203737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81027e63-c871-4c8f-a013-f493fa0c2c93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6893b7ffa4543afb40fc118a28d3021, user_id=8cdcfef37ec44c90b02fb970559cceda, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:14.206540 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81027e63-c871-4c8f-a013-f493fa0c2c93 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:14.210136 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-09251fb9-b02d-4b1a-ab4b-29b354192a7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '045faee3a9ab45fb91c942a1e6ac868f', 'request_id': 'req-09251fb9-b02d-4b1a-ab4b-29b354192a7e'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:14.216739 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-09251fb9-b02d-4b1a-ab4b-29b354192a7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '045faee3a9ab45fb91c942a1e6ac868f', 'request_id': 'req-09251fb9-b02d-4b1a-ab4b-29b354192a7e'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:14.221099 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1254/2520] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:59:14 2022] PUT /identity/v3/projects/b6893b7ffa4543afb40fc118a28d3021/users/8cdcfef37ec44c90b02fb970559cceda/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:59:14.229051 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-09251fb9-b02d-4b1a-ab4b-29b354192a7e admin admin] The token cache is being invalidate because project 045faee3a9ab45fb91c942a1e6ac868f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:59:14.229335 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-09251fb9-b02d-4b1a-ab4b-29b354192a7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:14.230027 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-09251fb9-b02d-4b1a-ab4b-29b354192a7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:14.231568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1267/2521] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:59:14 2022] DELETE /identity/v3/projects/045faee3a9ab45fb91c942a1e6ac868f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:14.235271 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae99d8-2bdf-4818-8061-4cee7cc076b8 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:14.235556 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae99d8-2bdf-4818-8061-4cee7cc076b8 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:14.235904 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae99d8-2bdf-4818-8061-4cee7cc076b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:14.274089 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-58ae99d8-2bdf-4818-8061-4cee7cc076b8 None None] MFA Rules not processed for user `8cdcfef37ec44c90b02fb970559cceda`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:14.275369 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-58ae99d8-2bdf-4818-8061-4cee7cc076b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:14.364191 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1255/2522] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:59:14.365517 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09251fb9-b02d-4b1a-ab4b-29b354192a7e admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:14.367111 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-09251fb9-b02d-4b1a-ab4b-29b354192a7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:14.447191 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09251fb9-b02d-4b1a-ab4b-29b354192a7e admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:14.526106 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75975d-c2a1-4a14-ba6c-2ae1ec49672e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:14.526869 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75975d-c2a1-4a14-ba6c-2ae1ec49672e admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:14.527251 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75975d-c2a1-4a14-ba6c-2ae1ec49672e admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:14.527626 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75975d-c2a1-4a14-ba6c-2ae1ec49672e admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:14.528418 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75975d-c2a1-4a14-ba6c-2ae1ec49672e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:14.530544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75975d-c2a1-4a14-ba6c-2ae1ec49672e admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:14.565158 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1268/2523] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:59:14 2022] POST /identity/v3/projects => generated 379 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:59:14.569378 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae99d8-2bdf-4818-8061-4cee7cc076b8 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:14.581521 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae99d8-2bdf-4818-8061-4cee7cc076b8 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:14.645394 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2419fa7-1f37-40d7-b2fb-2892870924e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:14.646084 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2419fa7-1f37-40d7-b2fb-2892870924e4 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:14.646430 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2419fa7-1f37-40d7-b2fb-2892870924e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:14.646619 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2419fa7-1f37-40d7-b2fb-2892870924e4 admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:14.651575 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2419fa7-1f37-40d7-b2fb-2892870924e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:14.651575 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2419fa7-1f37-40d7-b2fb-2892870924e4 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:14.672494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1256/2524] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:59:14 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:14.677493 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75975d-c2a1-4a14-ba6c-2ae1ec49672e admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:14.689925 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75975d-c2a1-4a14-ba6c-2ae1ec49672e admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:14.695165 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9dc15f-44dc-417e-b63a-37fdceef2f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:14.695804 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9dc15f-44dc-417e-b63a-37fdceef2f03 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:14.696095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9dc15f-44dc-417e-b63a-37fdceef2f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:14.696381 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9dc15f-44dc-417e-b63a-37fdceef2f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:14.697084 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9dc15f-44dc-417e-b63a-37fdceef2f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:14.698772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9dc15f-44dc-417e-b63a-37fdceef2f03 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:14.711344 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1269/2525] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:14.715626 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2419fa7-1f37-40d7-b2fb-2892870924e4 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:14.726514 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2419fa7-1f37-40d7-b2fb-2892870924e4 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:14.733502 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5214f08-a120-4118-87f4-6dc798dacbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:14.734172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5214f08-a120-4118-87f4-6dc798dacbcd admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:14.734454 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5214f08-a120-4118-87f4-6dc798dacbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:14.734702 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5214f08-a120-4118-87f4-6dc798dacbcd admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:14.735408 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5214f08-a120-4118-87f4-6dc798dacbcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:14.737097 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5214f08-a120-4118-87f4-6dc798dacbcd admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:14.750065 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1257/2526] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:14.754345 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9dc15f-44dc-417e-b63a-37fdceef2f03 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:14.765375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9dc15f-44dc-417e-b63a-37fdceef2f03 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:14.770876 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a63d6-512b-4a4f-855d-7e4ceb7c67c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:14.771571 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a63d6-512b-4a4f-855d-7e4ceb7c67c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:14.771846 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a63d6-512b-4a4f-855d-7e4ceb7c67c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:14.772120 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a63d6-512b-4a4f-855d-7e4ceb7c67c8 admin admin] PATH_INFO: `/v3/projects/08620542f5bf4bdf91f66ec360134c1a/users/9afe4829586d43f0bb960fa00c01be98/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:14.796621 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a63d6-512b-4a4f-855d-7e4ceb7c67c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08620542f5bf4bdf91f66ec360134c1a, user_id=9afe4829586d43f0bb960fa00c01be98, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:14.799597 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a63d6-512b-4a4f-855d-7e4ceb7c67c8 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:14.819314 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1270/2527] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:59:14 2022] PUT /identity/v3/projects/08620542f5bf4bdf91f66ec360134c1a/users/9afe4829586d43f0bb960fa00c01be98/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:14.830653 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d9a6b-ba26-4f85-a648-39ef2fb1e8c0 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:14.831095 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d9a6b-ba26-4f85-a648-39ef2fb1e8c0 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:14.831465 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d9a6b-ba26-4f85-a648-39ef2fb1e8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:14.873298 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-483d9a6b-ba26-4f85-a648-39ef2fb1e8c0 None None] MFA Rules not processed for user `9afe4829586d43f0bb960fa00c01be98`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:14.874620 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-483d9a6b-ba26-4f85-a648-39ef2fb1e8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:14.885547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:14.950784 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1258/2528] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:14.956064 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a63d6-512b-4a4f-855d-7e4ceb7c67c8 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:14.988010 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:15.024890 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a63d6-512b-4a4f-855d-7e4ceb7c67c8 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:15.031095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6c048-1c9f-44ae-b452-df247e14f798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:15.031717 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6c048-1c9f-44ae-b452-df247e14f798 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:15.031995 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6c048-1c9f-44ae-b452-df247e14f798 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:15.032239 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6c048-1c9f-44ae-b452-df247e14f798 admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:15.032933 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6c048-1c9f-44ae-b452-df247e14f798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:15.035025 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6c048-1c9f-44ae-b452-df247e14f798 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:15.062093 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1271/2529] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:59:14 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:15.066388 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d9a6b-ba26-4f85-a648-39ef2fb1e8c0 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:15.077693 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d9a6b-ba26-4f85-a648-39ef2fb1e8c0 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:15.138831 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5af41-f841-4b91-b068-d80007167607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:15.139377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5af41-f841-4b91-b068-d80007167607 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:15.139649 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5af41-f841-4b91-b068-d80007167607 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:15.139918 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5af41-f841-4b91-b068-d80007167607 admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:15.140633 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5af41-f841-4b91-b068-d80007167607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:15.142677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5af41-f841-4b91-b068-d80007167607 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:15.168168 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1259/2530] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:59:15 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:59:15.172434 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6c048-1c9f-44ae-b452-df247e14f798 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:15.183422 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6c048-1c9f-44ae-b452-df247e14f798 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:15.188492 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd2813-78b8-46f5-a481-c11e53089f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:15.189107 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd2813-78b8-46f5-a481-c11e53089f21 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:15.189383 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd2813-78b8-46f5-a481-c11e53089f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:15.189657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd2813-78b8-46f5-a481-c11e53089f21 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:15.190393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd2813-78b8-46f5-a481-c11e53089f21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:15.192029 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd2813-78b8-46f5-a481-c11e53089f21 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:15.203088 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1272/2531] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:15.207748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5af41-f841-4b91-b068-d80007167607 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:15.218765 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5af41-f841-4b91-b068-d80007167607 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:15.224706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bafd5-27e9-4e11-9242-87f4f0929573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:15.225414 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bafd5-27e9-4e11-9242-87f4f0929573 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:15.225695 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bafd5-27e9-4e11-9242-87f4f0929573 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:15.226004 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bafd5-27e9-4e11-9242-87f4f0929573 admin admin] PATH_INFO: `/v3/projects/923580973be6425991f0d81904fe21f5/users/0033750fe0aa4b57b7167e5af7fcf04c/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:15.241610 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bafd5-27e9-4e11-9242-87f4f0929573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=923580973be6425991f0d81904fe21f5, user_id=0033750fe0aa4b57b7167e5af7fcf04c, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:15.244282 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bafd5-27e9-4e11-9242-87f4f0929573 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:15.259954 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1260/2532] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:59:15 2022] PUT /identity/v3/projects/923580973be6425991f0d81904fe21f5/users/0033750fe0aa4b57b7167e5af7fcf04c/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:15.264154 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd2813-78b8-46f5-a481-c11e53089f21 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:15.275637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd2813-78b8-46f5-a481-c11e53089f21 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:15.333057 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae29f6-f5c6-485b-84ce-864ea904d6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:15.333679 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae29f6-f5c6-485b-84ce-864ea904d6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:15.333956 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae29f6-f5c6-485b-84ce-864ea904d6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:15.334258 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae29f6-f5c6-485b-84ce-864ea904d6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:15.334962 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae29f6-f5c6-485b-84ce-864ea904d6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:15.336598 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae29f6-f5c6-485b-84ce-864ea904d6a3 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:15.346803 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1273/2533] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:15.351311 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bafd5-27e9-4e11-9242-87f4f0929573 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:15.362138 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bafd5-27e9-4e11-9242-87f4f0929573 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:15.367419 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f615dc9-b36d-44ce-892f-eda69f0270ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:15.368098 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f615dc9-b36d-44ce-892f-eda69f0270ab admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:15.368373 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f615dc9-b36d-44ce-892f-eda69f0270ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:15.368648 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f615dc9-b36d-44ce-892f-eda69f0270ab admin admin] PATH_INFO: `/v3/projects/923580973be6425991f0d81904fe21f5/users/0033750fe0aa4b57b7167e5af7fcf04c/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:15.371109 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f615dc9-b36d-44ce-892f-eda69f0270ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=923580973be6425991f0d81904fe21f5, user_id=0033750fe0aa4b57b7167e5af7fcf04c, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:15.373766 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f615dc9-b36d-44ce-892f-eda69f0270ab admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:15.385934 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1261/2534] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:59:15 2022] PUT /identity/v3/projects/923580973be6425991f0d81904fe21f5/users/0033750fe0aa4b57b7167e5af7fcf04c/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:15.396603 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e173556-e0b0-416e-951a-66594f3bae35 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:15.396897 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e173556-e0b0-416e-951a-66594f3bae35 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:15.397169 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e173556-e0b0-416e-951a-66594f3bae35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:15.426242 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-4e173556-e0b0-416e-951a-66594f3bae35 None None] MFA Rules not processed for user `0033750fe0aa4b57b7167e5af7fcf04c`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:15.427498 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-4e173556-e0b0-416e-951a-66594f3bae35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:15.499366 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1274/2535] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:15 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:59:15.511217 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f615dc9-b36d-44ce-892f-eda69f0270ab admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:15.513288 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-8f615dc9-b36d-44ce-892f-eda69f0270ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:15.572077 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f615dc9-b36d-44ce-892f-eda69f0270ab admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:15.575872 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182fb0b-d287-46e2-b8c8-362886b87fa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:15.576497 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182fb0b-d287-46e2-b8c8-362886b87fa5 service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:15.576774 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182fb0b-d287-46e2-b8c8-362886b87fa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:15.577038 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182fb0b-d287-46e2-b8c8-362886b87fa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:15.586575 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182fb0b-d287-46e2-b8c8-362886b87fa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:15.588001 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182fb0b-d287-46e2-b8c8-362886b87fa5 service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:15.597595 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1262/2536] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:15 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:59:15.641369 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e173556-e0b0-416e-951a-66594f3bae35 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:15.642995 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-4e173556-e0b0-416e-951a-66594f3bae35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:15.655831 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e173556-e0b0-416e-951a-66594f3bae35 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:15.659653 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee0c5c-f665-466f-b3b5-2ee17ae9eec2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:15.660266 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee0c5c-f665-466f-b3b5-2ee17ae9eec2 service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:15.660541 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee0c5c-f665-466f-b3b5-2ee17ae9eec2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:15.660806 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee0c5c-f665-466f-b3b5-2ee17ae9eec2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:15.680908 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:15.720990 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee0c5c-f665-466f-b3b5-2ee17ae9eec2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:15.722536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee0c5c-f665-466f-b3b5-2ee17ae9eec2 service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:15.735242 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1275/2537] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:59:18.727992 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182fb0b-d287-46e2-b8c8-362886b87fa5 service cinder] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:18.734045 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:18.800292 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182fb0b-d287-46e2-b8c8-362886b87fa5 service cinder] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:18.805122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a76fbc-9656-4442-841e-0c11e62407df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:18.805776 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a76fbc-9656-4442-841e-0c11e62407df admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:18.806095 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a76fbc-9656-4442-841e-0c11e62407df admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:18.806356 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a76fbc-9656-4442-841e-0c11e62407df admin admin] PATH_INFO: `/v3/users/8cdcfef37ec44c90b02fb970559cceda` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:18.807566 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a76fbc-9656-4442-841e-0c11e62407df admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cdcfef37ec44c90b02fb970559cceda)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:18.809675 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a76fbc-9656-4442-841e-0c11e62407df admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:18.858761 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f3a76fbc-9656-4442-841e-0c11e62407df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cdcfef37ec44c90b02fb970559cceda'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:18.866901 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f3a76fbc-9656-4442-841e-0c11e62407df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cdcfef37ec44c90b02fb970559cceda'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:18.879870 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f3a76fbc-9656-4442-841e-0c11e62407df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cdcfef37ec44c90b02fb970559cceda'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:18.887015 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f3a76fbc-9656-4442-841e-0c11e62407df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cdcfef37ec44c90b02fb970559cceda'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:18.888007 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f3a76fbc-9656-4442-841e-0c11e62407df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cdcfef37ec44c90b02fb970559cceda'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:18.895770 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1263/2538] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:59:18 2022] DELETE /identity/v3/users/8cdcfef37ec44c90b02fb970559cceda => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:18.900551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c4b26-59a0-4966-9f65-ed24480c87ba None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:18.901030 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c4b26-59a0-4966-9f65-ed24480c87ba None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:18.901165 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c4b26-59a0-4966-9f65-ed24480c87ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:18.920628 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-d98c4b26-59a0-4966-9f65-ed24480c87ba None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:18.921838 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-d98c4b26-59a0-4966-9f65-ed24480c87ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:18.984630 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1276/2539] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:18.994876 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a76fbc-9656-4442-841e-0c11e62407df admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:18.996821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-f3a76fbc-9656-4442-841e-0c11e62407df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:19.056287 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a76fbc-9656-4442-841e-0c11e62407df admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:19.060488 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33403f-ad63-488e-b674-bda08ee7c2c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:19.061123 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33403f-ad63-488e-b674-bda08ee7c2c3 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:19.061400 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33403f-ad63-488e-b674-bda08ee7c2c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:19.061675 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c33403f-ad63-488e-b674-bda08ee7c2c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:19.071387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c33403f-ad63-488e-b674-bda08ee7c2c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:19.072832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c33403f-ad63-488e-b674-bda08ee7c2c3 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:19.082459 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1264/2540] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:59:19.368407 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c4b26-59a0-4966-9f65-ed24480c87ba None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:19.369993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-d98c4b26-59a0-4966-9f65-ed24480c87ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:19.383831 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c4b26-59a0-4966-9f65-ed24480c87ba None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:19.389590 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e9f55-1ec7-43cd-910a-524e60db1e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:19.390321 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e9f55-1ec7-43cd-910a-524e60db1e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:19.390603 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e9f55-1ec7-43cd-910a-524e60db1e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:19.390878 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e9f55-1ec7-43cd-910a-524e60db1e31 admin admin] PATH_INFO: `/v3/projects/b6893b7ffa4543afb40fc118a28d3021` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:19.392185 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e9f55-1ec7-43cd-910a-524e60db1e31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6893b7ffa4543afb40fc118a28d3021)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:19.394458 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e9f55-1ec7-43cd-910a-524e60db1e31 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:19.444245 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-163e9f55-1ec7-43cd-910a-524e60db1e31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6893b7ffa4543afb40fc118a28d3021', 'request_id': 'req-163e9f55-1ec7-43cd-910a-524e60db1e31'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:19.452217 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-163e9f55-1ec7-43cd-910a-524e60db1e31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6893b7ffa4543afb40fc118a28d3021', 'request_id': 'req-163e9f55-1ec7-43cd-910a-524e60db1e31'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:19.458315 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-163e9f55-1ec7-43cd-910a-524e60db1e31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6893b7ffa4543afb40fc118a28d3021', 'request_id': 'req-163e9f55-1ec7-43cd-910a-524e60db1e31'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:19.469793 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-163e9f55-1ec7-43cd-910a-524e60db1e31 admin admin] The token cache is being invalidate because project b6893b7ffa4543afb40fc118a28d3021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:59:19.470091 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-163e9f55-1ec7-43cd-910a-524e60db1e31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:19.470830 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-163e9f55-1ec7-43cd-910a-524e60db1e31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:19.472381 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1277/2541] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:59:19 2022] DELETE /identity/v3/projects/b6893b7ffa4543afb40fc118a28d3021 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:19.476589 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33403f-ad63-488e-b674-bda08ee7c2c3 service neutron] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:19.486817 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c33403f-ad63-488e-b674-bda08ee7c2c3 service neutron] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:19.512415 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:19.554533 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1939b-49d2-489b-9b91-233819374de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:19.555191 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1939b-49d2-489b-9b91-233819374de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:19.555471 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1939b-49d2-489b-9b91-233819374de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:19.556458 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1939b-49d2-489b-9b91-233819374de6 admin admin] PATH_INFO: `/v3/users/9afe4829586d43f0bb960fa00c01be98` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:19.557721 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1939b-49d2-489b-9b91-233819374de6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9afe4829586d43f0bb960fa00c01be98)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:19.559830 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1939b-49d2-489b-9b91-233819374de6 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:19.612920 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-4dd1939b-49d2-489b-9b91-233819374de6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9afe4829586d43f0bb960fa00c01be98'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:19.622012 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-4dd1939b-49d2-489b-9b91-233819374de6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9afe4829586d43f0bb960fa00c01be98'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:19.636139 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-4dd1939b-49d2-489b-9b91-233819374de6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9afe4829586d43f0bb960fa00c01be98'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:19.648327 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-4dd1939b-49d2-489b-9b91-233819374de6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9afe4829586d43f0bb960fa00c01be98'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:19.649013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-4dd1939b-49d2-489b-9b91-233819374de6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9afe4829586d43f0bb960fa00c01be98'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:19.661704 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1265/2542] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:59:19 2022] DELETE /identity/v3/users/9afe4829586d43f0bb960fa00c01be98 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:19.975401 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e9f55-1ec7-43cd-910a-524e60db1e31 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:19.977178 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-163e9f55-1ec7-43cd-910a-524e60db1e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:19.996467 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e9f55-1ec7-43cd-910a-524e60db1e31 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:20.061731 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:20.077599 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ea650-a814-4e03-82a9-bbf1035368de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:20.078344 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ea650-a814-4e03-82a9-bbf1035368de admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:20.078969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ea650-a814-4e03-82a9-bbf1035368de admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:20.079306 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ea650-a814-4e03-82a9-bbf1035368de admin admin] PATH_INFO: `/v3/projects/08620542f5bf4bdf91f66ec360134c1a` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:20.080661 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ea650-a814-4e03-82a9-bbf1035368de admin admin] RBAC: Authorizing `identity:delete_project(project_id=08620542f5bf4bdf91f66ec360134c1a)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:20.082996 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ea650-a814-4e03-82a9-bbf1035368de admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:20.132976 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-104ea650-a814-4e03-82a9-bbf1035368de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08620542f5bf4bdf91f66ec360134c1a', 'request_id': 'req-104ea650-a814-4e03-82a9-bbf1035368de'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:20.141421 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-104ea650-a814-4e03-82a9-bbf1035368de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08620542f5bf4bdf91f66ec360134c1a', 'request_id': 'req-104ea650-a814-4e03-82a9-bbf1035368de'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:20.148273 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-104ea650-a814-4e03-82a9-bbf1035368de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08620542f5bf4bdf91f66ec360134c1a', 'request_id': 'req-104ea650-a814-4e03-82a9-bbf1035368de'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:20.160113 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-104ea650-a814-4e03-82a9-bbf1035368de admin admin] The token cache is being invalidate because project 08620542f5bf4bdf91f66ec360134c1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:59:20.160400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-104ea650-a814-4e03-82a9-bbf1035368de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:20.161126 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-104ea650-a814-4e03-82a9-bbf1035368de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:20.162887 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1278/2543] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:59:19 2022] DELETE /identity/v3/projects/08620542f5bf4bdf91f66ec360134c1a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:20.167289 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1939b-49d2-489b-9b91-233819374de6 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:20.169325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-4dd1939b-49d2-489b-9b91-233819374de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:20.184158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1939b-49d2-489b-9b91-233819374de6 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:20.245353 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5d605-2074-4596-8a4c-d69d24456a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:20.246912 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5d605-2074-4596-8a4c-d69d24456a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:20.247234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5d605-2074-4596-8a4c-d69d24456a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:20.247525 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5d605-2074-4596-8a4c-d69d24456a57 admin admin] PATH_INFO: `/v3/users/0033750fe0aa4b57b7167e5af7fcf04c` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:20.248755 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5d605-2074-4596-8a4c-d69d24456a57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0033750fe0aa4b57b7167e5af7fcf04c)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:20.250874 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5d605-2074-4596-8a4c-d69d24456a57 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:20.308200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-a5c5d605-2074-4596-8a4c-d69d24456a57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0033750fe0aa4b57b7167e5af7fcf04c'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:20.309952 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:20.318008 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-a5c5d605-2074-4596-8a4c-d69d24456a57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0033750fe0aa4b57b7167e5af7fcf04c'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:20.332348 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-a5c5d605-2074-4596-8a4c-d69d24456a57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0033750fe0aa4b57b7167e5af7fcf04c'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:20.339464 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-a5c5d605-2074-4596-8a4c-d69d24456a57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0033750fe0aa4b57b7167e5af7fcf04c'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:20.340239 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-a5c5d605-2074-4596-8a4c-d69d24456a57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0033750fe0aa4b57b7167e5af7fcf04c'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:20.346333 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1266/2544] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:59:20 2022] DELETE /identity/v3/users/0033750fe0aa4b57b7167e5af7fcf04c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:20.639320 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ea650-a814-4e03-82a9-bbf1035368de admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:20.640884 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-104ea650-a814-4e03-82a9-bbf1035368de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:20.657541 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ea650-a814-4e03-82a9-bbf1035368de admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:20.715213 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b252e-5f2c-4ec6-9311-912fc051f6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:20.715855 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b252e-5f2c-4ec6-9311-912fc051f6e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:20.716128 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b252e-5f2c-4ec6-9311-912fc051f6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:20.716396 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b252e-5f2c-4ec6-9311-912fc051f6e6 admin admin] PATH_INFO: `/v3/projects/923580973be6425991f0d81904fe21f5` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:20.717755 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b252e-5f2c-4ec6-9311-912fc051f6e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=923580973be6425991f0d81904fe21f5)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:20.719843 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b252e-5f2c-4ec6-9311-912fc051f6e6 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:20.770315 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-ac6b252e-5f2c-4ec6-9311-912fc051f6e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '923580973be6425991f0d81904fe21f5', 'request_id': 'req-ac6b252e-5f2c-4ec6-9311-912fc051f6e6'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:20.779232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-ac6b252e-5f2c-4ec6-9311-912fc051f6e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '923580973be6425991f0d81904fe21f5', 'request_id': 'req-ac6b252e-5f2c-4ec6-9311-912fc051f6e6'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:20.785312 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-ac6b252e-5f2c-4ec6-9311-912fc051f6e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '923580973be6425991f0d81904fe21f5', 'request_id': 'req-ac6b252e-5f2c-4ec6-9311-912fc051f6e6'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:20.797648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-ac6b252e-5f2c-4ec6-9311-912fc051f6e6 admin admin] The token cache is being invalidate because project 923580973be6425991f0d81904fe21f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:59:20.797958 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-ac6b252e-5f2c-4ec6-9311-912fc051f6e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:20.798766 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-ac6b252e-5f2c-4ec6-9311-912fc051f6e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:20.800414 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1279/2545] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:59:20 2022] DELETE /identity/v3/projects/923580973be6425991f0d81904fe21f5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:20.806662 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd7f01-f58f-48c6-a525-516a2f3f5e43 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:20.806971 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd7f01-f58f-48c6-a525-516a2f3f5e43 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:20.807246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd7f01-f58f-48c6-a525-516a2f3f5e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:20.830214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-cebd7f01-f58f-48c6-a525-516a2f3f5e43 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:20.831437 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-cebd7f01-f58f-48c6-a525-516a2f3f5e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:20.900288 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1267/2546] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:20.910239 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c0213-fe3c-4aed-8530-0850942d125f None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:20.910522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c0213-fe3c-4aed-8530-0850942d125f None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:20.910792 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c0213-fe3c-4aed-8530-0850942d125f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:20.919791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:20.932815 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-916c0213-fe3c-4aed-8530-0850942d125f None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:20.934825 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-916c0213-fe3c-4aed-8530-0850942d125f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:20.944223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1280/2547] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:20.948674 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd7f01-f58f-48c6-a525-516a2f3f5e43 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:20.958947 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd7f01-f58f-48c6-a525-516a2f3f5e43 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:20.963824 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769060a-45cf-40dd-94f5-6cc6d016214d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:20.964500 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769060a-45cf-40dd-94f5-6cc6d016214d admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:20.964765 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769060a-45cf-40dd-94f5-6cc6d016214d admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:20.965049 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769060a-45cf-40dd-94f5-6cc6d016214d admin admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:20.965798 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769060a-45cf-40dd-94f5-6cc6d016214d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:59:20.966079 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769060a-45cf-40dd-94f5-6cc6d016214d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:20.967822 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769060a-45cf-40dd-94f5-6cc6d016214d admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:20.980133 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1268/2548] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:59:20.984835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c0213-fe3c-4aed-8530-0850942d125f None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:20.994716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c0213-fe3c-4aed-8530-0850942d125f None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:21.000282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043586b-1aa7-428c-ab33-683a6a0361fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:21.000934 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043586b-1aa7-428c-ab33-683a6a0361fa admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:21.001318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043586b-1aa7-428c-ab33-683a6a0361fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:21.001605 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043586b-1aa7-428c-ab33-683a6a0361fa admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:21.002431 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043586b-1aa7-428c-ab33-683a6a0361fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:21.004332 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043586b-1aa7-428c-ab33-683a6a0361fa admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:21.033834 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1281/2549] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:59:20 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:21.038234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769060a-45cf-40dd-94f5-6cc6d016214d admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:21.048724 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769060a-45cf-40dd-94f5-6cc6d016214d admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:21.106380 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f848d4-0f86-4f3e-a4ca-eca30afa22f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:21.107009 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f848d4-0f86-4f3e-a4ca-eca30afa22f4 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:21.107294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f848d4-0f86-4f3e-a4ca-eca30afa22f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:21.107694 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f848d4-0f86-4f3e-a4ca-eca30afa22f4 admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:21.108357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f848d4-0f86-4f3e-a4ca-eca30afa22f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:21.110292 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f848d4-0f86-4f3e-a4ca-eca30afa22f4 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:21.137434 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1269/2550] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:59:21 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:21.138991 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043586b-1aa7-428c-ab33-683a6a0361fa admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:21.150921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043586b-1aa7-428c-ab33-683a6a0361fa admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:21.156822 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0675e-c4e4-4959-ad1d-68142419377a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:21.157453 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0675e-c4e4-4959-ad1d-68142419377a admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:21.157864 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0675e-c4e4-4959-ad1d-68142419377a admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:21.158109 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0675e-c4e4-4959-ad1d-68142419377a admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:21.158823 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0675e-c4e4-4959-ad1d-68142419377a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:21.160474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0675e-c4e4-4959-ad1d-68142419377a admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:21.172391 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1282/2551] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:21.177052 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f848d4-0f86-4f3e-a4ca-eca30afa22f4 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:21.187361 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f848d4-0f86-4f3e-a4ca-eca30afa22f4 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:21.192199 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba24ee7c-b980-4ef2-9a5b-4f61bbbb881f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:21.192809 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24ee7c-b980-4ef2-9a5b-4f61bbbb881f admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:21.193085 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24ee7c-b980-4ef2-9a5b-4f61bbbb881f admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:21.193356 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba24ee7c-b980-4ef2-9a5b-4f61bbbb881f admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:21.194100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24ee7c-b980-4ef2-9a5b-4f61bbbb881f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:21.195704 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba24ee7c-b980-4ef2-9a5b-4f61bbbb881f admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:21.207222 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1270/2552] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:59:21.211893 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0675e-c4e4-4959-ad1d-68142419377a admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:21.222242 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0675e-c4e4-4959-ad1d-68142419377a admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:21.227133 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334825ac-5be6-41ee-b2a1-f4f78a2ba488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:21.227785 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334825ac-5be6-41ee-b2a1-f4f78a2ba488 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:21.228070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334825ac-5be6-41ee-b2a1-f4f78a2ba488 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:21.228424 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334825ac-5be6-41ee-b2a1-f4f78a2ba488 admin admin] PATH_INFO: `/v3/projects/a57e4e12f4004ef387e766bfb3ff1cc4/users/bc28a5cd4d154d45ab698b4748a5486d/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:21.243865 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334825ac-5be6-41ee-b2a1-f4f78a2ba488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a57e4e12f4004ef387e766bfb3ff1cc4, user_id=bc28a5cd4d154d45ab698b4748a5486d, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:21.247105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334825ac-5be6-41ee-b2a1-f4f78a2ba488 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:21.266452 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1283/2553] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:59:21 2022] PUT /identity/v3/projects/a57e4e12f4004ef387e766bfb3ff1cc4/users/bc28a5cd4d154d45ab698b4748a5486d/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:21.278548 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bdec2-0d2f-4898-b59c-c9b0e5b6c966 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:21.278841 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bdec2-0d2f-4898-b59c-c9b0e5b6c966 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:21.279121 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bdec2-0d2f-4898-b59c-c9b0e5b6c966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:21.309470 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-e02bdec2-0d2f-4898-b59c-c9b0e5b6c966 None None] MFA Rules not processed for user `bc28a5cd4d154d45ab698b4748a5486d`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:21.310744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-e02bdec2-0d2f-4898-b59c-c9b0e5b6c966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:21.330362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:21.383933 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1271/2554] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:21.388786 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334825ac-5be6-41ee-b2a1-f4f78a2ba488 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:21.462222 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334825ac-5be6-41ee-b2a1-f4f78a2ba488 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:21.467151 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792b3a4-c617-4259-9a80-5a735f864071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:21.467784 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792b3a4-c617-4259-9a80-5a735f864071 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:21.468066 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792b3a4-c617-4259-9a80-5a735f864071 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:21.468340 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d792b3a4-c617-4259-9a80-5a735f864071 admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:21.469023 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792b3a4-c617-4259-9a80-5a735f864071 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:21.471078 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d792b3a4-c617-4259-9a80-5a735f864071 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:21.506319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1284/2555] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:59:21 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:21.508494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bdec2-0d2f-4898-b59c-c9b0e5b6c966 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:21.525851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bdec2-0d2f-4898-b59c-c9b0e5b6c966 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:21.586479 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256a200-4bb2-4d4b-b75c-0536a77d2066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:21.588853 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256a200-4bb2-4d4b-b75c-0536a77d2066 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:21.588853 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256a200-4bb2-4d4b-b75c-0536a77d2066 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:21.588853 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256a200-4bb2-4d4b-b75c-0536a77d2066 admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:21.588853 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256a200-4bb2-4d4b-b75c-0536a77d2066 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:21.590270 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256a200-4bb2-4d4b-b75c-0536a77d2066 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:21.614226 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1272/2556] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:59:21 2022] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:21.618299 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792b3a4-c617-4259-9a80-5a735f864071 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:21.635103 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d792b3a4-c617-4259-9a80-5a735f864071 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:21.642149 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855758c9-c59d-4015-afe5-d34ac8581f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:21.644122 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855758c9-c59d-4015-afe5-d34ac8581f2e admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:21.644122 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855758c9-c59d-4015-afe5-d34ac8581f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:21.644122 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855758c9-c59d-4015-afe5-d34ac8581f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:21.644122 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855758c9-c59d-4015-afe5-d34ac8581f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:21.645691 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855758c9-c59d-4015-afe5-d34ac8581f2e admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:21.657364 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1285/2557] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:21.662048 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256a200-4bb2-4d4b-b75c-0536a77d2066 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:21.672597 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256a200-4bb2-4d4b-b75c-0536a77d2066 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:21.677455 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8553003-4099-40e3-8e1a-783414532ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:21.678176 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8553003-4099-40e3-8e1a-783414532ee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:21.678458 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8553003-4099-40e3-8e1a-783414532ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:21.678733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8553003-4099-40e3-8e1a-783414532ee8 admin admin] PATH_INFO: `/v3/projects/b00028e5cfbc49b0a4edf6f9c517656e/users/8930eb4a78a4419c84be9fb9cefa9ce8/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:21.694384 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8553003-4099-40e3-8e1a-783414532ee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b00028e5cfbc49b0a4edf6f9c517656e, user_id=8930eb4a78a4419c84be9fb9cefa9ce8, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:21.697081 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8553003-4099-40e3-8e1a-783414532ee8 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:21.711859 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1273/2558] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:59:21 2022] PUT /identity/v3/projects/b00028e5cfbc49b0a4edf6f9c517656e/users/8930eb4a78a4419c84be9fb9cefa9ce8/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:21.716337 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855758c9-c59d-4015-afe5-d34ac8581f2e admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:21.728249 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855758c9-c59d-4015-afe5-d34ac8581f2e admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:21.786648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703998ba-c038-4c16-9c4c-5122c26a275a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:21.787279 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703998ba-c038-4c16-9c4c-5122c26a275a admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:21.787561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703998ba-c038-4c16-9c4c-5122c26a275a admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:21.787820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703998ba-c038-4c16-9c4c-5122c26a275a admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:21.788520 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703998ba-c038-4c16-9c4c-5122c26a275a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:21.790179 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703998ba-c038-4c16-9c4c-5122c26a275a admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:21.800779 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1286/2559] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:21.805400 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8553003-4099-40e3-8e1a-783414532ee8 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:21.817074 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8553003-4099-40e3-8e1a-783414532ee8 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:21.823172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e36a68-bfa6-489c-a920-e424ec58256f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:21.823965 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e36a68-bfa6-489c-a920-e424ec58256f admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:21.824392 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e36a68-bfa6-489c-a920-e424ec58256f admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:21.824676 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e36a68-bfa6-489c-a920-e424ec58256f admin admin] PATH_INFO: `/v3/projects/b00028e5cfbc49b0a4edf6f9c517656e/users/8930eb4a78a4419c84be9fb9cefa9ce8/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:21.826838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e36a68-bfa6-489c-a920-e424ec58256f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b00028e5cfbc49b0a4edf6f9c517656e, user_id=8930eb4a78a4419c84be9fb9cefa9ce8, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:21.829848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e36a68-bfa6-489c-a920-e424ec58256f admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:21.842048 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1274/2560] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:59:21 2022] PUT /identity/v3/projects/b00028e5cfbc49b0a4edf6f9c517656e/users/8930eb4a78a4419c84be9fb9cefa9ce8/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:21.854912 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82bcb2-5a3e-4ad6-b885-861bc7cb95a5 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:21.855222 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82bcb2-5a3e-4ad6-b885-861bc7cb95a5 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:21.855574 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82bcb2-5a3e-4ad6-b885-861bc7cb95a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:21.877942 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:21.886636 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-8b82bcb2-5a3e-4ad6-b885-861bc7cb95a5 None None] MFA Rules not processed for user `8930eb4a78a4419c84be9fb9cefa9ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:21.888084 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-8b82bcb2-5a3e-4ad6-b885-861bc7cb95a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:21.966736 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1287/2561] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:59:21.978798 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e36a68-bfa6-489c-a920-e424ec58256f admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:21.980843 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-b5e36a68-bfa6-489c-a920-e424ec58256f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:22.056526 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e36a68-bfa6-489c-a920-e424ec58256f admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:22.060561 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347d51e-42ec-4dee-9fc4-c7b7001cb272 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:22.061188 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347d51e-42ec-4dee-9fc4-c7b7001cb272 service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:22.061460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347d51e-42ec-4dee-9fc4-c7b7001cb272 service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:22.061729 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347d51e-42ec-4dee-9fc4-c7b7001cb272 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:22.089532 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:22.123454 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347d51e-42ec-4dee-9fc4-c7b7001cb272 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:22.126296 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347d51e-42ec-4dee-9fc4-c7b7001cb272 service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:22.135318 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1275/2562] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:59:26.422223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82bcb2-5a3e-4ad6-b885-861bc7cb95a5 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:26.436091 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82bcb2-5a3e-4ad6-b885-861bc7cb95a5 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:26.440109 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868ff46-fea9-4069-8a0b-295e417eac32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:26.440751 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868ff46-fea9-4069-8a0b-295e417eac32 service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:26.441033 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868ff46-fea9-4069-8a0b-295e417eac32 service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:26.441307 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868ff46-fea9-4069-8a0b-295e417eac32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:26.451772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868ff46-fea9-4069-8a0b-295e417eac32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:26.453285 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868ff46-fea9-4069-8a0b-295e417eac32 service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:26.463764 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1288/2563] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:59:31.080288 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347d51e-42ec-4dee-9fc4-c7b7001cb272 service cinder] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:31.081899 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-4347d51e-42ec-4dee-9fc4-c7b7001cb272 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:31.149109 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347d51e-42ec-4dee-9fc4-c7b7001cb272 service cinder] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:31.152744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111877d0-eeac-46aa-a1ad-9574ea1c8c13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:31.153368 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111877d0-eeac-46aa-a1ad-9574ea1c8c13 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:31.153650 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111877d0-eeac-46aa-a1ad-9574ea1c8c13 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:31.153919 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111877d0-eeac-46aa-a1ad-9574ea1c8c13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:31.155811 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-111877d0-eeac-46aa-a1ad-9574ea1c8c13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:31.222242 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111877d0-eeac-46aa-a1ad-9574ea1c8c13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:31.223684 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111877d0-eeac-46aa-a1ad-9574ea1c8c13 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:31.233789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1276/2564] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:59:31.469371 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868ff46-fea9-4069-8a0b-295e417eac32 service cinder] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:31.481374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868ff46-fea9-4069-8a0b-295e417eac32 service cinder] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:31.486641 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c914f-2b50-49cb-b0cc-8e9fb6317daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:31.487477 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c914f-2b50-49cb-b0cc-8e9fb6317daa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:31.487649 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c914f-2b50-49cb-b0cc-8e9fb6317daa admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:31.488165 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c914f-2b50-49cb-b0cc-8e9fb6317daa admin admin] PATH_INFO: `/v3/users/bc28a5cd4d154d45ab698b4748a5486d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:31.489448 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c914f-2b50-49cb-b0cc-8e9fb6317daa admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc28a5cd4d154d45ab698b4748a5486d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:31.494675 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c914f-2b50-49cb-b0cc-8e9fb6317daa admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:31.554921 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-248c914f-2b50-49cb-b0cc-8e9fb6317daa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc28a5cd4d154d45ab698b4748a5486d'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:31.555574 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-248c914f-2b50-49cb-b0cc-8e9fb6317daa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc28a5cd4d154d45ab698b4748a5486d'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:31.564060 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-248c914f-2b50-49cb-b0cc-8e9fb6317daa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc28a5cd4d154d45ab698b4748a5486d'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:31.579590 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-248c914f-2b50-49cb-b0cc-8e9fb6317daa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc28a5cd4d154d45ab698b4748a5486d'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:31.588035 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-248c914f-2b50-49cb-b0cc-8e9fb6317daa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc28a5cd4d154d45ab698b4748a5486d'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:31.596161 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1289/2565] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:59:31 2022] DELETE /identity/v3/users/bc28a5cd4d154d45ab698b4748a5486d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:31.601249 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d0a60-ff95-49c2-9af1-7b505b4de615 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:31.601537 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d0a60-ff95-49c2-9af1-7b505b4de615 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:31.601810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d0a60-ff95-49c2-9af1-7b505b4de615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:31.624712 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-eb7d0a60-ff95-49c2-9af1-7b505b4de615 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:31.626002 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-eb7d0a60-ff95-49c2-9af1-7b505b4de615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:31.714345 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1277/2566] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:31.724928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c914f-2b50-49cb-b0cc-8e9fb6317daa admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:31.727261 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-248c914f-2b50-49cb-b0cc-8e9fb6317daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:31.813158 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c914f-2b50-49cb-b0cc-8e9fb6317daa admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:31.817230 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0e50b-4eb5-4b4d-af76-eac23373dace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:31.817864 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0e50b-4eb5-4b4d-af76-eac23373dace service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:31.818176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0e50b-4eb5-4b4d-af76-eac23373dace service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:31.818432 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0e50b-4eb5-4b4d-af76-eac23373dace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:31.828146 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0e50b-4eb5-4b4d-af76-eac23373dace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:31.829648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0e50b-4eb5-4b4d-af76-eac23373dace service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:31.833773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:31.840523 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1290/2567] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:59:32.122123 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d0a60-ff95-49c2-9af1-7b505b4de615 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:32.124556 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-eb7d0a60-ff95-49c2-9af1-7b505b4de615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:32.146192 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d0a60-ff95-49c2-9af1-7b505b4de615 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:32.152735 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046dd5b-dc82-443b-ad19-c36cd19c2253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:32.153412 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046dd5b-dc82-443b-ad19-c36cd19c2253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:32.153728 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046dd5b-dc82-443b-ad19-c36cd19c2253 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:32.153949 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046dd5b-dc82-443b-ad19-c36cd19c2253 admin admin] PATH_INFO: `/v3/projects/a57e4e12f4004ef387e766bfb3ff1cc4` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:32.155209 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046dd5b-dc82-443b-ad19-c36cd19c2253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a57e4e12f4004ef387e766bfb3ff1cc4)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:32.158241 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046dd5b-dc82-443b-ad19-c36cd19c2253 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:32.171546 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:32.214703 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8046dd5b-dc82-443b-ad19-c36cd19c2253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a57e4e12f4004ef387e766bfb3ff1cc4', 'request_id': 'req-8046dd5b-dc82-443b-ad19-c36cd19c2253'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:32.225075 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8046dd5b-dc82-443b-ad19-c36cd19c2253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a57e4e12f4004ef387e766bfb3ff1cc4', 'request_id': 'req-8046dd5b-dc82-443b-ad19-c36cd19c2253'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:32.231757 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8046dd5b-dc82-443b-ad19-c36cd19c2253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a57e4e12f4004ef387e766bfb3ff1cc4', 'request_id': 'req-8046dd5b-dc82-443b-ad19-c36cd19c2253'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:32.245042 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8046dd5b-dc82-443b-ad19-c36cd19c2253 admin admin] The token cache is being invalidate because project a57e4e12f4004ef387e766bfb3ff1cc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:59:32.245448 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8046dd5b-dc82-443b-ad19-c36cd19c2253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:32.246614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8046dd5b-dc82-443b-ad19-c36cd19c2253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:32.248398 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1278/2568] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:59:32 2022] DELETE /identity/v3/projects/a57e4e12f4004ef387e766bfb3ff1cc4 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:59:32.252444 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0e50b-4eb5-4b4d-af76-eac23373dace service neutron] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:32.263366 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0e50b-4eb5-4b4d-af76-eac23373dace service neutron] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:32.341269 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9af3c-9a46-4dae-9127-8028af720049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:32.341952 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9af3c-9a46-4dae-9127-8028af720049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:32.342282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9af3c-9a46-4dae-9127-8028af720049 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:32.342559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9af3c-9a46-4dae-9127-8028af720049 admin admin] PATH_INFO: `/v3/users/8930eb4a78a4419c84be9fb9cefa9ce8` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:32.343967 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9af3c-9a46-4dae-9127-8028af720049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8930eb4a78a4419c84be9fb9cefa9ce8)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:32.350468 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9af3c-9a46-4dae-9127-8028af720049 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:32.402950 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-34b9af3c-9a46-4dae-9127-8028af720049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8930eb4a78a4419c84be9fb9cefa9ce8'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:32.403625 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-34b9af3c-9a46-4dae-9127-8028af720049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8930eb4a78a4419c84be9fb9cefa9ce8'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:32.412973 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-34b9af3c-9a46-4dae-9127-8028af720049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8930eb4a78a4419c84be9fb9cefa9ce8'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:32.427727 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-34b9af3c-9a46-4dae-9127-8028af720049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8930eb4a78a4419c84be9fb9cefa9ce8'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:32.435339 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-34b9af3c-9a46-4dae-9127-8028af720049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8930eb4a78a4419c84be9fb9cefa9ce8'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:32.442224 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1291/2569] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:59:32 2022] DELETE /identity/v3/users/8930eb4a78a4419c84be9fb9cefa9ce8 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:32.741641 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046dd5b-dc82-443b-ad19-c36cd19c2253 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:32.743398 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-8046dd5b-dc82-443b-ad19-c36cd19c2253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:32.771362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046dd5b-dc82-443b-ad19-c36cd19c2253 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:32.843888 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c5de5-e197-44ab-b6cf-f008573be296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:32.844559 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c5de5-e197-44ab-b6cf-f008573be296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:32.844896 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c5de5-e197-44ab-b6cf-f008573be296 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:32.845175 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c5de5-e197-44ab-b6cf-f008573be296 admin admin] PATH_INFO: `/v3/projects/b00028e5cfbc49b0a4edf6f9c517656e` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:32.846649 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c5de5-e197-44ab-b6cf-f008573be296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b00028e5cfbc49b0a4edf6f9c517656e)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:32.848772 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c5de5-e197-44ab-b6cf-f008573be296 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:32.913427 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-282c5de5-e197-44ab-b6cf-f008573be296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b00028e5cfbc49b0a4edf6f9c517656e', 'request_id': 'req-282c5de5-e197-44ab-b6cf-f008573be296'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:32.923367 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-282c5de5-e197-44ab-b6cf-f008573be296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b00028e5cfbc49b0a4edf6f9c517656e', 'request_id': 'req-282c5de5-e197-44ab-b6cf-f008573be296'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:32.930391 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-282c5de5-e197-44ab-b6cf-f008573be296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b00028e5cfbc49b0a4edf6f9c517656e', 'request_id': 'req-282c5de5-e197-44ab-b6cf-f008573be296'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:32.945852 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-282c5de5-e197-44ab-b6cf-f008573be296 admin admin] The token cache is being invalidate because project b00028e5cfbc49b0a4edf6f9c517656e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:59:32.946314 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-282c5de5-e197-44ab-b6cf-f008573be296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:32.946987 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-282c5de5-e197-44ab-b6cf-f008573be296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:32.953838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1279/2570] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:59:32 2022] DELETE /identity/v3/projects/b00028e5cfbc49b0a4edf6f9c517656e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:32.956197 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b23a5-ab91-4d43-a78e-1cbdee2643c5 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:32.956727 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b23a5-ab91-4d43-a78e-1cbdee2643c5 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:32.956727 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b23a5-ab91-4d43-a78e-1cbdee2643c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:32.991295 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-755b23a5-ab91-4d43-a78e-1cbdee2643c5 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:32.992933 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-755b23a5-ab91-4d43-a78e-1cbdee2643c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:33.098241 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1292/2571] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:33.100759 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ce759-8447-45c4-bcd5-6a363d6c7871 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:33.101049 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ce759-8447-45c4-bcd5-6a363d6c7871 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:33.101324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ce759-8447-45c4-bcd5-6a363d6c7871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:33.127566 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-e94ce759-8447-45c4-bcd5-6a363d6c7871 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:33.143725 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-e94ce759-8447-45c4-bcd5-6a363d6c7871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:33.153830 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1280/2572] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:59:33.158422 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b23a5-ab91-4d43-a78e-1cbdee2643c5 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:33.170589 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b23a5-ab91-4d43-a78e-1cbdee2643c5 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:33.177076 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b82b0-d3b3-4f6b-aea7-9f7145a18100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:33.178013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b82b0-d3b3-4f6b-aea7-9f7145a18100 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:33.178600 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b82b0-d3b3-4f6b-aea7-9f7145a18100 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:33.179095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b82b0-d3b3-4f6b-aea7-9f7145a18100 admin admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:33.180108 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b82b0-d3b3-4f6b-aea7-9f7145a18100 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:59:33.180632 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b82b0-d3b3-4f6b-aea7-9f7145a18100 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:33.182582 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b82b0-d3b3-4f6b-aea7-9f7145a18100 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:33.203595 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1293/2573] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:59:33.205516 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ce759-8447-45c4-bcd5-6a363d6c7871 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:33.220863 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ce759-8447-45c4-bcd5-6a363d6c7871 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:33.227624 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3d7c4-3237-422b-b3d4-f4e2ccafeb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:33.228440 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3d7c4-3237-422b-b3d4-f4e2ccafeb89 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:33.228846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3d7c4-3237-422b-b3d4-f4e2ccafeb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:33.228975 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3d7c4-3237-422b-b3d4-f4e2ccafeb89 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:33.229663 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3d7c4-3237-422b-b3d4-f4e2ccafeb89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:33.232123 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3d7c4-3237-422b-b3d4-f4e2ccafeb89 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:33.272494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1281/2574] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:59:33 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:33.276873 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b82b0-d3b3-4f6b-aea7-9f7145a18100 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:33.292062 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:33.295919 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b82b0-d3b3-4f6b-aea7-9f7145a18100 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:33.371174 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad1fcd-9736-426c-9c41-7b36632426ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:33.372314 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad1fcd-9736-426c-9c41-7b36632426ee admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:33.372935 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad1fcd-9736-426c-9c41-7b36632426ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:33.373315 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad1fcd-9736-426c-9c41-7b36632426ee admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:33.374121 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad1fcd-9736-426c-9c41-7b36632426ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:33.376182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad1fcd-9736-426c-9c41-7b36632426ee admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:33.400604 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1294/2575] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:59:33 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:33.404756 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3d7c4-3237-422b-b3d4-f4e2ccafeb89 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:33.410427 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:33.417720 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3d7c4-3237-422b-b3d4-f4e2ccafeb89 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:33.424732 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e28c3d-d1b5-4e43-8d45-7ec146bf5857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:33.425379 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e28c3d-d1b5-4e43-8d45-7ec146bf5857 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:33.425658 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e28c3d-d1b5-4e43-8d45-7ec146bf5857 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:33.425934 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e28c3d-d1b5-4e43-8d45-7ec146bf5857 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:33.426691 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e28c3d-d1b5-4e43-8d45-7ec146bf5857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:33.428327 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e28c3d-d1b5-4e43-8d45-7ec146bf5857 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:33.439969 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1282/2576] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:59:33.444141 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad1fcd-9736-426c-9c41-7b36632426ee admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:33.454945 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad1fcd-9736-426c-9c41-7b36632426ee admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:33.460637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20712a-d3a8-497b-bcb1-fd2875cc6120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:33.461263 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20712a-d3a8-497b-bcb1-fd2875cc6120 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:33.461605 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20712a-d3a8-497b-bcb1-fd2875cc6120 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:33.461951 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20712a-d3a8-497b-bcb1-fd2875cc6120 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:33.462745 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20712a-d3a8-497b-bcb1-fd2875cc6120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:33.464452 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20712a-d3a8-497b-bcb1-fd2875cc6120 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:33.476458 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1295/2577] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:33.480839 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e28c3d-d1b5-4e43-8d45-7ec146bf5857 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:33.491943 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e28c3d-d1b5-4e43-8d45-7ec146bf5857 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:33.497140 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824bf6ee-6446-43f2-997e-0cbe5f687a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:33.497840 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bf6ee-6446-43f2-997e-0cbe5f687a4d admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:33.498140 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bf6ee-6446-43f2-997e-0cbe5f687a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:33.498426 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bf6ee-6446-43f2-997e-0cbe5f687a4d admin admin] PATH_INFO: `/v3/projects/9c1baac8f0e24fddb0269ea5e3c53926/users/f6bdf1f4c0a7404ab977d00add7914fc/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:33.514629 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824bf6ee-6446-43f2-997e-0cbe5f687a4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c1baac8f0e24fddb0269ea5e3c53926, user_id=f6bdf1f4c0a7404ab977d00add7914fc, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:33.517284 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824bf6ee-6446-43f2-997e-0cbe5f687a4d admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:33.532476 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1283/2578] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:59:33 2022] PUT /identity/v3/projects/9c1baac8f0e24fddb0269ea5e3c53926/users/f6bdf1f4c0a7404ab977d00add7914fc/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:33.544240 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e91758-9f0c-4fc5-a7ec-790a14f445ca None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:33.544533 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e91758-9f0c-4fc5-a7ec-790a14f445ca None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:33.544810 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e91758-9f0c-4fc5-a7ec-790a14f445ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:33.575431 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-b5e91758-9f0c-4fc5-a7ec-790a14f445ca None None] MFA Rules not processed for user `f6bdf1f4c0a7404ab977d00add7914fc`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:33.576662 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-b5e91758-9f0c-4fc5-a7ec-790a14f445ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:33.645682 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1296/2579] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:33.663668 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824bf6ee-6446-43f2-997e-0cbe5f687a4d admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:33.665413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-824bf6ee-6446-43f2-997e-0cbe5f687a4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:33.762170 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824bf6ee-6446-43f2-997e-0cbe5f687a4d admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:33.767336 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305f005-1f82-4e88-a661-df4ae8e5a545 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:33.768398 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305f005-1f82-4e88-a661-df4ae8e5a545 service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:33.768896 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305f005-1f82-4e88-a661-df4ae8e5a545 service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:33.769404 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305f005-1f82-4e88-a661-df4ae8e5a545 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:33.781018 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305f005-1f82-4e88-a661-df4ae8e5a545 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:33.782964 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305f005-1f82-4e88-a661-df4ae8e5a545 service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:33.825371 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e91758-9f0c-4fc5-a7ec-790a14f445ca None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:33.826341 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1284/2580] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:59:33.904219 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e91758-9f0c-4fc5-a7ec-790a14f445ca None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:33.908793 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c927c7-c348-4ba9-a0f6-9949d3ced2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:33.909451 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c927c7-c348-4ba9-a0f6-9949d3ced2d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:33.910008 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c927c7-c348-4ba9-a0f6-9949d3ced2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:33.910343 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c927c7-c348-4ba9-a0f6-9949d3ced2d7 admin admin] PATH_INFO: `/v3/users/f6bdf1f4c0a7404ab977d00add7914fc` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:33.911450 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c927c7-c348-4ba9-a0f6-9949d3ced2d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6bdf1f4c0a7404ab977d00add7914fc)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:33.913401 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c927c7-c348-4ba9-a0f6-9949d3ced2d7 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:33.931334 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:33.976999 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-52c927c7-c348-4ba9-a0f6-9949d3ced2d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6bdf1f4c0a7404ab977d00add7914fc'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:33.978336 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-52c927c7-c348-4ba9-a0f6-9949d3ced2d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6bdf1f4c0a7404ab977d00add7914fc'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:33.989273 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-52c927c7-c348-4ba9-a0f6-9949d3ced2d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6bdf1f4c0a7404ab977d00add7914fc'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:34.014248 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-52c927c7-c348-4ba9-a0f6-9949d3ced2d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6bdf1f4c0a7404ab977d00add7914fc'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:34.027014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-52c927c7-c348-4ba9-a0f6-9949d3ced2d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6bdf1f4c0a7404ab977d00add7914fc'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:34.034273 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1297/2581] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:59:33 2022] DELETE /identity/v3/users/f6bdf1f4c0a7404ab977d00add7914fc => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:59:34.039172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfc1a7-3b4b-4cb8-9f4b-2314e42944d4 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:34.039461 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfc1a7-3b4b-4cb8-9f4b-2314e42944d4 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:34.039736 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfc1a7-3b4b-4cb8-9f4b-2314e42944d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:34.061802 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-0cdfc1a7-3b4b-4cb8-9f4b-2314e42944d4 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:34.063308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-0cdfc1a7-3b4b-4cb8-9f4b-2314e42944d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:34.194180 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1285/2582] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:59:34.210490 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c927c7-c348-4ba9-a0f6-9949d3ced2d7 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:34.214080 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-52c927c7-c348-4ba9-a0f6-9949d3ced2d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:34.320945 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c927c7-c348-4ba9-a0f6-9949d3ced2d7 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:34.329772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9684c9-4b5c-4809-bc46-ffce29728bce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:34.332930 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9684c9-4b5c-4809-bc46-ffce29728bce service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:34.333357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9684c9-4b5c-4809-bc46-ffce29728bce service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:34.333735 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9684c9-4b5c-4809-bc46-ffce29728bce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:34.347057 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9684c9-4b5c-4809-bc46-ffce29728bce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:34.348952 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9684c9-4b5c-4809-bc46-ffce29728bce service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:34.363811 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1298/2583] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:59:34.714749 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfc1a7-3b4b-4cb8-9f4b-2314e42944d4 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:34.716179 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-0cdfc1a7-3b4b-4cb8-9f4b-2314e42944d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:34.901698 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfc1a7-3b4b-4cb8-9f4b-2314e42944d4 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:34.914678 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973b389-a993-46f7-be76-39082a0eae1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae8593e125da4b208dd100608aa2b462', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:34.915389 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973b389-a993-46f7-be76-39082a0eae1f service nova] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:34.915655 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973b389-a993-46f7-be76-39082a0eae1f service nova] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:34.915933 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973b389-a993-46f7-be76-39082a0eae1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:34.919089 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-8973b389-a993-46f7-be76-39082a0eae1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:34.946675 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:34.950230 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973b389-a993-46f7-be76-39082a0eae1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:34.951887 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973b389-a993-46f7-be76-39082a0eae1f service nova] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:34.980378 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1286/2584] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:59:35.334888 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9684c9-4b5c-4809-bc46-ffce29728bce service neutron] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:35.336412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-0f9684c9-4b5c-4809-bc46-ffce29728bce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:35.353920 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9684c9-4b5c-4809-bc46-ffce29728bce service neutron] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:35.367801 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f103b63-090b-4c65-bb7c-c510f1d74bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:35.370125 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f103b63-090b-4c65-bb7c-c510f1d74bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:35.370666 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f103b63-090b-4c65-bb7c-c510f1d74bce admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:35.371163 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f103b63-090b-4c65-bb7c-c510f1d74bce admin admin] PATH_INFO: `/v3/projects/9c1baac8f0e24fddb0269ea5e3c53926` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:35.373251 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f103b63-090b-4c65-bb7c-c510f1d74bce admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c1baac8f0e24fddb0269ea5e3c53926)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:35.376085 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f103b63-090b-4c65-bb7c-c510f1d74bce admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:35.485420 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2f103b63-090b-4c65-bb7c-c510f1d74bce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c1baac8f0e24fddb0269ea5e3c53926', 'request_id': 'req-2f103b63-090b-4c65-bb7c-c510f1d74bce'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:35.500744 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2f103b63-090b-4c65-bb7c-c510f1d74bce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c1baac8f0e24fddb0269ea5e3c53926', 'request_id': 'req-2f103b63-090b-4c65-bb7c-c510f1d74bce'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:35.509116 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2f103b63-090b-4c65-bb7c-c510f1d74bce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c1baac8f0e24fddb0269ea5e3c53926', 'request_id': 'req-2f103b63-090b-4c65-bb7c-c510f1d74bce'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:35.524608 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2f103b63-090b-4c65-bb7c-c510f1d74bce admin admin] The token cache is being invalidate because project 9c1baac8f0e24fddb0269ea5e3c53926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:59:35.524901 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2f103b63-090b-4c65-bb7c-c510f1d74bce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:35.525611 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-2f103b63-090b-4c65-bb7c-c510f1d74bce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:35.527314 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1299/2585] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:59:35 2022] DELETE /identity/v3/projects/9c1baac8f0e24fddb0269ea5e3c53926 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:35.532323 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3258fa5-3c29-4af2-9471-b88ff7386c1f None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:35.532873 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3258fa5-3c29-4af2-9471-b88ff7386c1f None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:35.532873 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3258fa5-3c29-4af2-9471-b88ff7386c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:35.553888 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-c3258fa5-3c29-4af2-9471-b88ff7386c1f None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:35.555310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-c3258fa5-3c29-4af2-9471-b88ff7386c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:35.629646 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1287/2586] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:59:35.638664 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398bdd6-0fd6-4e65-a060-258dc3833421 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:35.638952 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398bdd6-0fd6-4e65-a060-258dc3833421 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:35.639223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398bdd6-0fd6-4e65-a060-258dc3833421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:35.668556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-2398bdd6-0fd6-4e65-a060-258dc3833421 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:35.670909 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-2398bdd6-0fd6-4e65-a060-258dc3833421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:35.680643 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1300/2587] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:35.684618 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398bdd6-0fd6-4e65-a060-258dc3833421 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:35.684883 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3258fa5-3c29-4af2-9471-b88ff7386c1f None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:35.688560 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-c3258fa5-3c29-4af2-9471-b88ff7386c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:35.696042 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398bdd6-0fd6-4e65-a060-258dc3833421 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:35.701815 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3258fa5-3c29-4af2-9471-b88ff7386c1f None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:35.702344 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075102e-a787-43c0-b788-08445b36e810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:35.703177 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075102e-a787-43c0-b788-08445b36e810 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:35.703550 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075102e-a787-43c0-b788-08445b36e810 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:35.703887 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075102e-a787-43c0-b788-08445b36e810 admin admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:35.704661 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075102e-a787-43c0-b788-08445b36e810 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:59:35.705025 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075102e-a787-43c0-b788-08445b36e810 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:35.706956 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075102e-a787-43c0-b788-08445b36e810 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:35.707448 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662502f3-8d34-4519-a1d7-73b8bd15b5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:35.708560 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662502f3-8d34-4519-a1d7-73b8bd15b5dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:35.709110 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662502f3-8d34-4519-a1d7-73b8bd15b5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:35.709617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662502f3-8d34-4519-a1d7-73b8bd15b5dd admin admin] PATH_INFO: `/v3/users/c01c17a9cf7e485da50e80b139cf19eb` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:35.711321 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662502f3-8d34-4519-a1d7-73b8bd15b5dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c01c17a9cf7e485da50e80b139cf19eb)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:35.713355 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662502f3-8d34-4519-a1d7-73b8bd15b5dd admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:35.716252 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:35.726423 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1301/2588] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:59:35.727264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075102e-a787-43c0-b788-08445b36e810 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:35.742127 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075102e-a787-43c0-b788-08445b36e810 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:35.747499 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83726c3a-6db0-44cc-9bfb-7416a60e15d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:35.748319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83726c3a-6db0-44cc-9bfb-7416a60e15d7 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:35.748810 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83726c3a-6db0-44cc-9bfb-7416a60e15d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:35.749323 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83726c3a-6db0-44cc-9bfb-7416a60e15d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:35.749814 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83726c3a-6db0-44cc-9bfb-7416a60e15d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:35.751969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83726c3a-6db0-44cc-9bfb-7416a60e15d7 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:35.787268 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1302/2589] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:59:35 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:35.792216 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83726c3a-6db0-44cc-9bfb-7416a60e15d7 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:35.804231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-662502f3-8d34-4519-a1d7-73b8bd15b5dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c01c17a9cf7e485da50e80b139cf19eb'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:35.821435 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-662502f3-8d34-4519-a1d7-73b8bd15b5dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c01c17a9cf7e485da50e80b139cf19eb'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:35.839262 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-662502f3-8d34-4519-a1d7-73b8bd15b5dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c01c17a9cf7e485da50e80b139cf19eb'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:35.851535 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-662502f3-8d34-4519-a1d7-73b8bd15b5dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c01c17a9cf7e485da50e80b139cf19eb'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:35.852491 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-662502f3-8d34-4519-a1d7-73b8bd15b5dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c01c17a9cf7e485da50e80b139cf19eb'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:35.859848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1288/2590] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:59:35 2022] DELETE /identity/v3/users/c01c17a9cf7e485da50e80b139cf19eb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:35.879019 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83726c3a-6db0-44cc-9bfb-7416a60e15d7 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:35.957645 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b1af0-95da-41b4-b5a1-c8ed7f7ee8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:35.958437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b1af0-95da-41b4-b5a1-c8ed7f7ee8d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:35.958871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b1af0-95da-41b4-b5a1-c8ed7f7ee8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:35.959146 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b1af0-95da-41b4-b5a1-c8ed7f7ee8d9 admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:35.959917 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b1af0-95da-41b4-b5a1-c8ed7f7ee8d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:35.962103 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86b1af0-95da-41b4-b5a1-c8ed7f7ee8d9 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:35.995223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1303/2591] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:59:35 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:36.000483 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662502f3-8d34-4519-a1d7-73b8bd15b5dd admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:36.003110 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-662502f3-8d34-4519-a1d7-73b8bd15b5dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:36.043528 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662502f3-8d34-4519-a1d7-73b8bd15b5dd admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:36.059621 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b94b65-e578-492c-af0e-c6401407858e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:36.060704 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b94b65-e578-492c-af0e-c6401407858e admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:36.061210 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b94b65-e578-492c-af0e-c6401407858e admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:36.061701 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b94b65-e578-492c-af0e-c6401407858e admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:36.063216 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b94b65-e578-492c-af0e-c6401407858e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:36.066578 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b94b65-e578-492c-af0e-c6401407858e admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:36.101786 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1289/2592] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:36.107459 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b1af0-95da-41b4-b5a1-c8ed7f7ee8d9 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:36.125752 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b1af0-95da-41b4-b5a1-c8ed7f7ee8d9 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:36.132156 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dea189-915c-45a8-a441-c22a728ee664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:36.132956 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dea189-915c-45a8-a441-c22a728ee664 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:36.133270 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dea189-915c-45a8-a441-c22a728ee664 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:36.133558 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dea189-915c-45a8-a441-c22a728ee664 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:36.134307 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dea189-915c-45a8-a441-c22a728ee664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:36.135997 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dea189-915c-45a8-a441-c22a728ee664 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:36.146444 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b94b65-e578-492c-af0e-c6401407858e admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:36.148599 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-b5b94b65-e578-492c-af0e-c6401407858e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:36.158187 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1304/2593] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:36.162817 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dea189-915c-45a8-a441-c22a728ee664 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:36.164584 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b94b65-e578-492c-af0e-c6401407858e admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:36.170194 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8729e-e0d9-4fb9-b616-156f53ba298a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:36.170888 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8729e-e0d9-4fb9-b616-156f53ba298a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:36.171175 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8729e-e0d9-4fb9-b616-156f53ba298a admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:36.171458 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8729e-e0d9-4fb9-b616-156f53ba298a admin admin] PATH_INFO: `/v3/projects/f23e54f4300640899c1ff1cdbbd9203c` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:36.173395 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8729e-e0d9-4fb9-b616-156f53ba298a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f23e54f4300640899c1ff1cdbbd9203c)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:36.175717 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8729e-e0d9-4fb9-b616-156f53ba298a admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:36.177095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dea189-915c-45a8-a441-c22a728ee664 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:36.183837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828f3b9-4930-4386-bb0c-450dfe318bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:36.184591 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828f3b9-4930-4386-bb0c-450dfe318bff admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:36.184886 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828f3b9-4930-4386-bb0c-450dfe318bff admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:36.185147 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828f3b9-4930-4386-bb0c-450dfe318bff admin admin] PATH_INFO: `/v3/projects/71cf19e0adf341d0980c3926e042174b/users/2ef6e42874d940148303748c62b21e43/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:36.203991 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828f3b9-4930-4386-bb0c-450dfe318bff admin admin] RBAC: Authorizing `identity:create_grant(project_id=71cf19e0adf341d0980c3926e042174b, user_id=2ef6e42874d940148303748c62b21e43, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:36.207112 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828f3b9-4930-4386-bb0c-450dfe318bff admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:36.223711 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1305/2594] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:59:36 2022] PUT /identity/v3/projects/71cf19e0adf341d0980c3926e042174b/users/2ef6e42874d940148303748c62b21e43/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:36.234525 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aec519-9e11-4873-9a7e-d98533901b18 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:36.234816 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aec519-9e11-4873-9a7e-d98533901b18 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:36.235145 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aec519-9e11-4873-9a7e-d98533901b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:36.242775 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-4ad8729e-e0d9-4fb9-b616-156f53ba298a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f23e54f4300640899c1ff1cdbbd9203c', 'request_id': 'req-4ad8729e-e0d9-4fb9-b616-156f53ba298a'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:36.246772 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:36.254238 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-4ad8729e-e0d9-4fb9-b616-156f53ba298a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f23e54f4300640899c1ff1cdbbd9203c', 'request_id': 'req-4ad8729e-e0d9-4fb9-b616-156f53ba298a'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:36.262758 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-4ad8729e-e0d9-4fb9-b616-156f53ba298a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f23e54f4300640899c1ff1cdbbd9203c', 'request_id': 'req-4ad8729e-e0d9-4fb9-b616-156f53ba298a'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:36.271167 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-92aec519-9e11-4873-9a7e-d98533901b18 None None] MFA Rules not processed for user `2ef6e42874d940148303748c62b21e43`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:36.272660 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-92aec519-9e11-4873-9a7e-d98533901b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:36.297704 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-4ad8729e-e0d9-4fb9-b616-156f53ba298a admin admin] The token cache is being invalidate because project f23e54f4300640899c1ff1cdbbd9203c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:59:36.298560 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-4ad8729e-e0d9-4fb9-b616-156f53ba298a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:36.299410 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-4ad8729e-e0d9-4fb9-b616-156f53ba298a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:36.301270 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1290/2595] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:59:36 2022] DELETE /identity/v3/projects/f23e54f4300640899c1ff1cdbbd9203c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:59:36.306832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c4e0c-8c53-4a67-aa28-488050bf617d None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:36.311356 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c4e0c-8c53-4a67-aa28-488050bf617d None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:36.312013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c4e0c-8c53-4a67-aa28-488050bf617d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:36.329614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:36.343779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-df6c4e0c-8c53-4a67-aa28-488050bf617d None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:36.345037 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-df6c4e0c-8c53-4a67-aa28-488050bf617d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:36.388069 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1306/2596] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:59:36.400103 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aec519-9e11-4873-9a7e-d98533901b18 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:36.401691 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-92aec519-9e11-4873-9a7e-d98533901b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:36.438315 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1291/2597] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:36.441821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202f86c-7da4-4a74-b446-3fc074ff7ccb None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:36.441821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202f86c-7da4-4a74-b446-3fc074ff7ccb None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:36.441821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202f86c-7da4-4a74-b446-3fc074ff7ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:36.473328 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-0202f86c-7da4-4a74-b446-3fc074ff7ccb None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:36.475178 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-0202f86c-7da4-4a74-b446-3fc074ff7ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:36.482855 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aec519-9e11-4873-9a7e-d98533901b18 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:36.485431 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1292/2598] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:36.487915 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18339ef-34e8-4845-ad01-fba140fdfb98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:36.488673 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18339ef-34e8-4845-ad01-fba140fdfb98 service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:36.489152 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18339ef-34e8-4845-ad01-fba140fdfb98 service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:36.489521 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18339ef-34e8-4845-ad01-fba140fdfb98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:36.489899 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202f86c-7da4-4a74-b446-3fc074ff7ccb None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:36.499755 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18339ef-34e8-4845-ad01-fba140fdfb98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:36.501238 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18339ef-34e8-4845-ad01-fba140fdfb98 service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:36.503289 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202f86c-7da4-4a74-b446-3fc074ff7ccb None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:36.510551 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47f334-a7cd-453e-905d-1fc24b149652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:36.511438 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47f334-a7cd-453e-905d-1fc24b149652 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:36.511558 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1307/2599] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:59:36.511646 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47f334-a7cd-453e-905d-1fc24b149652 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:36.511736 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47f334-a7cd-453e-905d-1fc24b149652 admin admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:36.512463 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47f334-a7cd-453e-905d-1fc24b149652 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:59:36.512898 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47f334-a7cd-453e-905d-1fc24b149652 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:36.514621 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47f334-a7cd-453e-905d-1fc24b149652 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:36.532617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1293/2600] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:59:36.534579 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18339ef-34e8-4845-ad01-fba140fdfb98 service cinder] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:36.545488 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18339ef-34e8-4845-ad01-fba140fdfb98 service cinder] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:36.550161 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383a916-de60-49ba-88e0-ab0c145a1293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:36.550791 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383a916-de60-49ba-88e0-ab0c145a1293 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:36.551075 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383a916-de60-49ba-88e0-ab0c145a1293 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:36.551350 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383a916-de60-49ba-88e0-ab0c145a1293 admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:36.552033 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383a916-de60-49ba-88e0-ab0c145a1293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:36.554018 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383a916-de60-49ba-88e0-ab0c145a1293 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:36.587475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1308/2601] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:59:36 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:36.589703 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47f334-a7cd-453e-905d-1fc24b149652 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:36.601576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47f334-a7cd-453e-905d-1fc24b149652 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:36.663202 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460a0f7-f3c8-4ea1-b303-ada6462bbd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:36.663836 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460a0f7-f3c8-4ea1-b303-ada6462bbd36 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:36.664119 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460a0f7-f3c8-4ea1-b303-ada6462bbd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:36.664390 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460a0f7-f3c8-4ea1-b303-ada6462bbd36 admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:36.665103 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9460a0f7-f3c8-4ea1-b303-ada6462bbd36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:36.667122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9460a0f7-f3c8-4ea1-b303-ada6462bbd36 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:36.689523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1294/2602] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:59:36 2022] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:36.693814 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383a916-de60-49ba-88e0-ab0c145a1293 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:36.705366 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383a916-de60-49ba-88e0-ab0c145a1293 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:36.710308 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae00dc-d479-415f-9703-39909881171d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:36.711013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae00dc-d479-415f-9703-39909881171d admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:36.711357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae00dc-d479-415f-9703-39909881171d admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:36.711715 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae00dc-d479-415f-9703-39909881171d admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:36.712486 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae00dc-d479-415f-9703-39909881171d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:36.714219 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae00dc-d479-415f-9703-39909881171d admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:36.727025 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1309/2603] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:59:36.729879 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460a0f7-f3c8-4ea1-b303-ada6462bbd36 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:36.741246 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460a0f7-f3c8-4ea1-b303-ada6462bbd36 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:36.747484 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702c80e-4081-4846-b634-7706e6e41e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:36.748130 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702c80e-4081-4846-b634-7706e6e41e44 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:36.748413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702c80e-4081-4846-b634-7706e6e41e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:36.748878 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702c80e-4081-4846-b634-7706e6e41e44 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:36.749633 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702c80e-4081-4846-b634-7706e6e41e44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:36.751388 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702c80e-4081-4846-b634-7706e6e41e44 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:36.764107 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1295/2604] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:36.774145 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae00dc-d479-415f-9703-39909881171d admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:36.805293 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae00dc-d479-415f-9703-39909881171d admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:36.815402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a5bed-839d-4dc7-ba4f-31e24d3725b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:36.816173 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a5bed-839d-4dc7-ba4f-31e24d3725b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:36.816459 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a5bed-839d-4dc7-ba4f-31e24d3725b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:36.816741 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a5bed-839d-4dc7-ba4f-31e24d3725b7 admin admin] PATH_INFO: `/v3/projects/7507f7e166af44bb950e86aa6d9411ae/users/5f2542f3a788478cb5788cc0ccb361fe/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:36.843494 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a5bed-839d-4dc7-ba4f-31e24d3725b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7507f7e166af44bb950e86aa6d9411ae, user_id=5f2542f3a788478cb5788cc0ccb361fe, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:36.854319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a5bed-839d-4dc7-ba4f-31e24d3725b7 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:36.866047 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1310/2605] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:59:36 2022] PUT /identity/v3/projects/7507f7e166af44bb950e86aa6d9411ae/users/5f2542f3a788478cb5788cc0ccb361fe/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:36.876539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c1612-9bd3-4aa6-b37d-bc1f7f7e4f3c None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:36.877457 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c1612-9bd3-4aa6-b37d-bc1f7f7e4f3c None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:36.877457 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c1612-9bd3-4aa6-b37d-bc1f7f7e4f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:36.917763 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-b37c1612-9bd3-4aa6-b37d-bc1f7f7e4f3c None None] MFA Rules not processed for user `5f2542f3a788478cb5788cc0ccb361fe`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:36.919036 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-b37c1612-9bd3-4aa6-b37d-bc1f7f7e4f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:36.949847 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:36.998292 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1296/2606] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:36 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:37.003005 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a5bed-839d-4dc7-ba4f-31e24d3725b7 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:37.074268 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a5bed-839d-4dc7-ba4f-31e24d3725b7 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:37.079423 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179c925-9891-4f86-8478-2a82d0824b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:37.080068 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179c925-9891-4f86-8478-2a82d0824b05 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:37.080356 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179c925-9891-4f86-8478-2a82d0824b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:37.080780 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179c925-9891-4f86-8478-2a82d0824b05 admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:37.081463 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179c925-9891-4f86-8478-2a82d0824b05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:37.083374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179c925-9891-4f86-8478-2a82d0824b05 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:37.107253 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:37.119952 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1311/2607] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:59:37 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:37.122305 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c1612-9bd3-4aa6-b37d-bc1f7f7e4f3c None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:37.137202 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c1612-9bd3-4aa6-b37d-bc1f7f7e4f3c None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:37.203931 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a49a6-86d1-4b3a-9878-3813315f7f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:37.204573 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a49a6-86d1-4b3a-9878-3813315f7f4b admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:37.204857 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a49a6-86d1-4b3a-9878-3813315f7f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:37.205503 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a49a6-86d1-4b3a-9878-3813315f7f4b admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:37.206230 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a49a6-86d1-4b3a-9878-3813315f7f4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:37.208259 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a49a6-86d1-4b3a-9878-3813315f7f4b admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:37.236562 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1297/2608] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:59:37 2022] POST /identity/v3/users => generated 289 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:37.240808 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179c925-9891-4f86-8478-2a82d0824b05 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:37.253348 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179c925-9891-4f86-8478-2a82d0824b05 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:37.259776 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17974be-d2a4-4496-aaa8-3121e19ec43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:37.260623 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17974be-d2a4-4496-aaa8-3121e19ec43e admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:37.260966 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17974be-d2a4-4496-aaa8-3121e19ec43e admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:37.261314 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17974be-d2a4-4496-aaa8-3121e19ec43e admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:37.262125 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17974be-d2a4-4496-aaa8-3121e19ec43e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:37.270320 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17974be-d2a4-4496-aaa8-3121e19ec43e admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:37.294161 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1312/2609] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:37.297309 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a49a6-86d1-4b3a-9878-3813315f7f4b admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:37.314032 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a49a6-86d1-4b3a-9878-3813315f7f4b admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:37.326332 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2af07c-781d-4375-99ee-c4ba7014eddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:37.327510 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2af07c-781d-4375-99ee-c4ba7014eddd admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:37.327510 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2af07c-781d-4375-99ee-c4ba7014eddd admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:37.327892 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2af07c-781d-4375-99ee-c4ba7014eddd admin admin] PATH_INFO: `/v3/projects/e69bb28eef944c00941b5f3e7c156b0e/users/d22dc841d7b24da18fbae006e02a31d8/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:37.345148 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2af07c-781d-4375-99ee-c4ba7014eddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e69bb28eef944c00941b5f3e7c156b0e, user_id=d22dc841d7b24da18fbae006e02a31d8, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:37.348050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2af07c-781d-4375-99ee-c4ba7014eddd admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:37.363786 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1298/2610] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:59:37 2022] PUT /identity/v3/projects/e69bb28eef944c00941b5f3e7c156b0e/users/d22dc841d7b24da18fbae006e02a31d8/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:37.367740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17974be-d2a4-4496-aaa8-3121e19ec43e admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:37.379093 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17974be-d2a4-4496-aaa8-3121e19ec43e admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:37.466195 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae6f2fb-6b2d-4588-a6fb-60ffa357f2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:37.466960 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6f2fb-6b2d-4588-a6fb-60ffa357f2fd admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:37.467630 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6f2fb-6b2d-4588-a6fb-60ffa357f2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:37.468007 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae6f2fb-6b2d-4588-a6fb-60ffa357f2fd admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:37.469602 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6f2fb-6b2d-4588-a6fb-60ffa357f2fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:37.471772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae6f2fb-6b2d-4588-a6fb-60ffa357f2fd admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:37.494010 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1313/2611] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:37.494574 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2af07c-781d-4375-99ee-c4ba7014eddd admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:37.506697 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2af07c-781d-4375-99ee-c4ba7014eddd admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:37.511510 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f0c73-1c2e-43b5-9d4c-c8856aa93cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:37.512207 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f0c73-1c2e-43b5-9d4c-c8856aa93cf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:37.512484 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f0c73-1c2e-43b5-9d4c-c8856aa93cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:37.512801 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f0c73-1c2e-43b5-9d4c-c8856aa93cf4 admin admin] PATH_INFO: `/v3/projects/e69bb28eef944c00941b5f3e7c156b0e/users/d22dc841d7b24da18fbae006e02a31d8/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:37.515591 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f0c73-1c2e-43b5-9d4c-c8856aa93cf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e69bb28eef944c00941b5f3e7c156b0e, user_id=d22dc841d7b24da18fbae006e02a31d8, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:37.517868 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f0c73-1c2e-43b5-9d4c-c8856aa93cf4 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:37.529669 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1299/2612] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:59:37 2022] PUT /identity/v3/projects/e69bb28eef944c00941b5f3e7c156b0e/users/d22dc841d7b24da18fbae006e02a31d8/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:37.541789 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee310974-0281-4a1b-99be-6111c4f493cb None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:37.542196 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee310974-0281-4a1b-99be-6111c4f493cb None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:37.542375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee310974-0281-4a1b-99be-6111c4f493cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:37.575198 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-ee310974-0281-4a1b-99be-6111c4f493cb None None] MFA Rules not processed for user `d22dc841d7b24da18fbae006e02a31d8`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:37.576700 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-ee310974-0281-4a1b-99be-6111c4f493cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:37.657192 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1314/2613] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:37 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:37.669459 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f0c73-1c2e-43b5-9d4c-c8856aa93cf4 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:37.671308 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-7e9f0c73-1c2e-43b5-9d4c-c8856aa93cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:37.741678 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f0c73-1c2e-43b5-9d4c-c8856aa93cf4 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:37.745715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5417e-fe83-4583-9e51-35c0ebf47ceb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:37.746390 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5417e-fe83-4583-9e51-35c0ebf47ceb service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:37.747084 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5417e-fe83-4583-9e51-35c0ebf47ceb service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:37.747359 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5417e-fe83-4583-9e51-35c0ebf47ceb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:37.757655 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5417e-fe83-4583-9e51-35c0ebf47ceb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:37.759282 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5417e-fe83-4583-9e51-35c0ebf47ceb service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:37.770477 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1300/2614] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:37 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:59:37.870984 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee310974-0281-4a1b-99be-6111c4f493cb None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:37.884846 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee310974-0281-4a1b-99be-6111c4f493cb None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:37.890820 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2c609-89ba-44f7-b79f-f48061a45c31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:37.891470 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2c609-89ba-44f7-b79f-f48061a45c31 service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:37.891746 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2c609-89ba-44f7-b79f-f48061a45c31 service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:37.892014 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2c609-89ba-44f7-b79f-f48061a45c31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:38.044284 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2c609-89ba-44f7-b79f-f48061a45c31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:38.046450 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2c609-89ba-44f7-b79f-f48061a45c31 service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:38.066618 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1315/2615] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:37 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:59:38.935548 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5417e-fe83-4583-9e51-35c0ebf47ceb service cinder] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:38.937364 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-d2f5417e-fe83-4583-9e51-35c0ebf47ceb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:39.099493 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:39.147510 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5417e-fe83-4583-9e51-35c0ebf47ceb service cinder] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:39.152886 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca4910-b319-4d1f-86dd-2dc423b3b00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:39.153535 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca4910-b319-4d1f-86dd-2dc423b3b00f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:39.153810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca4910-b319-4d1f-86dd-2dc423b3b00f admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:39.154107 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca4910-b319-4d1f-86dd-2dc423b3b00f admin admin] PATH_INFO: `/v3/users/efa189e782b54c68bd48781470349fa6` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:39.155256 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca4910-b319-4d1f-86dd-2dc423b3b00f admin admin] RBAC: Authorizing `identity:delete_user(user_id=efa189e782b54c68bd48781470349fa6)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:39.157208 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca4910-b319-4d1f-86dd-2dc423b3b00f admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:39.208477 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-32ca4910-b319-4d1f-86dd-2dc423b3b00f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efa189e782b54c68bd48781470349fa6'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:39.216530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-32ca4910-b319-4d1f-86dd-2dc423b3b00f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efa189e782b54c68bd48781470349fa6'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:39.229812 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-32ca4910-b319-4d1f-86dd-2dc423b3b00f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efa189e782b54c68bd48781470349fa6'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:39.237197 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-32ca4910-b319-4d1f-86dd-2dc423b3b00f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efa189e782b54c68bd48781470349fa6'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:39.238102 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-32ca4910-b319-4d1f-86dd-2dc423b3b00f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efa189e782b54c68bd48781470349fa6'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:39.249212 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1301/2616] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:59:38 2022] DELETE /identity/v3/users/efa189e782b54c68bd48781470349fa6 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:39.253851 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec954b-7e90-4cac-a8b8-5be338ebd693 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:39.254383 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec954b-7e90-4cac-a8b8-5be338ebd693 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:39.254491 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec954b-7e90-4cac-a8b8-5be338ebd693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:39.268125 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:39.275264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-81ec954b-7e90-4cac-a8b8-5be338ebd693 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:39.276506 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-81ec954b-7e90-4cac-a8b8-5be338ebd693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:39.341136 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1316/2617] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:39.351563 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca4910-b319-4d1f-86dd-2dc423b3b00f admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:39.353207 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-32ca4910-b319-4d1f-86dd-2dc423b3b00f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:39.416672 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca4910-b319-4d1f-86dd-2dc423b3b00f admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:39.420483 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33d9af-7aa7-43a8-87b1-05c861cbe198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:39.421123 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33d9af-7aa7-43a8-87b1-05c861cbe198 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:39.421395 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33d9af-7aa7-43a8-87b1-05c861cbe198 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:39.421720 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33d9af-7aa7-43a8-87b1-05c861cbe198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:39.431439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33d9af-7aa7-43a8-87b1-05c861cbe198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:39.432892 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33d9af-7aa7-43a8-87b1-05c861cbe198 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:39.443217 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1302/2618] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:59:39.743383 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec954b-7e90-4cac-a8b8-5be338ebd693 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:39.744981 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-81ec954b-7e90-4cac-a8b8-5be338ebd693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:39.757881 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec954b-7e90-4cac-a8b8-5be338ebd693 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:39.763129 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b30f9-397e-46d7-80af-3ec73ef4a073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:39.763904 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b30f9-397e-46d7-80af-3ec73ef4a073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:39.764187 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b30f9-397e-46d7-80af-3ec73ef4a073 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:39.764455 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b30f9-397e-46d7-80af-3ec73ef4a073 admin admin] PATH_INFO: `/v3/projects/92567817ba7a4deb8801c34a21726232` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:39.765654 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b30f9-397e-46d7-80af-3ec73ef4a073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92567817ba7a4deb8801c34a21726232)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:39.767871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b30f9-397e-46d7-80af-3ec73ef4a073 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:39.817268 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-8d2b30f9-397e-46d7-80af-3ec73ef4a073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92567817ba7a4deb8801c34a21726232', 'request_id': 'req-8d2b30f9-397e-46d7-80af-3ec73ef4a073'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:39.826456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-8d2b30f9-397e-46d7-80af-3ec73ef4a073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92567817ba7a4deb8801c34a21726232', 'request_id': 'req-8d2b30f9-397e-46d7-80af-3ec73ef4a073'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:39.827379 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33d9af-7aa7-43a8-87b1-05c861cbe198 service neutron] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:39.828891 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-df33d9af-7aa7-43a8-87b1-05c861cbe198 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:39.833634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-8d2b30f9-397e-46d7-80af-3ec73ef4a073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92567817ba7a4deb8801c34a21726232', 'request_id': 'req-8d2b30f9-397e-46d7-80af-3ec73ef4a073'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:39.842411 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33d9af-7aa7-43a8-87b1-05c861cbe198 service neutron] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:39.846185 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-8d2b30f9-397e-46d7-80af-3ec73ef4a073 admin admin] The token cache is being invalidate because project 92567817ba7a4deb8801c34a21726232 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:59:39.846496 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-8d2b30f9-397e-46d7-80af-3ec73ef4a073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:39.847595 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-8d2b30f9-397e-46d7-80af-3ec73ef4a073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:39.848926 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1317/2619] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:59:39 2022] DELETE /identity/v3/projects/92567817ba7a4deb8801c34a21726232 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:39.853308 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b30f9-397e-46d7-80af-3ec73ef4a073 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:39.854843 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-8d2b30f9-397e-46d7-80af-3ec73ef4a073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:39.889809 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:39.904977 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f91b1-1ff3-46fe-a4b8-2f1633b5b9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:39.905854 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f91b1-1ff3-46fe-a4b8-2f1633b5b9b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:39.906774 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f91b1-1ff3-46fe-a4b8-2f1633b5b9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:39.907051 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f91b1-1ff3-46fe-a4b8-2f1633b5b9b3 admin admin] PATH_INFO: `/v3/users/2ef6e42874d940148303748c62b21e43` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:39.908301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f91b1-1ff3-46fe-a4b8-2f1633b5b9b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ef6e42874d940148303748c62b21e43)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:39.910299 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f91b1-1ff3-46fe-a4b8-2f1633b5b9b3 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:39.923702 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b30f9-397e-46d7-80af-3ec73ef4a073 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:39.929561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170efb55-f176-4c44-a7f0-d8df5f6e64c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:39.930562 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170efb55-f176-4c44-a7f0-d8df5f6e64c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:39.930867 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170efb55-f176-4c44-a7f0-d8df5f6e64c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:39.931198 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170efb55-f176-4c44-a7f0-d8df5f6e64c7 admin admin] PATH_INFO: `/v3/users/c62e0f34bbd946e4a79ef6a20e41aaf1` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:39.932627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170efb55-f176-4c44-a7f0-d8df5f6e64c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c62e0f34bbd946e4a79ef6a20e41aaf1)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:39.934648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170efb55-f176-4c44-a7f0-d8df5f6e64c7 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:39.963791 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-536f91b1-1ff3-46fe-a4b8-2f1633b5b9b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ef6e42874d940148303748c62b21e43'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:39.973906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-536f91b1-1ff3-46fe-a4b8-2f1633b5b9b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ef6e42874d940148303748c62b21e43'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:39.978674 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:39.993443 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-536f91b1-1ff3-46fe-a4b8-2f1633b5b9b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ef6e42874d940148303748c62b21e43'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:39.997365 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-170efb55-f176-4c44-a7f0-d8df5f6e64c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c62e0f34bbd946e4a79ef6a20e41aaf1'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:39.998209 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-170efb55-f176-4c44-a7f0-d8df5f6e64c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c62e0f34bbd946e4a79ef6a20e41aaf1'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:40.005468 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-536f91b1-1ff3-46fe-a4b8-2f1633b5b9b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ef6e42874d940148303748c62b21e43'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:40.005468 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-536f91b1-1ff3-46fe-a4b8-2f1633b5b9b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ef6e42874d940148303748c62b21e43'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:40.010557 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-170efb55-f176-4c44-a7f0-d8df5f6e64c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c62e0f34bbd946e4a79ef6a20e41aaf1'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:40.014474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1303/2620] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:59:39 2022] DELETE /identity/v3/users/2ef6e42874d940148303748c62b21e43 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:59:40.019427 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae577516-09b2-4d12-a255-ca74a764a6a8 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:40.019783 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae577516-09b2-4d12-a255-ca74a764a6a8 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:40.020388 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae577516-09b2-4d12-a255-ca74a764a6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:40.032252 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-170efb55-f176-4c44-a7f0-d8df5f6e64c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c62e0f34bbd946e4a79ef6a20e41aaf1'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:40.040948 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-ae577516-09b2-4d12-a255-ca74a764a6a8 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:40.042171 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-170efb55-f176-4c44-a7f0-d8df5f6e64c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c62e0f34bbd946e4a79ef6a20e41aaf1'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:40.042334 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-ae577516-09b2-4d12-a255-ca74a764a6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:40.050368 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1318/2621] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:59:39 2022] DELETE /identity/v3/users/c62e0f34bbd946e4a79ef6a20e41aaf1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:40.105913 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1304/2622] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:59:40.116355 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170efb55-f176-4c44-a7f0-d8df5f6e64c7 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:40.118063 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-170efb55-f176-4c44-a7f0-d8df5f6e64c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:40.189134 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170efb55-f176-4c44-a7f0-d8df5f6e64c7 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:40.193625 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755dad71-ad5e-40fe-8b5c-56fb96cbcc68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:40.194310 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755dad71-ad5e-40fe-8b5c-56fb96cbcc68 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:40.194592 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755dad71-ad5e-40fe-8b5c-56fb96cbcc68 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:40.194866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755dad71-ad5e-40fe-8b5c-56fb96cbcc68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:40.272593 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755dad71-ad5e-40fe-8b5c-56fb96cbcc68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:40.273143 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755dad71-ad5e-40fe-8b5c-56fb96cbcc68 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:40.283877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1319/2623] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:59:40.334838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae577516-09b2-4d12-a255-ca74a764a6a8 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:40.406468 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae577516-09b2-4d12-a255-ca74a764a6a8 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:40.412399 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed4980-03be-4c32-a6a5-95cbfcee5b7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:40.412938 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed4980-03be-4c32-a6a5-95cbfcee5b7e service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:40.413338 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed4980-03be-4c32-a6a5-95cbfcee5b7e service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:40.413581 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed4980-03be-4c32-a6a5-95cbfcee5b7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:40.415916 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-b1ed4980-03be-4c32-a6a5-95cbfcee5b7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:40.431800 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed4980-03be-4c32-a6a5-95cbfcee5b7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:40.434252 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed4980-03be-4c32-a6a5-95cbfcee5b7e service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:40.446749 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1305/2624] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:59:40.499807 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755dad71-ad5e-40fe-8b5c-56fb96cbcc68 service neutron] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:40.501399 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-755dad71-ad5e-40fe-8b5c-56fb96cbcc68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:40.520555 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755dad71-ad5e-40fe-8b5c-56fb96cbcc68 service neutron] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:40.533543 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae63a6f-640a-400b-85b2-d917638739c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:40.534297 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae63a6f-640a-400b-85b2-d917638739c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:40.534532 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae63a6f-640a-400b-85b2-d917638739c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:40.534807 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae63a6f-640a-400b-85b2-d917638739c2 admin admin] PATH_INFO: `/v3/projects/f26f48f5d1ad427ea260f9cd64c108a4` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:40.536037 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae63a6f-640a-400b-85b2-d917638739c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f26f48f5d1ad427ea260f9cd64c108a4)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:40.538058 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae63a6f-640a-400b-85b2-d917638739c2 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:40.596608 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-8ae63a6f-640a-400b-85b2-d917638739c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f26f48f5d1ad427ea260f9cd64c108a4', 'request_id': 'req-8ae63a6f-640a-400b-85b2-d917638739c2'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:40.600735 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:40.608545 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-8ae63a6f-640a-400b-85b2-d917638739c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f26f48f5d1ad427ea260f9cd64c108a4', 'request_id': 'req-8ae63a6f-640a-400b-85b2-d917638739c2'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:40.618888 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-8ae63a6f-640a-400b-85b2-d917638739c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f26f48f5d1ad427ea260f9cd64c108a4', 'request_id': 'req-8ae63a6f-640a-400b-85b2-d917638739c2'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:40.631310 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-8ae63a6f-640a-400b-85b2-d917638739c2 admin admin] The token cache is being invalidate because project f26f48f5d1ad427ea260f9cd64c108a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:59:40.631896 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-8ae63a6f-640a-400b-85b2-d917638739c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:40.632576 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-8ae63a6f-640a-400b-85b2-d917638739c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:40.634517 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1320/2625] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:59:40 2022] DELETE /identity/v3/projects/f26f48f5d1ad427ea260f9cd64c108a4 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:40.639477 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f3989-3e4b-48e9-99d8-bfe04e460298 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:40.640563 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f3989-3e4b-48e9-99d8-bfe04e460298 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:40.641144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f3989-3e4b-48e9-99d8-bfe04e460298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:40.672429 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-ab9f3989-3e4b-48e9-99d8-bfe04e460298 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:40.675984 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-ab9f3989-3e4b-48e9-99d8-bfe04e460298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:40.683554 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:40.692778 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae63a6f-640a-400b-85b2-d917638739c2 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:40.694888 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-8ae63a6f-640a-400b-85b2-d917638739c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:40.774798 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1306/2626] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:59:40.786377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769ecde-f4b3-486f-810b-f82b2ff85f7c None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:40.786732 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769ecde-f4b3-486f-810b-f82b2ff85f7c None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:40.787229 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769ecde-f4b3-486f-810b-f82b2ff85f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:40.809326 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-2769ecde-f4b3-486f-810b-f82b2ff85f7c None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:40.810701 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-2769ecde-f4b3-486f-810b-f82b2ff85f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:40.811454 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae63a6f-640a-400b-85b2-d917638739c2 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:40.824498 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1307/2627] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:59:40.824498 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769ecde-f4b3-486f-810b-f82b2ff85f7c None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:40.826928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd27c4f-0ea1-4a54-8b5f-cbd126083b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:40.828363 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd27c4f-0ea1-4a54-8b5f-cbd126083b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:40.832881 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd27c4f-0ea1-4a54-8b5f-cbd126083b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:40.833227 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd27c4f-0ea1-4a54-8b5f-cbd126083b60 admin admin] PATH_INFO: `/v3/projects/71cf19e0adf341d0980c3926e042174b` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:40.837045 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd27c4f-0ea1-4a54-8b5f-cbd126083b60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71cf19e0adf341d0980c3926e042174b)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:40.839103 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd27c4f-0ea1-4a54-8b5f-cbd126083b60 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:40.841012 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769ecde-f4b3-486f-810b-f82b2ff85f7c None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:40.852231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b2009-08a8-4d66-a072-4dd3fcf19b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:40.852968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b2009-08a8-4d66-a072-4dd3fcf19b2c admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:40.853391 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b2009-08a8-4d66-a072-4dd3fcf19b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:40.854197 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b2009-08a8-4d66-a072-4dd3fcf19b2c admin admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:40.855093 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b2009-08a8-4d66-a072-4dd3fcf19b2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:59:40.855364 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b2009-08a8-4d66-a072-4dd3fcf19b2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:40.857126 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b2009-08a8-4d66-a072-4dd3fcf19b2c admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:40.874741 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1308/2628] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 04:59:40.878991 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b2009-08a8-4d66-a072-4dd3fcf19b2c admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:40.892167 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b2009-08a8-4d66-a072-4dd3fcf19b2c admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:40.897800 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769729f5-8266-44de-b64f-330eae895a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:40.898733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769729f5-8266-44de-b64f-330eae895a86 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:40.899087 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769729f5-8266-44de-b64f-330eae895a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:40.899426 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769729f5-8266-44de-b64f-330eae895a86 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:40.900182 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769729f5-8266-44de-b64f-330eae895a86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:40.902227 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769729f5-8266-44de-b64f-330eae895a86 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:40.948202 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-9bd27c4f-0ea1-4a54-8b5f-cbd126083b60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71cf19e0adf341d0980c3926e042174b', 'request_id': 'req-9bd27c4f-0ea1-4a54-8b5f-cbd126083b60'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:40.958677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1309/2629] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:59:40 2022] POST /identity/v3/projects => generated 367 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:59:40.959314 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-9bd27c4f-0ea1-4a54-8b5f-cbd126083b60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71cf19e0adf341d0980c3926e042174b', 'request_id': 'req-9bd27c4f-0ea1-4a54-8b5f-cbd126083b60'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:40.960552 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769729f5-8266-44de-b64f-330eae895a86 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:40.974351 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-9bd27c4f-0ea1-4a54-8b5f-cbd126083b60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71cf19e0adf341d0980c3926e042174b', 'request_id': 'req-9bd27c4f-0ea1-4a54-8b5f-cbd126083b60'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:40.995351 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-9bd27c4f-0ea1-4a54-8b5f-cbd126083b60 admin admin] The token cache is being invalidate because project 71cf19e0adf341d0980c3926e042174b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:59:40.995658 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-9bd27c4f-0ea1-4a54-8b5f-cbd126083b60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:40.996366 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-9bd27c4f-0ea1-4a54-8b5f-cbd126083b60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:40.998767 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1321/2630] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:59:40 2022] DELETE /identity/v3/projects/71cf19e0adf341d0980c3926e042174b => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:59:41.004024 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f4344-df7d-4a82-9538-e5203f6edab7 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:41.004385 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f4344-df7d-4a82-9538-e5203f6edab7 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:41.004731 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f4344-df7d-4a82-9538-e5203f6edab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:41.037652 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-023f4344-df7d-4a82-9538-e5203f6edab7 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:41.039254 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-023f4344-df7d-4a82-9538-e5203f6edab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:41.043932 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769729f5-8266-44de-b64f-330eae895a86 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:41.047505 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1322/2631] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:41.052983 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036afc33-80c8-4cec-83d0-280a7165c872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:41.054364 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036afc33-80c8-4cec-83d0-280a7165c872 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:41.054881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036afc33-80c8-4cec-83d0-280a7165c872 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:41.055382 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036afc33-80c8-4cec-83d0-280a7165c872 admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:41.056015 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff578713-be27-4c81-9e40-21327b403eb3 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:41.056015 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff578713-be27-4c81-9e40-21327b403eb3 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:41.056239 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff578713-be27-4c81-9e40-21327b403eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:41.057341 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036afc33-80c8-4cec-83d0-280a7165c872 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:41.062673 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036afc33-80c8-4cec-83d0-280a7165c872 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:41.076577 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-ff578713-be27-4c81-9e40-21327b403eb3 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:41.078499 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-ff578713-be27-4c81-9e40-21327b403eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:41.087719 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1323/2632] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:59:41.092397 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff578713-be27-4c81-9e40-21327b403eb3 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:41.095373 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1310/2633] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:59:40 2022] POST /identity/v3/users => generated 284 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:41.099692 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036afc33-80c8-4cec-83d0-280a7165c872 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:41.102398 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff578713-be27-4c81-9e40-21327b403eb3 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:41.105423 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-036afc33-80c8-4cec-83d0-280a7165c872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:41.108732 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdaade-ce97-43cf-bd44-152447a8c833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:41.109688 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdaade-ce97-43cf-bd44-152447a8c833 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:41.110069 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdaade-ce97-43cf-bd44-152447a8c833 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:41.110443 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccdaade-ce97-43cf-bd44-152447a8c833 admin admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:41.111227 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdaade-ce97-43cf-bd44-152447a8c833 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:59:41.111648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdaade-ce97-43cf-bd44-152447a8c833 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:41.113375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccdaade-ce97-43cf-bd44-152447a8c833 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:41.123200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036afc33-80c8-4cec-83d0-280a7165c872 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:41.132382 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1324/2634] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:59:41.132495 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c20f6-ff91-4c8f-92d9-2b169fda0ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:41.132495 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c20f6-ff91-4c8f-92d9-2b169fda0ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:41.132495 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c20f6-ff91-4c8f-92d9-2b169fda0ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:41.132495 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c20f6-ff91-4c8f-92d9-2b169fda0ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:41.133616 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c20f6-ff91-4c8f-92d9-2b169fda0ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:41.135155 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdaade-ce97-43cf-bd44-152447a8c833 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:41.135801 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c20f6-ff91-4c8f-92d9-2b169fda0ee4 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:41.148634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccdaade-ce97-43cf-bd44-152447a8c833 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:41.149382 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1311/2635] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:41.154264 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f625f-4774-4d98-9f89-0ca9aa6d86d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:41.154913 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f625f-4774-4d98-9f89-0ca9aa6d86d5 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:41.155259 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f625f-4774-4d98-9f89-0ca9aa6d86d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:41.155532 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f625f-4774-4d98-9f89-0ca9aa6d86d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:41.156107 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c20f6-ff91-4c8f-92d9-2b169fda0ee4 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:41.156231 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f625f-4774-4d98-9f89-0ca9aa6d86d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:41.158669 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921f625f-4774-4d98-9f89-0ca9aa6d86d5 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:41.172088 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c20f6-ff91-4c8f-92d9-2b169fda0ee4 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:41.182715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da34144-fa5f-4d7b-8859-ca13decc20d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:41.183745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da34144-fa5f-4d7b-8859-ca13decc20d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:41.184273 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da34144-fa5f-4d7b-8859-ca13decc20d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:41.184743 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da34144-fa5f-4d7b-8859-ca13decc20d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:41.185809 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da34144-fa5f-4d7b-8859-ca13decc20d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:41.188127 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da34144-fa5f-4d7b-8859-ca13decc20d4 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:41.200906 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1325/2637] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:59:41 2022] POST /identity/v3/projects => generated 369 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:41.201258 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1312/2637] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:41.205918 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f625f-4774-4d98-9f89-0ca9aa6d86d5 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:41.208734 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da34144-fa5f-4d7b-8859-ca13decc20d4 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:41.222335 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da34144-fa5f-4d7b-8859-ca13decc20d4 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:41.239487 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:41.266806 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:41.298559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f625f-4774-4d98-9f89-0ca9aa6d86d5 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:41.305810 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc9ea0-7ae3-49a6-aac4-2e9da5f427f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:41.306681 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc9ea0-7ae3-49a6-aac4-2e9da5f427f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:41.307133 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc9ea0-7ae3-49a6-aac4-2e9da5f427f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:41.307484 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc9ea0-7ae3-49a6-aac4-2e9da5f427f3 admin admin] PATH_INFO: `/v3/projects/b8d033e227204499828cd3417e2f9d41/users/50057de7fd1d49aaab70cb2902cac291/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:41.307775 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874ad20-8771-4a34-b214-4557b150e788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:41.308563 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874ad20-8771-4a34-b214-4557b150e788 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:41.308915 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874ad20-8771-4a34-b214-4557b150e788 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:41.309255 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874ad20-8771-4a34-b214-4557b150e788 admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:41.310169 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874ad20-8771-4a34-b214-4557b150e788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:41.312680 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874ad20-8771-4a34-b214-4557b150e788 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:41.332173 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc9ea0-7ae3-49a6-aac4-2e9da5f427f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8d033e227204499828cd3417e2f9d41, user_id=50057de7fd1d49aaab70cb2902cac291, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:41.337053 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc9ea0-7ae3-49a6-aac4-2e9da5f427f3 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:41.342021 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1313/2638] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:59:41 2022] POST /identity/v3/users => generated 285 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:59:41.348050 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874ad20-8771-4a34-b214-4557b150e788 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:41.356678 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1326/2639] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:59:41 2022] PUT /identity/v3/projects/b8d033e227204499828cd3417e2f9d41/users/50057de7fd1d49aaab70cb2902cac291/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:41.366344 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874ad20-8771-4a34-b214-4557b150e788 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:41.368832 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ca015-538e-428a-8bfc-13807393bf6e None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:41.369411 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ca015-538e-428a-8bfc-13807393bf6e None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:41.370030 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73ca015-538e-428a-8bfc-13807393bf6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:41.405789 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-e73ca015-538e-428a-8bfc-13807393bf6e None None] MFA Rules not processed for user `50057de7fd1d49aaab70cb2902cac291`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:41.407649 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-e73ca015-538e-428a-8bfc-13807393bf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:41.456408 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1b622-eabd-41af-9108-959bd27f53a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:41.457742 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1b622-eabd-41af-9108-959bd27f53a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:41.458402 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1b622-eabd-41af-9108-959bd27f53a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:41.458402 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1b622-eabd-41af-9108-959bd27f53a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:41.459332 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1b622-eabd-41af-9108-959bd27f53a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:41.461002 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1b622-eabd-41af-9108-959bd27f53a9 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:41.478033 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1314/2640] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:59:41.480209 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1b622-eabd-41af-9108-959bd27f53a9 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:41.514467 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1b622-eabd-41af-9108-959bd27f53a9 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:41.514728 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1327/2641] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:41.519888 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ca015-538e-428a-8bfc-13807393bf6e None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:41.525576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f1f06-9a74-448d-8442-0ecea0e41493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:41.526439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f1f06-9a74-448d-8442-0ecea0e41493 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:41.526744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f1f06-9a74-448d-8442-0ecea0e41493 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:41.527054 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f1f06-9a74-448d-8442-0ecea0e41493 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:41.527800 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f1f06-9a74-448d-8442-0ecea0e41493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:41.529614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f1f06-9a74-448d-8442-0ecea0e41493 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:41.534352 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73ca015-538e-428a-8bfc-13807393bf6e None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:41.539519 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcad314-0fd9-4ab2-a221-aec7b4c651c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:41.540153 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcad314-0fd9-4ab2-a221-aec7b4c651c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:41.540432 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcad314-0fd9-4ab2-a221-aec7b4c651c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:41.540706 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcad314-0fd9-4ab2-a221-aec7b4c651c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:41.541375 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcad314-0fd9-4ab2-a221-aec7b4c651c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:41.543350 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcad314-0fd9-4ab2-a221-aec7b4c651c9 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:41.546703 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1315/2642] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:41.547621 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f1f06-9a74-448d-8442-0ecea0e41493 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:41.558797 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f1f06-9a74-448d-8442-0ecea0e41493 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:41.563668 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f3708-fc70-4a35-9f59-42dde77e708b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:41.564357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f3708-fc70-4a35-9f59-42dde77e708b admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:41.564639 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f3708-fc70-4a35-9f59-42dde77e708b admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:41.564985 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f3708-fc70-4a35-9f59-42dde77e708b admin admin] PATH_INFO: `/v3/projects/17012cd699d5460097c088c93352ab65/users/acb1d598f8ab48eeb9a5a274bb6533ed/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:41.588132 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1328/2643] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:59:41 2022] POST /identity/v3/projects => generated 367 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:41.590894 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f3708-fc70-4a35-9f59-42dde77e708b admin admin] RBAC: Authorizing `identity:create_grant(project_id=17012cd699d5460097c088c93352ab65, user_id=acb1d598f8ab48eeb9a5a274bb6533ed, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:41.592012 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcad314-0fd9-4ab2-a221-aec7b4c651c9 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:41.594234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f3708-fc70-4a35-9f59-42dde77e708b admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:41.614410 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1316/2644] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:59:41 2022] PUT /identity/v3/projects/17012cd699d5460097c088c93352ab65/users/acb1d598f8ab48eeb9a5a274bb6533ed/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:41.694407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec0651-aeb9-48aa-81ac-e14976968ba3 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:41.694957 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec0651-aeb9-48aa-81ac-e14976968ba3 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:41.695700 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec0651-aeb9-48aa-81ac-e14976968ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:41.740048 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcad314-0fd9-4ab2-a221-aec7b4c651c9 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:41.760817 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-17ec0651-aeb9-48aa-81ac-e14976968ba3 None None] MFA Rules not processed for user `acb1d598f8ab48eeb9a5a274bb6533ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:41.762289 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-17ec0651-aeb9-48aa-81ac-e14976968ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:41.783272 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:41.851328 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6afca-c0e7-42ef-b2f6-43580db134d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:41.851993 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6afca-c0e7-42ef-b2f6-43580db134d4 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:41.852203 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6afca-c0e7-42ef-b2f6-43580db134d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:41.852482 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6afca-c0e7-42ef-b2f6-43580db134d4 admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:41.853194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6afca-c0e7-42ef-b2f6-43580db134d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:41.855254 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6afca-c0e7-42ef-b2f6-43580db134d4 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:41.898364 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1329/2645] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:59:41 2022] POST /identity/v3/users => generated 290 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:59:41.901076 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6afca-c0e7-42ef-b2f6-43580db134d4 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:41.915738 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6afca-c0e7-42ef-b2f6-43580db134d4 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:41.922076 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c754a7-2b7b-4067-9312-b2cc5f1d040c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:41.922881 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c754a7-2b7b-4067-9312-b2cc5f1d040c admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:41.923444 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c754a7-2b7b-4067-9312-b2cc5f1d040c admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:41.923882 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c754a7-2b7b-4067-9312-b2cc5f1d040c admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:41.925019 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c754a7-2b7b-4067-9312-b2cc5f1d040c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:41.927305 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c754a7-2b7b-4067-9312-b2cc5f1d040c admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:41.933490 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1317/2646] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:41.946933 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec0651-aeb9-48aa-81ac-e14976968ba3 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:41.948371 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-17ec0651-aeb9-48aa-81ac-e14976968ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:41.952357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1330/2647] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:41 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:41.953597 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c754a7-2b7b-4067-9312-b2cc5f1d040c admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:41.965392 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c754a7-2b7b-4067-9312-b2cc5f1d040c admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:41.969833 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:41.970319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9d96d-b77d-49ae-b20f-f80a728abd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:41.971185 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9d96d-b77d-49ae-b20f-f80a728abd5d admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:41.971404 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9d96d-b77d-49ae-b20f-f80a728abd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:41.971670 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9d96d-b77d-49ae-b20f-f80a728abd5d admin admin] PATH_INFO: `/v3/projects/8acff6dcbcd6424ebd6e346c89c359d7/users/9a4f2a7e00b34f37a76a9cdb069f58b5/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:41.989615 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9d96d-b77d-49ae-b20f-f80a728abd5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8acff6dcbcd6424ebd6e346c89c359d7, user_id=9a4f2a7e00b34f37a76a9cdb069f58b5, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:41.992690 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9d96d-b77d-49ae-b20f-f80a728abd5d admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:42.017381 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec0651-aeb9-48aa-81ac-e14976968ba3 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:42.025291 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1331/2648] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:59:41 2022] PUT /identity/v3/projects/8acff6dcbcd6424ebd6e346c89c359d7/users/9a4f2a7e00b34f37a76a9cdb069f58b5/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:59:42.033180 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9d96d-b77d-49ae-b20f-f80a728abd5d admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:42.138056 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d428230-5320-4204-8349-7451b8f6b448 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfbf2c03eb740ed8b72c4825cffc341', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:42.139365 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d428230-5320-4204-8349-7451b8f6b448 service glance] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:42.139649 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d428230-5320-4204-8349-7451b8f6b448 service glance] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:42.139951 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d428230-5320-4204-8349-7451b8f6b448 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:42.143383 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9d96d-b77d-49ae-b20f-f80a728abd5d admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:42.148874 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76baeb2-d342-46af-a9fb-7e0b157a6e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:42.149532 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76baeb2-d342-46af-a9fb-7e0b157a6e5c admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:42.149805 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76baeb2-d342-46af-a9fb-7e0b157a6e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:42.150114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76baeb2-d342-46af-a9fb-7e0b157a6e5c admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:42.151006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76baeb2-d342-46af-a9fb-7e0b157a6e5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:42.152689 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76baeb2-d342-46af-a9fb-7e0b157a6e5c admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:42.170437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1332/2649] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:59:42.171658 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76baeb2-d342-46af-a9fb-7e0b157a6e5c admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:42.184108 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76baeb2-d342-46af-a9fb-7e0b157a6e5c admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:42.198616 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf11cdf-427b-4170-93df-ee879d8a6148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:42.201706 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf11cdf-427b-4170-93df-ee879d8a6148 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:42.202232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf11cdf-427b-4170-93df-ee879d8a6148 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:42.202785 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf11cdf-427b-4170-93df-ee879d8a6148 admin admin] PATH_INFO: `/v3/projects/8acff6dcbcd6424ebd6e346c89c359d7/users/9a4f2a7e00b34f37a76a9cdb069f58b5/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:42.211152 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf11cdf-427b-4170-93df-ee879d8a6148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8acff6dcbcd6424ebd6e346c89c359d7, user_id=9a4f2a7e00b34f37a76a9cdb069f58b5, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:42.214969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf11cdf-427b-4170-93df-ee879d8a6148 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:42.239382 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d428230-5320-4204-8349-7451b8f6b448 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:42.242148 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d428230-5320-4204-8349-7451b8f6b448 service glance] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:42.255489 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1333/2650] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:59:42 2022] PUT /identity/v3/projects/8acff6dcbcd6424ebd6e346c89c359d7/users/9a4f2a7e00b34f37a76a9cdb069f58b5/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:42.259058 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1318/2651] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:41 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:59:42.268097 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adfcec-0431-48be-bbda-ebf2e8a5eba5 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:42.268481 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adfcec-0431-48be-bbda-ebf2e8a5eba5 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:42.268827 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adfcec-0431-48be-bbda-ebf2e8a5eba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:42.309251 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-51adfcec-0431-48be-bbda-ebf2e8a5eba5 None None] MFA Rules not processed for user `9a4f2a7e00b34f37a76a9cdb069f58b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:42.311364 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-51adfcec-0431-48be-bbda-ebf2e8a5eba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:42.427242 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1319/2652] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:42 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:59:42.442499 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf11cdf-427b-4170-93df-ee879d8a6148 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:42.444646 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-dcf11cdf-427b-4170-93df-ee879d8a6148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:42.525593 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf11cdf-427b-4170-93df-ee879d8a6148 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:42.530062 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cba94d-a757-4329-b20a-687d201def09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:42.530664 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cba94d-a757-4329-b20a-687d201def09 service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:42.531065 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cba94d-a757-4329-b20a-687d201def09 service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:42.531241 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cba94d-a757-4329-b20a-687d201def09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:42.543516 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cba94d-a757-4329-b20a-687d201def09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:42.545521 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cba94d-a757-4329-b20a-687d201def09 service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:42.560711 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1334/2653] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:42 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:59:42.618693 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51adfcec-0431-48be-bbda-ebf2e8a5eba5 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:42.631237 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51adfcec-0431-48be-bbda-ebf2e8a5eba5 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:42.635393 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebf403-b7ed-43e5-9010-86f1f5899d28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:42.636042 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebf403-b7ed-43e5-9010-86f1f5899d28 service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:42.636416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebf403-b7ed-43e5-9010-86f1f5899d28 service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:42.636627 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebf403-b7ed-43e5-9010-86f1f5899d28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:42.648182 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:42.717706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ebf403-b7ed-43e5-9010-86f1f5899d28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:42.720320 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ebf403-b7ed-43e5-9010-86f1f5899d28 service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:42.735602 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1320/2654] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:42 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:59:44.943354 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cba94d-a757-4329-b20a-687d201def09 service cinder] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:44.944904 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-30cba94d-a757-4329-b20a-687d201def09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:44.952454 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:45.035736 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cba94d-a757-4329-b20a-687d201def09 service cinder] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:45.041904 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2200fca-e192-400c-8410-5532a877eea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:45.042931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2200fca-e192-400c-8410-5532a877eea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:45.043351 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2200fca-e192-400c-8410-5532a877eea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:45.043642 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2200fca-e192-400c-8410-5532a877eea9 admin admin] PATH_INFO: `/v3/users/5f2542f3a788478cb5788cc0ccb361fe` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:45.044952 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2200fca-e192-400c-8410-5532a877eea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f2542f3a788478cb5788cc0ccb361fe)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:45.047009 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2200fca-e192-400c-8410-5532a877eea9 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:45.115674 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-d2200fca-e192-400c-8410-5532a877eea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f2542f3a788478cb5788cc0ccb361fe'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:45.116372 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-d2200fca-e192-400c-8410-5532a877eea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f2542f3a788478cb5788cc0ccb361fe'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:45.128639 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-d2200fca-e192-400c-8410-5532a877eea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f2542f3a788478cb5788cc0ccb361fe'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:45.152811 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-d2200fca-e192-400c-8410-5532a877eea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f2542f3a788478cb5788cc0ccb361fe'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:45.167271 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-d2200fca-e192-400c-8410-5532a877eea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f2542f3a788478cb5788cc0ccb361fe'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:45.177686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1335/2655] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:59:44 2022] DELETE /identity/v3/users/5f2542f3a788478cb5788cc0ccb361fe => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:45.183589 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71529997-ddae-4426-9570-990cb22fe369 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:45.184147 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71529997-ddae-4426-9570-990cb22fe369 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:45.184247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71529997-ddae-4426-9570-990cb22fe369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:45.204321 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-71529997-ddae-4426-9570-990cb22fe369 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:45.205802 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-71529997-ddae-4426-9570-990cb22fe369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:45.281588 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1321/2656] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:45.290338 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2200fca-e192-400c-8410-5532a877eea9 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:45.291808 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-d2200fca-e192-400c-8410-5532a877eea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:45.355567 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2200fca-e192-400c-8410-5532a877eea9 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:45.360221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debb5e4-4e1f-441d-b727-b4b7d7cdee25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:45.360866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debb5e4-4e1f-441d-b727-b4b7d7cdee25 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:45.361168 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debb5e4-4e1f-441d-b727-b4b7d7cdee25 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:45.361447 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debb5e4-4e1f-441d-b727-b4b7d7cdee25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:45.371366 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debb5e4-4e1f-441d-b727-b4b7d7cdee25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:45.373871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5debb5e4-4e1f-441d-b727-b4b7d7cdee25 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:45.390319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1336/2657] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:59:45.742241 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71529997-ddae-4426-9570-990cb22fe369 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:45.744578 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-71529997-ddae-4426-9570-990cb22fe369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:45.782335 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71529997-ddae-4426-9570-990cb22fe369 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:45.791375 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c07719-44c7-4820-a5ca-aa06f8801c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:45.792889 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c07719-44c7-4820-a5ca-aa06f8801c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:45.793136 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c07719-44c7-4820-a5ca-aa06f8801c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:45.793591 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c07719-44c7-4820-a5ca-aa06f8801c24 admin admin] PATH_INFO: `/v3/projects/7507f7e166af44bb950e86aa6d9411ae` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:45.796242 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c07719-44c7-4820-a5ca-aa06f8801c24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7507f7e166af44bb950e86aa6d9411ae)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:45.799908 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c07719-44c7-4820-a5ca-aa06f8801c24 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:45.908231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-a1c07719-44c7-4820-a5ca-aa06f8801c24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7507f7e166af44bb950e86aa6d9411ae', 'request_id': 'req-a1c07719-44c7-4820-a5ca-aa06f8801c24'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:45.925713 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-a1c07719-44c7-4820-a5ca-aa06f8801c24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7507f7e166af44bb950e86aa6d9411ae', 'request_id': 'req-a1c07719-44c7-4820-a5ca-aa06f8801c24'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:45.942516 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-a1c07719-44c7-4820-a5ca-aa06f8801c24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7507f7e166af44bb950e86aa6d9411ae', 'request_id': 'req-a1c07719-44c7-4820-a5ca-aa06f8801c24'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:45.985778 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-a1c07719-44c7-4820-a5ca-aa06f8801c24 admin admin] The token cache is being invalidate because project 7507f7e166af44bb950e86aa6d9411ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:59:45.987951 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-a1c07719-44c7-4820-a5ca-aa06f8801c24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:45.991332 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-a1c07719-44c7-4820-a5ca-aa06f8801c24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:45.996695 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1322/2658] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:59:45 2022] DELETE /identity/v3/projects/7507f7e166af44bb950e86aa6d9411ae => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:46.002738 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debb5e4-4e1f-441d-b727-b4b7d7cdee25 service neutron] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:46.035428 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5debb5e4-4e1f-441d-b727-b4b7d7cdee25 service neutron] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:46.097258 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:46.174998 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633c787-5467-49c1-86b3-29b8ac0a4367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:46.176090 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633c787-5467-49c1-86b3-29b8ac0a4367 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:46.176487 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633c787-5467-49c1-86b3-29b8ac0a4367 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:46.176941 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633c787-5467-49c1-86b3-29b8ac0a4367 admin admin] PATH_INFO: `/v3/users/d22dc841d7b24da18fbae006e02a31d8` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:46.180088 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633c787-5467-49c1-86b3-29b8ac0a4367 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d22dc841d7b24da18fbae006e02a31d8)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:46.182947 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633c787-5467-49c1-86b3-29b8ac0a4367 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:46.278008 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-9633c787-5467-49c1-86b3-29b8ac0a4367 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd22dc841d7b24da18fbae006e02a31d8'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:46.287855 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-9633c787-5467-49c1-86b3-29b8ac0a4367 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd22dc841d7b24da18fbae006e02a31d8'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:46.301930 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-9633c787-5467-49c1-86b3-29b8ac0a4367 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd22dc841d7b24da18fbae006e02a31d8'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:46.341075 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-9633c787-5467-49c1-86b3-29b8ac0a4367 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd22dc841d7b24da18fbae006e02a31d8'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:46.360046 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-9633c787-5467-49c1-86b3-29b8ac0a4367 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd22dc841d7b24da18fbae006e02a31d8'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:46.375000 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1337/2659] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:59:46 2022] DELETE /identity/v3/users/d22dc841d7b24da18fbae006e02a31d8 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:46.836866 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c07719-44c7-4820-a5ca-aa06f8801c24 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:46.840902 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-a1c07719-44c7-4820-a5ca-aa06f8801c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:46.860799 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c07719-44c7-4820-a5ca-aa06f8801c24 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:46.914167 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:46.956986 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850ccd0-fbe0-425d-933d-0fe846bc1997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:46.958290 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850ccd0-fbe0-425d-933d-0fe846bc1997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:46.958586 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850ccd0-fbe0-425d-933d-0fe846bc1997 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:46.959002 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850ccd0-fbe0-425d-933d-0fe846bc1997 admin admin] PATH_INFO: `/v3/projects/e69bb28eef944c00941b5f3e7c156b0e` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:46.961718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f850ccd0-fbe0-425d-933d-0fe846bc1997 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e69bb28eef944c00941b5f3e7c156b0e)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:46.972593 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f850ccd0-fbe0-425d-933d-0fe846bc1997 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:47.027558 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633c787-5467-49c1-86b3-29b8ac0a4367 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:47.030396 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-9633c787-5467-49c1-86b3-29b8ac0a4367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:47.046721 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633c787-5467-49c1-86b3-29b8ac0a4367 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:47.055236 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b345e-c5b0-4821-9a48-bfc03526f765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:47.057179 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b345e-c5b0-4821-9a48-bfc03526f765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:47.058402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b345e-c5b0-4821-9a48-bfc03526f765 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:47.059573 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b345e-c5b0-4821-9a48-bfc03526f765 admin admin] PATH_INFO: `/v3/users/50057de7fd1d49aaab70cb2902cac291` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:47.063153 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b345e-c5b0-4821-9a48-bfc03526f765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50057de7fd1d49aaab70cb2902cac291)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:47.069501 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b345e-c5b0-4821-9a48-bfc03526f765 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:47.096100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f850ccd0-fbe0-425d-933d-0fe846bc1997 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e69bb28eef944c00941b5f3e7c156b0e', 'request_id': 'req-f850ccd0-fbe0-425d-933d-0fe846bc1997'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:47.108833 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f850ccd0-fbe0-425d-933d-0fe846bc1997 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e69bb28eef944c00941b5f3e7c156b0e', 'request_id': 'req-f850ccd0-fbe0-425d-933d-0fe846bc1997'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:47.123430 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f850ccd0-fbe0-425d-933d-0fe846bc1997 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e69bb28eef944c00941b5f3e7c156b0e', 'request_id': 'req-f850ccd0-fbe0-425d-933d-0fe846bc1997'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:47.153128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f850ccd0-fbe0-425d-933d-0fe846bc1997 admin admin] The token cache is being invalidate because project e69bb28eef944c00941b5f3e7c156b0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:59:47.153441 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f850ccd0-fbe0-425d-933d-0fe846bc1997 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:47.154945 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f850ccd0-fbe0-425d-933d-0fe846bc1997 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:47.160592 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1323/2660] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:59:46 2022] DELETE /identity/v3/projects/e69bb28eef944c00941b5f3e7c156b0e => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:47.169448 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e423b7d-85d7-41b9-a451-a9d3e177d5b3 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:47.170161 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e423b7d-85d7-41b9-a451-a9d3e177d5b3 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:47.171101 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e423b7d-85d7-41b9-a451-a9d3e177d5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:47.220772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-4d9b345e-c5b0-4821-9a48-bfc03526f765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50057de7fd1d49aaab70cb2902cac291'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:47.222392 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-4d9b345e-c5b0-4821-9a48-bfc03526f765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50057de7fd1d49aaab70cb2902cac291'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:47.228494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-5e423b7d-85d7-41b9-a451-a9d3e177d5b3 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:47.231075 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-5e423b7d-85d7-41b9-a451-a9d3e177d5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:47.238900 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-4d9b345e-c5b0-4821-9a48-bfc03526f765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50057de7fd1d49aaab70cb2902cac291'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:47.260895 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-4d9b345e-c5b0-4821-9a48-bfc03526f765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50057de7fd1d49aaab70cb2902cac291'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:47.271007 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-4d9b345e-c5b0-4821-9a48-bfc03526f765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50057de7fd1d49aaab70cb2902cac291'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:47.284372 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1338/2661] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:59:47 2022] DELETE /identity/v3/users/50057de7fd1d49aaab70cb2902cac291 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:47.286280 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd8c2e-c504-479d-8425-e7e206996a3f None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:47.286686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd8c2e-c504-479d-8425-e7e206996a3f None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:47.287913 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd8c2e-c504-479d-8425-e7e206996a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:47.314593 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-dccd8c2e-c504-479d-8425-e7e206996a3f None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:47.316068 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-dccd8c2e-c504-479d-8425-e7e206996a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:47.337409 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:47.410374 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1324/2662] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:47.422530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b192ee-b02b-4ae0-9f72-798752075e59 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:47.423341 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b192ee-b02b-4ae0-9f72-798752075e59 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:47.424535 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b192ee-b02b-4ae0-9f72-798752075e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:47.464632 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1339/2663] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:59:47.482896 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd8c2e-c504-479d-8425-e7e206996a3f None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:47.485120 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-f7b192ee-b02b-4ae0-9f72-798752075e59 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:47.485368 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-dccd8c2e-c504-479d-8425-e7e206996a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:47.487520 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-f7b192ee-b02b-4ae0-9f72-798752075e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:47.505495 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1325/2664] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:59:47.512028 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b192ee-b02b-4ae0-9f72-798752075e59 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:47.540102 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b192ee-b02b-4ae0-9f72-798752075e59 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:47.552395 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306e97d-c95f-466e-b496-f25bbfa4721c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:47.554047 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306e97d-c95f-466e-b496-f25bbfa4721c admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:47.554732 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306e97d-c95f-466e-b496-f25bbfa4721c admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:47.555568 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306e97d-c95f-466e-b496-f25bbfa4721c admin admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:47.557869 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306e97d-c95f-466e-b496-f25bbfa4721c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:59:47.558731 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306e97d-c95f-466e-b496-f25bbfa4721c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:47.564407 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306e97d-c95f-466e-b496-f25bbfa4721c admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:47.581095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd8c2e-c504-479d-8425-e7e206996a3f None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:47.598662 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1326/2665] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:59:47.598862 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4ec1d-b26e-4c8a-a8a5-95193bc4a72f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:47.599326 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4ec1d-b26e-4c8a-a8a5-95193bc4a72f service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:47.599605 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4ec1d-b26e-4c8a-a8a5-95193bc4a72f service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:47.599877 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4ec1d-b26e-4c8a-a8a5-95193bc4a72f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:47.601840 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306e97d-c95f-466e-b496-f25bbfa4721c admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:47.618080 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306e97d-c95f-466e-b496-f25bbfa4721c admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:47.618632 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a4ec1d-b26e-4c8a-a8a5-95193bc4a72f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:47.621433 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a4ec1d-b26e-4c8a-a8a5-95193bc4a72f service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:47.625437 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b448631-a151-45e0-b1a8-5390ebc3b640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:47.626547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b448631-a151-45e0-b1a8-5390ebc3b640 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:47.627047 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b448631-a151-45e0-b1a8-5390ebc3b640 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:47.627659 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b448631-a151-45e0-b1a8-5390ebc3b640 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:47.628577 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b448631-a151-45e0-b1a8-5390ebc3b640 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:47.631107 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b448631-a151-45e0-b1a8-5390ebc3b640 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:47.646705 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1340/2666] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:59:47.708404 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1327/2667] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:59:47 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:47.713267 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4ec1d-b26e-4c8a-a8a5-95193bc4a72f service neutron] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:47.729111 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4ec1d-b26e-4c8a-a8a5-95193bc4a72f service neutron] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:47.877346 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2055e94-8880-4f78-82ff-840441f638a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:47.879045 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2055e94-8880-4f78-82ff-840441f638a6 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:47.879925 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2055e94-8880-4f78-82ff-840441f638a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:47.880616 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2055e94-8880-4f78-82ff-840441f638a6 admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:47.882582 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2055e94-8880-4f78-82ff-840441f638a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:47.887023 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2055e94-8880-4f78-82ff-840441f638a6 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:47.926306 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1341/2668] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:59:47 2022] POST /identity/v3/users => generated 282 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:47.932514 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b448631-a151-45e0-b1a8-5390ebc3b640 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:47.962058 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b448631-a151-45e0-b1a8-5390ebc3b640 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:47.974540 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53b3d7-1ca9-4abb-a0a1-176a6767d404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:47.975619 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53b3d7-1ca9-4abb-a0a1-176a6767d404 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:47.976156 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53b3d7-1ca9-4abb-a0a1-176a6767d404 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:47.976688 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53b3d7-1ca9-4abb-a0a1-176a6767d404 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:47.977842 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53b3d7-1ca9-4abb-a0a1-176a6767d404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:47.992964 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53b3d7-1ca9-4abb-a0a1-176a6767d404 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:48.014817 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1328/2669] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:47 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:59:48.021750 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2055e94-8880-4f78-82ff-840441f638a6 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:48.040335 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2055e94-8880-4f78-82ff-840441f638a6 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:48.052634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a4c34-eeea-4181-a84a-cb19bdd4989f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:48.054170 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a4c34-eeea-4181-a84a-cb19bdd4989f admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:48.054866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a4c34-eeea-4181-a84a-cb19bdd4989f admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:48.055237 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a4c34-eeea-4181-a84a-cb19bdd4989f admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:48.056219 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a4c34-eeea-4181-a84a-cb19bdd4989f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:48.058064 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a4c34-eeea-4181-a84a-cb19bdd4989f admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:48.072674 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1342/2670] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:48.077779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53b3d7-1ca9-4abb-a0a1-176a6767d404 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:48.098540 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53b3d7-1ca9-4abb-a0a1-176a6767d404 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:48.115715 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb776f-fcc5-44c4-b65f-728352e6e6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:48.116331 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb776f-fcc5-44c4-b65f-728352e6e6aa admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:48.116611 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb776f-fcc5-44c4-b65f-728352e6e6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:48.116904 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb776f-fcc5-44c4-b65f-728352e6e6aa admin admin] PATH_INFO: `/v3/projects/3512d19beed8451b8add85cc5602a5de/users/4e90268255e34acca205507408e4dff9/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:48.128689 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:48.144533 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb776f-fcc5-44c4-b65f-728352e6e6aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3512d19beed8451b8add85cc5602a5de, user_id=4e90268255e34acca205507408e4dff9, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:48.148905 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb776f-fcc5-44c4-b65f-728352e6e6aa admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:48.172899 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1329/2671] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:59:48 2022] PUT /identity/v3/projects/3512d19beed8451b8add85cc5602a5de/users/4e90268255e34acca205507408e4dff9/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:48.188555 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1ab04-6e27-4d9d-a748-89130165a11c None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:48.190094 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1ab04-6e27-4d9d-a748-89130165a11c None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:48.192028 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1ab04-6e27-4d9d-a748-89130165a11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:48.245731 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-03f1ab04-6e27-4d9d-a748-89130165a11c None None] MFA Rules not processed for user `4e90268255e34acca205507408e4dff9`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:48.248589 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-03f1ab04-6e27-4d9d-a748-89130165a11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:48.250362 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb776f-fcc5-44c4-b65f-728352e6e6aa admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:48.252707 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-02cb776f-fcc5-44c4-b65f-728352e6e6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:48.356048 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:48.441071 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb776f-fcc5-44c4-b65f-728352e6e6aa admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:48.450365 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496eaa2-202e-4efc-af7e-2464fb536a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:48.451268 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496eaa2-202e-4efc-af7e-2464fb536a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:48.451759 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496eaa2-202e-4efc-af7e-2464fb536a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:48.452112 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496eaa2-202e-4efc-af7e-2464fb536a40 admin admin] PATH_INFO: `/v3/projects/b8d033e227204499828cd3417e2f9d41` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:48.458159 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496eaa2-202e-4efc-af7e-2464fb536a40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8d033e227204499828cd3417e2f9d41)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:48.460798 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496eaa2-202e-4efc-af7e-2464fb536a40 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:48.472826 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1343/2672] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:48 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:59:48.475103 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1ab04-6e27-4d9d-a748-89130165a11c None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:48.501866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1ab04-6e27-4d9d-a748-89130165a11c None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:48.520745 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb757ec-0d36-4573-9093-5d24c32e8529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:48.521552 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb757ec-0d36-4573-9093-5d24c32e8529 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:48.522015 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb757ec-0d36-4573-9093-5d24c32e8529 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:48.522151 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb757ec-0d36-4573-9093-5d24c32e8529 admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:48.524057 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb757ec-0d36-4573-9093-5d24c32e8529 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:48.527456 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb757ec-0d36-4573-9093-5d24c32e8529 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:48.565134 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1344/2673] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:59:48 2022] POST /identity/v3/projects => generated 363 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:48.566954 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-3496eaa2-202e-4efc-af7e-2464fb536a40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8d033e227204499828cd3417e2f9d41', 'request_id': 'req-3496eaa2-202e-4efc-af7e-2464fb536a40'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:48.570922 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb757ec-0d36-4573-9093-5d24c32e8529 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:48.578155 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-3496eaa2-202e-4efc-af7e-2464fb536a40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8d033e227204499828cd3417e2f9d41', 'request_id': 'req-3496eaa2-202e-4efc-af7e-2464fb536a40'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:48.587595 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-3496eaa2-202e-4efc-af7e-2464fb536a40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8d033e227204499828cd3417e2f9d41', 'request_id': 'req-3496eaa2-202e-4efc-af7e-2464fb536a40'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:48.602160 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-3496eaa2-202e-4efc-af7e-2464fb536a40 admin admin] The token cache is being invalidate because project b8d033e227204499828cd3417e2f9d41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:59:48.602699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-3496eaa2-202e-4efc-af7e-2464fb536a40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:48.603597 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-3496eaa2-202e-4efc-af7e-2464fb536a40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:48.606155 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1330/2674] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:59:48 2022] DELETE /identity/v3/projects/b8d033e227204499828cd3417e2f9d41 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:48.611761 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496eaa2-202e-4efc-af7e-2464fb536a40 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:48.613898 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-3496eaa2-202e-4efc-af7e-2464fb536a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:48.657718 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb757ec-0d36-4573-9093-5d24c32e8529 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:48.664996 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a3446-6b99-4dbf-9ed9-bd3788dceac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:48.665756 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a3446-6b99-4dbf-9ed9-bd3788dceac5 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:48.666178 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a3446-6b99-4dbf-9ed9-bd3788dceac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:48.666549 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a3446-6b99-4dbf-9ed9-bd3788dceac5 admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:48.667384 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a3446-6b99-4dbf-9ed9-bd3788dceac5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:48.669615 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a3446-6b99-4dbf-9ed9-bd3788dceac5 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:48.700557 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1345/2675] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:59:48 2022] POST /identity/v3/users => generated 288 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:59:48.706092 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a3446-6b99-4dbf-9ed9-bd3788dceac5 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:48.709038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-734a3446-6b99-4dbf-9ed9-bd3788dceac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:48.735294 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a3446-6b99-4dbf-9ed9-bd3788dceac5 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:48.739491 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496eaa2-202e-4efc-af7e-2464fb536a40 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:48.744184 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a3045-83fb-49de-be34-fb69da6138c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:48.744898 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a3045-83fb-49de-be34-fb69da6138c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:48.745127 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a3045-83fb-49de-be34-fb69da6138c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:48.745397 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a3045-83fb-49de-be34-fb69da6138c6 admin admin] PATH_INFO: `/v3/users/9a4f2a7e00b34f37a76a9cdb069f58b5` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:48.746488 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c098f2-d6f7-4e54-b9ed-b35830404ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:48.746719 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a3045-83fb-49de-be34-fb69da6138c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a4f2a7e00b34f37a76a9cdb069f58b5)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:48.748138 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c098f2-d6f7-4e54-b9ed-b35830404ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:48.748845 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c098f2-d6f7-4e54-b9ed-b35830404ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:48.749034 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a3045-83fb-49de-be34-fb69da6138c6 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:48.749559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c098f2-d6f7-4e54-b9ed-b35830404ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:48.751005 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c098f2-d6f7-4e54-b9ed-b35830404ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:48.754371 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c098f2-d6f7-4e54-b9ed-b35830404ae3 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:48.771129 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1346/2676] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:59:48.775233 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c098f2-d6f7-4e54-b9ed-b35830404ae3 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:48.778194 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:48.799577 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c098f2-d6f7-4e54-b9ed-b35830404ae3 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:48.808929 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64edec-0df6-4e19-a0c5-b93d20ffb8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:48.810118 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64edec-0df6-4e19-a0c5-b93d20ffb8c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:48.810603 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64edec-0df6-4e19-a0c5-b93d20ffb8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:48.810997 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64edec-0df6-4e19-a0c5-b93d20ffb8c1 admin admin] PATH_INFO: `/v3/projects/f8de0e30c5a0463e92c3fff7fc439610/users/202b9cbda675431491d444e251128d5b/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:48.832280 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-dc8a3045-83fb-49de-be34-fb69da6138c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a4f2a7e00b34f37a76a9cdb069f58b5'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:48.833672 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64edec-0df6-4e19-a0c5-b93d20ffb8c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8de0e30c5a0463e92c3fff7fc439610, user_id=202b9cbda675431491d444e251128d5b, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:48.840525 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64edec-0df6-4e19-a0c5-b93d20ffb8c1 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:48.854067 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-dc8a3045-83fb-49de-be34-fb69da6138c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a4f2a7e00b34f37a76a9cdb069f58b5'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:48.872760 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1347/2677] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:59:48 2022] PUT /identity/v3/projects/f8de0e30c5a0463e92c3fff7fc439610/users/202b9cbda675431491d444e251128d5b/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:48.880076 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64edec-0df6-4e19-a0c5-b93d20ffb8c1 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:48.886094 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-dc8a3045-83fb-49de-be34-fb69da6138c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a4f2a7e00b34f37a76a9cdb069f58b5'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:48.910038 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-dc8a3045-83fb-49de-be34-fb69da6138c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a4f2a7e00b34f37a76a9cdb069f58b5'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:48.912212 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-dc8a3045-83fb-49de-be34-fb69da6138c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a4f2a7e00b34f37a76a9cdb069f58b5'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:48.933972 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1331/2678] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:59:48 2022] DELETE /identity/v3/users/9a4f2a7e00b34f37a76a9cdb069f58b5 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:49.012218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64edec-0df6-4e19-a0c5-b93d20ffb8c1 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:49.025833 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:49.188289 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712cf7e-20d8-4d46-8f5c-1b15ce173f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:49.189291 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712cf7e-20d8-4d46-8f5c-1b15ce173f5d admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:49.189798 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712cf7e-20d8-4d46-8f5c-1b15ce173f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:49.190436 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712cf7e-20d8-4d46-8f5c-1b15ce173f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:49.191744 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712cf7e-20d8-4d46-8f5c-1b15ce173f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:49.194975 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1712cf7e-20d8-4d46-8f5c-1b15ce173f5d admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:49.238048 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1348/2679] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:49.242626 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a3045-83fb-49de-be34-fb69da6138c6 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:49.245297 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-dc8a3045-83fb-49de-be34-fb69da6138c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:49.288541 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a3045-83fb-49de-be34-fb69da6138c6 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:49.296760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ca8ce-0fd3-4490-9264-475b6894458d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:49.298008 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ca8ce-0fd3-4490-9264-475b6894458d admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:49.298561 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ca8ce-0fd3-4490-9264-475b6894458d admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:49.299302 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ca8ce-0fd3-4490-9264-475b6894458d admin admin] PATH_INFO: `/v3/projects/f8de0e30c5a0463e92c3fff7fc439610/users/202b9cbda675431491d444e251128d5b/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:49.304703 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ca8ce-0fd3-4490-9264-475b6894458d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8de0e30c5a0463e92c3fff7fc439610, user_id=202b9cbda675431491d444e251128d5b, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:49.310568 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ca8ce-0fd3-4490-9264-475b6894458d admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:49.340360 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1332/2680] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:59:49 2022] PUT /identity/v3/projects/f8de0e30c5a0463e92c3fff7fc439610/users/202b9cbda675431491d444e251128d5b/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:59:49.354802 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce879b84-4caf-46ad-bd22-b893582823d5 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:49.357241 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce879b84-4caf-46ad-bd22-b893582823d5 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:49.362326 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce879b84-4caf-46ad-bd22-b893582823d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:49.489404 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-ce879b84-4caf-46ad-bd22-b893582823d5 None None] MFA Rules not processed for user `202b9cbda675431491d444e251128d5b`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:49.489404 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-ce879b84-4caf-46ad-bd22-b893582823d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:49.602186 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ca8ce-0fd3-4490-9264-475b6894458d admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:49.604828 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-f45ca8ce-0fd3-4490-9264-475b6894458d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:49.743205 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1349/2681] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:49 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:49.756895 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce879b84-4caf-46ad-bd22-b893582823d5 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:49.758889 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ca8ce-0fd3-4490-9264-475b6894458d admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:49.759715 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-ce879b84-4caf-46ad-bd22-b893582823d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:49.765028 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b7c44-e87c-43d3-8ecf-9fd2bdea753c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:49.766548 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b7c44-e87c-43d3-8ecf-9fd2bdea753c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:49.767078 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b7c44-e87c-43d3-8ecf-9fd2bdea753c admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:49.767281 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b7c44-e87c-43d3-8ecf-9fd2bdea753c admin admin] PATH_INFO: `/v3/projects/8acff6dcbcd6424ebd6e346c89c359d7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:49.773642 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b7c44-e87c-43d3-8ecf-9fd2bdea753c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8acff6dcbcd6424ebd6e346c89c359d7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:49.776102 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b7c44-e87c-43d3-8ecf-9fd2bdea753c admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:49.858512 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-872b7c44-e87c-43d3-8ecf-9fd2bdea753c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8acff6dcbcd6424ebd6e346c89c359d7', 'request_id': 'req-872b7c44-e87c-43d3-8ecf-9fd2bdea753c'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:49.874172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-872b7c44-e87c-43d3-8ecf-9fd2bdea753c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8acff6dcbcd6424ebd6e346c89c359d7', 'request_id': 'req-872b7c44-e87c-43d3-8ecf-9fd2bdea753c'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:49.882748 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-872b7c44-e87c-43d3-8ecf-9fd2bdea753c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8acff6dcbcd6424ebd6e346c89c359d7', 'request_id': 'req-872b7c44-e87c-43d3-8ecf-9fd2bdea753c'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:49.897484 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-872b7c44-e87c-43d3-8ecf-9fd2bdea753c admin admin] The token cache is being invalidate because project 8acff6dcbcd6424ebd6e346c89c359d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:59:49.897970 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-872b7c44-e87c-43d3-8ecf-9fd2bdea753c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:49.899018 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-872b7c44-e87c-43d3-8ecf-9fd2bdea753c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:49.901762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1333/2682] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:59:49 2022] DELETE /identity/v3/projects/8acff6dcbcd6424ebd6e346c89c359d7 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:49.919729 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08959c3-fd4f-4a8d-bef9-4f35adcc7a8f None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:49.919729 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08959c3-fd4f-4a8d-bef9-4f35adcc7a8f None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:49.919729 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08959c3-fd4f-4a8d-bef9-4f35adcc7a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:49.933391 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce879b84-4caf-46ad-bd22-b893582823d5 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:49.942377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-d08959c3-fd4f-4a8d-bef9-4f35adcc7a8f None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:49.943947 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-d08959c3-fd4f-4a8d-bef9-4f35adcc7a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:49.958929 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:50.027105 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:50.043349 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5deaa-b5c7-46b4-a978-bb34450b410f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:50.043349 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5deaa-b5c7-46b4-a978-bb34450b410f service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:50.043349 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5deaa-b5c7-46b4-a978-bb34450b410f service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:50.043349 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5deaa-b5c7-46b4-a978-bb34450b410f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:50.045203 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-f1f5deaa-b5c7-46b4-a978-bb34450b410f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:50.106652 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1334/2683] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:59:50.117058 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aea339-5c81-4e8d-a3eb-40ebb31758fa None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:50.117839 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aea339-5c81-4e8d-a3eb-40ebb31758fa None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:50.118689 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aea339-5c81-4e8d-a3eb-40ebb31758fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:50.148992 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5deaa-b5c7-46b4-a978-bb34450b410f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:50.148992 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5deaa-b5c7-46b4-a978-bb34450b410f service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:50.162990 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-b9aea339-5c81-4e8d-a3eb-40ebb31758fa None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:50.165396 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-b9aea339-5c81-4e8d-a3eb-40ebb31758fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:50.190257 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1350/2684] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:49 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:59:50.193195 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5deaa-b5c7-46b4-a978-bb34450b410f service cinder] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:50.196712 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-f1f5deaa-b5c7-46b4-a978-bb34450b410f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:50.202161 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1335/2685] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:50.205256 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aea339-5c81-4e8d-a3eb-40ebb31758fa None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:50.219548 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5deaa-b5c7-46b4-a978-bb34450b410f service cinder] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:50.224732 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aea339-5c81-4e8d-a3eb-40ebb31758fa None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:50.226262 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f943d6-7776-44cd-8960-6a9e0e696d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:50.227204 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f943d6-7776-44cd-8960-6a9e0e696d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:50.227499 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f943d6-7776-44cd-8960-6a9e0e696d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:50.227781 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f943d6-7776-44cd-8960-6a9e0e696d17 admin admin] PATH_INFO: `/v3/users/191be93273d842a5a5b9db7bdbf3e95b` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:50.230537 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f943d6-7776-44cd-8960-6a9e0e696d17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=191be93273d842a5a5b9db7bdbf3e95b)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:50.232841 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f943d6-7776-44cd-8960-6a9e0e696d17 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:50.236620 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16231024-918a-418c-8988-54375f1a1825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:50.237587 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16231024-918a-418c-8988-54375f1a1825 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:50.237883 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16231024-918a-418c-8988-54375f1a1825 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:50.238283 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16231024-918a-418c-8988-54375f1a1825 admin admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:50.239434 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16231024-918a-418c-8988-54375f1a1825 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:59:50.239754 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16231024-918a-418c-8988-54375f1a1825 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:50.242486 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16231024-918a-418c-8988-54375f1a1825 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:50.262060 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1336/2686] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:59:50.272205 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16231024-918a-418c-8988-54375f1a1825 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:50.309931 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16231024-918a-418c-8988-54375f1a1825 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:50.317905 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c411fde-28ba-4508-8e68-6d06412072e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:50.318964 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c411fde-28ba-4508-8e68-6d06412072e5 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:50.319310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c411fde-28ba-4508-8e68-6d06412072e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:50.319677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c411fde-28ba-4508-8e68-6d06412072e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:50.320530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c411fde-28ba-4508-8e68-6d06412072e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:50.322943 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c411fde-28ba-4508-8e68-6d06412072e5 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:50.338975 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-98f943d6-7776-44cd-8960-6a9e0e696d17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '191be93273d842a5a5b9db7bdbf3e95b'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:50.340389 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-98f943d6-7776-44cd-8960-6a9e0e696d17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '191be93273d842a5a5b9db7bdbf3e95b'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:50.357424 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-98f943d6-7776-44cd-8960-6a9e0e696d17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '191be93273d842a5a5b9db7bdbf3e95b'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:50.369630 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1337/2687] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:59:50 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 04:59:50.369630 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c411fde-28ba-4508-8e68-6d06412072e5 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:50.372985 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-1c411fde-28ba-4508-8e68-6d06412072e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:50.381042 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-98f943d6-7776-44cd-8960-6a9e0e696d17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '191be93273d842a5a5b9db7bdbf3e95b'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:50.395150 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-98f943d6-7776-44cd-8960-6a9e0e696d17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '191be93273d842a5a5b9db7bdbf3e95b'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:50.407398 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1351/2688] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:59:50 2022] DELETE /identity/v3/users/191be93273d842a5a5b9db7bdbf3e95b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:50.410983 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f943d6-7776-44cd-8960-6a9e0e696d17 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:50.422795 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-98f943d6-7776-44cd-8960-6a9e0e696d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:50.451456 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c411fde-28ba-4508-8e68-6d06412072e5 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:50.537154 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f943d6-7776-44cd-8960-6a9e0e696d17 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:50.541382 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22a5ae-09ac-42f3-a453-c7fd272f91c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:50.542369 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22a5ae-09ac-42f3-a453-c7fd272f91c2 service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:50.542675 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22a5ae-09ac-42f3-a453-c7fd272f91c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:50.542807 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e6778-559c-4b47-9b8a-0091f4796f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:50.543191 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22a5ae-09ac-42f3-a453-c7fd272f91c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:50.543543 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e6778-559c-4b47-9b8a-0091f4796f48 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:50.544024 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e6778-559c-4b47-9b8a-0091f4796f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:50.544410 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e6778-559c-4b47-9b8a-0091f4796f48 admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:50.545109 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e6778-559c-4b47-9b8a-0091f4796f48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:50.545533 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-aa22a5ae-09ac-42f3-a453-c7fd272f91c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:50.547305 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e6778-559c-4b47-9b8a-0091f4796f48 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:50.562931 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:50.586801 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1352/2689] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:59:50 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:50.594569 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e6778-559c-4b47-9b8a-0091f4796f48 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:50.612035 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e6778-559c-4b47-9b8a-0091f4796f48 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:50.618291 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:50.620484 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8efcc-b691-4317-92e3-56ac591c4eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:50.621741 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8efcc-b691-4317-92e3-56ac591c4eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:50.622686 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8efcc-b691-4317-92e3-56ac591c4eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:50.623595 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8efcc-b691-4317-92e3-56ac591c4eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:50.624925 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d8efcc-b691-4317-92e3-56ac591c4eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:50.628200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d8efcc-b691-4317-92e3-56ac591c4eb9 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:50.642389 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1353/2690] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:59:50.647404 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa22a5ae-09ac-42f3-a453-c7fd272f91c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:50.649292 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa22a5ae-09ac-42f3-a453-c7fd272f91c2 service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:50.657009 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8efcc-b691-4317-92e3-56ac591c4eb9 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:50.667153 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1338/2691] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:50 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:59:50.669913 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8efcc-b691-4317-92e3-56ac591c4eb9 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:50.675515 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9fd55-0924-480f-84d2-b09757e93df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:50.676149 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9fd55-0924-480f-84d2-b09757e93df0 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:50.676436 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9fd55-0924-480f-84d2-b09757e93df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:50.676704 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9fd55-0924-480f-84d2-b09757e93df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:50.677410 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f9fd55-0924-480f-84d2-b09757e93df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:50.679087 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f9fd55-0924-480f-84d2-b09757e93df0 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:50.692070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1354/2692] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 04:59:50.697574 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22a5ae-09ac-42f3-a453-c7fd272f91c2 service cinder] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:50.706526 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9fd55-0924-480f-84d2-b09757e93df0 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:50.708613 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-b1f9fd55-0924-480f-84d2-b09757e93df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:50.716219 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22a5ae-09ac-42f3-a453-c7fd272f91c2 service cinder] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:50.726089 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab2e68-4b84-4a07-bcd8-e11c75c75d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:50.727393 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab2e68-4b84-4a07-bcd8-e11c75c75d32 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:50.727925 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab2e68-4b84-4a07-bcd8-e11c75c75d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:50.728365 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab2e68-4b84-4a07-bcd8-e11c75c75d32 admin admin] PATH_INFO: `/v3/projects/db3f71767d7143ca90a07ee7fbd2d524/users/4128804de02b42bc81bb2950cb698b3c/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:50.730711 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9fd55-0924-480f-84d2-b09757e93df0 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:50.736417 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70b84f-3c76-41e0-abc1-feb75fb2b17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:50.737293 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70b84f-3c76-41e0-abc1-feb75fb2b17b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:50.737560 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70b84f-3c76-41e0-abc1-feb75fb2b17b admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:50.737831 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70b84f-3c76-41e0-abc1-feb75fb2b17b admin admin] PATH_INFO: `/v3/projects/24f9078971b74c5a9e5f15d5c452a35a` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:50.739963 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70b84f-3c76-41e0-abc1-feb75fb2b17b admin admin] RBAC: Authorizing `identity:delete_project(project_id=24f9078971b74c5a9e5f15d5c452a35a)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:50.742148 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df70b84f-3c76-41e0-abc1-feb75fb2b17b admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:50.754316 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab2e68-4b84-4a07-bcd8-e11c75c75d32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db3f71767d7143ca90a07ee7fbd2d524, user_id=4128804de02b42bc81bb2950cb698b3c, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:50.760773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab2e68-4b84-4a07-bcd8-e11c75c75d32 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:50.779993 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1339/2693] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:59:50 2022] PUT /identity/v3/projects/db3f71767d7143ca90a07ee7fbd2d524/users/4128804de02b42bc81bb2950cb698b3c/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:50.786773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00c46b-4910-4579-bd63-19e917286cdb None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:50.787884 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00c46b-4910-4579-bd63-19e917286cdb None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:50.788583 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00c46b-4910-4579-bd63-19e917286cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:50.812330 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-7d00c46b-4910-4579-bd63-19e917286cdb None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:50.813628 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-7d00c46b-4910-4579-bd63-19e917286cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:50.820575 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-df70b84f-3c76-41e0-abc1-feb75fb2b17b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24f9078971b74c5a9e5f15d5c452a35a', 'request_id': 'req-df70b84f-3c76-41e0-abc1-feb75fb2b17b'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:50.836992 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-df70b84f-3c76-41e0-abc1-feb75fb2b17b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24f9078971b74c5a9e5f15d5c452a35a', 'request_id': 'req-df70b84f-3c76-41e0-abc1-feb75fb2b17b'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:50.849689 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-df70b84f-3c76-41e0-abc1-feb75fb2b17b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24f9078971b74c5a9e5f15d5c452a35a', 'request_id': 'req-df70b84f-3c76-41e0-abc1-feb75fb2b17b'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:50.876941 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-df70b84f-3c76-41e0-abc1-feb75fb2b17b admin admin] The token cache is being invalidate because project 24f9078971b74c5a9e5f15d5c452a35a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:59:50.877249 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-df70b84f-3c76-41e0-abc1-feb75fb2b17b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:50.878580 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-df70b84f-3c76-41e0-abc1-feb75fb2b17b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:50.882945 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1355/2694] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:59:50 2022] DELETE /identity/v3/projects/24f9078971b74c5a9e5f15d5c452a35a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:50.890454 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70b84f-3c76-41e0-abc1-feb75fb2b17b admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:50.892097 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-df70b84f-3c76-41e0-abc1-feb75fb2b17b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:50.911432 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1340/2695] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:50.923771 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00c46b-4910-4579-bd63-19e917286cdb None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:50.925317 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-7d00c46b-4910-4579-bd63-19e917286cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:50.990021 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df70b84f-3c76-41e0-abc1-feb75fb2b17b admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:50.994174 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00c46b-4910-4579-bd63-19e917286cdb None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:50.998065 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0592cf1a-5224-497a-9a6e-a2f0ade0943b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:50.998285 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f666ba-0277-41fe-af6f-cbcf20709f4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:50.998853 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f666ba-0277-41fe-af6f-cbcf20709f4a service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:50.999140 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f666ba-0277-41fe-af6f-cbcf20709f4a service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:50.999309 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592cf1a-5224-497a-9a6e-a2f0ade0943b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:50.999473 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f666ba-0277-41fe-af6f-cbcf20709f4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:50.999637 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592cf1a-5224-497a-9a6e-a2f0ade0943b admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:51.000138 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592cf1a-5224-497a-9a6e-a2f0ade0943b admin admin] PATH_INFO: `/v3/users/dcee48bc50cc4e5fb0a87a6c45d9b94b` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:51.002331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0592cf1a-5224-497a-9a6e-a2f0ade0943b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcee48bc50cc4e5fb0a87a6c45d9b94b)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:51.006217 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0592cf1a-5224-497a-9a6e-a2f0ade0943b admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:51.011240 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f666ba-0277-41fe-af6f-cbcf20709f4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:51.013053 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f666ba-0277-41fe-af6f-cbcf20709f4a service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:51.024623 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1341/2696] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:59:51.087028 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-0592cf1a-5224-497a-9a6e-a2f0ade0943b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcee48bc50cc4e5fb0a87a6c45d9b94b'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:51.087733 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-0592cf1a-5224-497a-9a6e-a2f0ade0943b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcee48bc50cc4e5fb0a87a6c45d9b94b'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:51.096665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-0592cf1a-5224-497a-9a6e-a2f0ade0943b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcee48bc50cc4e5fb0a87a6c45d9b94b'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:51.103539 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:51.116628 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-0592cf1a-5224-497a-9a6e-a2f0ade0943b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcee48bc50cc4e5fb0a87a6c45d9b94b'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:51.127780 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-0592cf1a-5224-497a-9a6e-a2f0ade0943b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcee48bc50cc4e5fb0a87a6c45d9b94b'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:51.137049 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1356/2697] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:59:50 2022] DELETE /identity/v3/users/dcee48bc50cc4e5fb0a87a6c45d9b94b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:51.375306 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f666ba-0277-41fe-af6f-cbcf20709f4a service neutron] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:51.388437 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f666ba-0277-41fe-af6f-cbcf20709f4a service neutron] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:51.475948 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77136b-eb9f-440b-8fd9-b949af5526b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:51.476714 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77136b-eb9f-440b-8fd9-b949af5526b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:51.477060 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77136b-eb9f-440b-8fd9-b949af5526b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:51.477423 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77136b-eb9f-440b-8fd9-b949af5526b2 admin admin] PATH_INFO: `/v3/projects/a9b731b431304f3f9983b28ab23968b4` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:51.479370 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77136b-eb9f-440b-8fd9-b949af5526b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9b731b431304f3f9983b28ab23968b4)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:51.481440 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77136b-eb9f-440b-8fd9-b949af5526b2 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:51.484417 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:51.559684 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8e77136b-eb9f-440b-8fd9-b949af5526b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9b731b431304f3f9983b28ab23968b4', 'request_id': 'req-8e77136b-eb9f-440b-8fd9-b949af5526b2'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:51.570678 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8e77136b-eb9f-440b-8fd9-b949af5526b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9b731b431304f3f9983b28ab23968b4', 'request_id': 'req-8e77136b-eb9f-440b-8fd9-b949af5526b2'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:51.579516 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8e77136b-eb9f-440b-8fd9-b949af5526b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9b731b431304f3f9983b28ab23968b4', 'request_id': 'req-8e77136b-eb9f-440b-8fd9-b949af5526b2'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:51.595756 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8e77136b-eb9f-440b-8fd9-b949af5526b2 admin admin] The token cache is being invalidate because project a9b731b431304f3f9983b28ab23968b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:59:51.596280 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8e77136b-eb9f-440b-8fd9-b949af5526b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:51.597519 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8e77136b-eb9f-440b-8fd9-b949af5526b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:51.599830 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1342/2698] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:59:51 2022] DELETE /identity/v3/projects/a9b731b431304f3f9983b28ab23968b4 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:51.928700 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77238e6-be92-4066-8917-8ad46d2f5741 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:51.929526 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77238e6-be92-4066-8917-8ad46d2f5741 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:51.929526 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77238e6-be92-4066-8917-8ad46d2f5741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:51.965437 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-b77238e6-be92-4066-8917-8ad46d2f5741 None None] MFA Rules not processed for user `4128804de02b42bc81bb2950cb698b3c`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:51.966527 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-b77238e6-be92-4066-8917-8ad46d2f5741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:52.075257 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1357/2699] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:59:52.086679 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77136b-eb9f-440b-8fd9-b949af5526b2 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:52.089002 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-8e77136b-eb9f-440b-8fd9-b949af5526b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:52.172742 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77136b-eb9f-440b-8fd9-b949af5526b2 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:52.176905 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f6d48-6eba-48c8-9d76-3481895cff8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:52.177657 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f6d48-6eba-48c8-9d76-3481895cff8c service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:52.177801 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f6d48-6eba-48c8-9d76-3481895cff8c service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:52.178105 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f6d48-6eba-48c8-9d76-3481895cff8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:52.187836 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f6d48-6eba-48c8-9d76-3481895cff8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:52.189311 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f6d48-6eba-48c8-9d76-3481895cff8c service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:52.200316 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1343/2700] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:59:53.698281 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a625d-6946-42ed-b28b-8bef54fce596 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:53.699298 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a625d-6946-42ed-b28b-8bef54fce596 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:53.699298 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a625d-6946-42ed-b28b-8bef54fce596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:53.725773 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-ae0a625d-6946-42ed-b28b-8bef54fce596 None None] MFA Rules not processed for user `4128804de02b42bc81bb2950cb698b3c`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:53.727376 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-ae0a625d-6946-42ed-b28b-8bef54fce596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:53.736979 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1358/2701] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:53.787720 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f6d48-6eba-48c8-9d76-3481895cff8c service cinder] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:53.789802 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-3e6f6d48-6eba-48c8-9d76-3481895cff8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:53.896838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f6d48-6eba-48c8-9d76-3481895cff8c service cinder] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:53.903373 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b183462-be86-4c43-9b16-1e9d485c6e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:53.904223 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b183462-be86-4c43-9b16-1e9d485c6e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:53.904598 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b183462-be86-4c43-9b16-1e9d485c6e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:53.905062 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b183462-be86-4c43-9b16-1e9d485c6e5b admin admin] PATH_INFO: `/v3/users/4e90268255e34acca205507408e4dff9` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:53.906699 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b183462-be86-4c43-9b16-1e9d485c6e5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e90268255e34acca205507408e4dff9)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:53.909164 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b183462-be86-4c43-9b16-1e9d485c6e5b admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:53.973963 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:53.993893 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-3b183462-be86-4c43-9b16-1e9d485c6e5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e90268255e34acca205507408e4dff9'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:54.006232 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-3b183462-be86-4c43-9b16-1e9d485c6e5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e90268255e34acca205507408e4dff9'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:54.026149 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-3b183462-be86-4c43-9b16-1e9d485c6e5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e90268255e34acca205507408e4dff9'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:54.034339 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-3b183462-be86-4c43-9b16-1e9d485c6e5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e90268255e34acca205507408e4dff9'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:54.035148 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-3b183462-be86-4c43-9b16-1e9d485c6e5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e90268255e34acca205507408e4dff9'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:54.042082 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1344/2702] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:59:53 2022] DELETE /identity/v3/users/4e90268255e34acca205507408e4dff9 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:54.046896 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc522af-4c55-493a-8249-0f969fb63083 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:54.047185 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc522af-4c55-493a-8249-0f969fb63083 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:54.047543 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc522af-4c55-493a-8249-0f969fb63083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:54.068307 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-6fc522af-4c55-493a-8249-0f969fb63083 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:54.069551 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-6fc522af-4c55-493a-8249-0f969fb63083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:54.127255 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b183462-be86-4c43-9b16-1e9d485c6e5b admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:54.128988 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-3b183462-be86-4c43-9b16-1e9d485c6e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:54.148776 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1359/2703] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 04:59:54.164004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc522af-4c55-493a-8249-0f969fb63083 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:54.166938 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-6fc522af-4c55-493a-8249-0f969fb63083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:54.236610 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b183462-be86-4c43-9b16-1e9d485c6e5b admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:54.242827 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf42ca-2094-48dd-af4e-886a7032016a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:54.243840 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf42ca-2094-48dd-af4e-886a7032016a service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:54.244298 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf42ca-2094-48dd-af4e-886a7032016a service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:54.244650 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf42ca-2094-48dd-af4e-886a7032016a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:54.247600 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-fbdf42ca-2094-48dd-af4e-886a7032016a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:54.250324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc522af-4c55-493a-8249-0f969fb63083 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:54.254760 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a6747-0576-4467-8473-aef003a05951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:54.255625 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a6747-0576-4467-8473-aef003a05951 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:54.256028 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a6747-0576-4467-8473-aef003a05951 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:54.256376 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a6747-0576-4467-8473-aef003a05951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:54.263765 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf42ca-2094-48dd-af4e-886a7032016a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:54.266639 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf42ca-2094-48dd-af4e-886a7032016a service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:54.279520 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a6747-0576-4467-8473-aef003a05951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:54.281892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a6747-0576-4467-8473-aef003a05951 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:54.286834 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1345/2704] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 04:59:54.301058 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1360/2705] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:59:54.702772 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf42ca-2094-48dd-af4e-886a7032016a service neutron] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:54.704547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-fbdf42ca-2094-48dd-af4e-886a7032016a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:54.730615 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf42ca-2094-48dd-af4e-886a7032016a service neutron] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:54.737342 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48808ccb-c392-450b-97cb-c6399c37713c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:54.739010 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48808ccb-c392-450b-97cb-c6399c37713c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:54.739347 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48808ccb-c392-450b-97cb-c6399c37713c admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:54.739622 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48808ccb-c392-450b-97cb-c6399c37713c admin admin] PATH_INFO: `/v3/projects/3512d19beed8451b8add85cc5602a5de` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:54.741001 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48808ccb-c392-450b-97cb-c6399c37713c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3512d19beed8451b8add85cc5602a5de)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:54.743166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48808ccb-c392-450b-97cb-c6399c37713c admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:54.841415 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-48808ccb-c392-450b-97cb-c6399c37713c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3512d19beed8451b8add85cc5602a5de', 'request_id': 'req-48808ccb-c392-450b-97cb-c6399c37713c'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:54.852158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-48808ccb-c392-450b-97cb-c6399c37713c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3512d19beed8451b8add85cc5602a5de', 'request_id': 'req-48808ccb-c392-450b-97cb-c6399c37713c'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:54.859552 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-48808ccb-c392-450b-97cb-c6399c37713c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3512d19beed8451b8add85cc5602a5de', 'request_id': 'req-48808ccb-c392-450b-97cb-c6399c37713c'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:54.878628 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-48808ccb-c392-450b-97cb-c6399c37713c admin admin] The token cache is being invalidate because project 3512d19beed8451b8add85cc5602a5de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:59:54.878628 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-48808ccb-c392-450b-97cb-c6399c37713c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:54.878628 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-48808ccb-c392-450b-97cb-c6399c37713c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:54.882030 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1346/2706] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:59:54 2022] DELETE /identity/v3/projects/3512d19beed8451b8add85cc5602a5de => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:54.886504 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a6747-0576-4467-8473-aef003a05951 service neutron] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:54.894367 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:54.904534 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a6747-0576-4467-8473-aef003a05951 service neutron] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:54.977468 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0632d-19b7-4181-b57e-7f8dac820623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:54.978598 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0632d-19b7-4181-b57e-7f8dac820623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:54.978974 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0632d-19b7-4181-b57e-7f8dac820623 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:54.979568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0632d-19b7-4181-b57e-7f8dac820623 admin admin] PATH_INFO: `/v3/users/202b9cbda675431491d444e251128d5b` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:54.981252 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0632d-19b7-4181-b57e-7f8dac820623 admin admin] RBAC: Authorizing `identity:delete_user(user_id=202b9cbda675431491d444e251128d5b)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:54.983463 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0632d-19b7-4181-b57e-7f8dac820623 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:55.059843 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-56f0632d-19b7-4181-b57e-7f8dac820623 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '202b9cbda675431491d444e251128d5b'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:55.061261 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-56f0632d-19b7-4181-b57e-7f8dac820623 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '202b9cbda675431491d444e251128d5b'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:55.073512 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-56f0632d-19b7-4181-b57e-7f8dac820623 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '202b9cbda675431491d444e251128d5b'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:55.090015 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-56f0632d-19b7-4181-b57e-7f8dac820623 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '202b9cbda675431491d444e251128d5b'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:55.098880 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-56f0632d-19b7-4181-b57e-7f8dac820623 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '202b9cbda675431491d444e251128d5b'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:55.106533 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1361/2707] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:59:54 2022] DELETE /identity/v3/users/202b9cbda675431491d444e251128d5b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:55.540019 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48808ccb-c392-450b-97cb-c6399c37713c admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:55.542974 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-48808ccb-c392-450b-97cb-c6399c37713c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:55.560373 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48808ccb-c392-450b-97cb-c6399c37713c admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:55.619831 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:55.650535 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3935e5b-0fb6-44dd-a43d-c1521de01e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:55.651341 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3935e5b-0fb6-44dd-a43d-c1521de01e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:55.651692 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3935e5b-0fb6-44dd-a43d-c1521de01e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:55.652037 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3935e5b-0fb6-44dd-a43d-c1521de01e5b admin admin] PATH_INFO: `/v3/projects/f8de0e30c5a0463e92c3fff7fc439610` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:55.653452 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3935e5b-0fb6-44dd-a43d-c1521de01e5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8de0e30c5a0463e92c3fff7fc439610)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:55.655623 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3935e5b-0fb6-44dd-a43d-c1521de01e5b admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:55.732778 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-b3935e5b-0fb6-44dd-a43d-c1521de01e5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8de0e30c5a0463e92c3fff7fc439610', 'request_id': 'req-b3935e5b-0fb6-44dd-a43d-c1521de01e5b'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:55.743557 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-b3935e5b-0fb6-44dd-a43d-c1521de01e5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8de0e30c5a0463e92c3fff7fc439610', 'request_id': 'req-b3935e5b-0fb6-44dd-a43d-c1521de01e5b'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:55.751890 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-b3935e5b-0fb6-44dd-a43d-c1521de01e5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8de0e30c5a0463e92c3fff7fc439610', 'request_id': 'req-b3935e5b-0fb6-44dd-a43d-c1521de01e5b'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:55.765790 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-b3935e5b-0fb6-44dd-a43d-c1521de01e5b admin admin] The token cache is being invalidate because project f8de0e30c5a0463e92c3fff7fc439610 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 04:59:55.766267 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-b3935e5b-0fb6-44dd-a43d-c1521de01e5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:55.766887 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-b3935e5b-0fb6-44dd-a43d-c1521de01e5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:55.768601 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1347/2708] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 04:59:55 2022] DELETE /identity/v3/projects/f8de0e30c5a0463e92c3fff7fc439610 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:55.774925 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475e50f-f87f-4b97-96d3-04056549981d None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:55.775332 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475e50f-f87f-4b97-96d3-04056549981d None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:55.775753 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475e50f-f87f-4b97-96d3-04056549981d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:55.798649 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-a475e50f-f87f-4b97-96d3-04056549981d None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:55.800132 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-a475e50f-f87f-4b97-96d3-04056549981d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:55.884839 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1362/2709] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:55.893789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035091f-4c59-4fbc-a312-f58a5deb9a3a None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:55.894441 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035091f-4c59-4fbc-a312-f58a5deb9a3a None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:55.894441 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2035091f-4c59-4fbc-a312-f58a5deb9a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:55.923361 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-2035091f-4c59-4fbc-a312-f58a5deb9a3a None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:55.924609 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-2035091f-4c59-4fbc-a312-f58a5deb9a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:55.934022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1348/2710] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:55.939584 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475e50f-f87f-4b97-96d3-04056549981d None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:55.956062 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475e50f-f87f-4b97-96d3-04056549981d None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:55.961505 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290f21c-6098-45a5-b7d8-4b31b77bf251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:55.962209 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290f21c-6098-45a5-b7d8-4b31b77bf251 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:55.962492 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290f21c-6098-45a5-b7d8-4b31b77bf251 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:55.962799 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290f21c-6098-45a5-b7d8-4b31b77bf251 admin admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:55.963561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290f21c-6098-45a5-b7d8-4b31b77bf251 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 04:59:55.963873 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290f21c-6098-45a5-b7d8-4b31b77bf251 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:55.965672 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290f21c-6098-45a5-b7d8-4b31b77bf251 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:55.981151 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1363/2711] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 04:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 04:59:55.986888 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035091f-4c59-4fbc-a312-f58a5deb9a3a None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:56.007674 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2035091f-4c59-4fbc-a312-f58a5deb9a3a None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:56.018023 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee4429-b143-4b5c-b936-699f55d0ba95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:56.019255 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee4429-b143-4b5c-b936-699f55d0ba95 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:56.019739 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee4429-b143-4b5c-b936-699f55d0ba95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:56.020003 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee4429-b143-4b5c-b936-699f55d0ba95 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:56.020914 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee4429-b143-4b5c-b936-699f55d0ba95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:56.023347 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee4429-b143-4b5c-b936-699f55d0ba95 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:56.060051 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1349/2712] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:59:55 2022] POST /identity/v3/projects => generated 369 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:56.064853 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290f21c-6098-45a5-b7d8-4b31b77bf251 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:56.087755 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290f21c-6098-45a5-b7d8-4b31b77bf251 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:56.097307 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:56.166865 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5ba47-1cb7-4929-ad43-84705b28c24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:56.167527 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5ba47-1cb7-4929-ad43-84705b28c24c admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:56.167960 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5ba47-1cb7-4929-ad43-84705b28c24c admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:56.168223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5ba47-1cb7-4929-ad43-84705b28c24c admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:56.168914 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5ba47-1cb7-4929-ad43-84705b28c24c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:56.170955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5ba47-1cb7-4929-ad43-84705b28c24c admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:56.210288 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1364/2713] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:59:56 2022] POST /identity/v3/users => generated 285 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:56.210629 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee4429-b143-4b5c-b936-699f55d0ba95 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:56.228122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee4429-b143-4b5c-b936-699f55d0ba95 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:56.239126 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264b298-5602-4e86-a20f-2a53326bf536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:56.240311 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264b298-5602-4e86-a20f-2a53326bf536 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:56.241072 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264b298-5602-4e86-a20f-2a53326bf536 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:56.241871 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264b298-5602-4e86-a20f-2a53326bf536 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:56.243483 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a264b298-5602-4e86-a20f-2a53326bf536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:56.246918 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a264b298-5602-4e86-a20f-2a53326bf536 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:56.263467 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1350/2714] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:56.272004 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5ba47-1cb7-4929-ad43-84705b28c24c admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:56.290392 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5ba47-1cb7-4929-ad43-84705b28c24c admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:56.298258 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd3a30-a282-40c2-a565-e832760cfdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:56.298922 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd3a30-a282-40c2-a565-e832760cfdb4 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:56.299391 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd3a30-a282-40c2-a565-e832760cfdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:56.299751 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd3a30-a282-40c2-a565-e832760cfdb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:56.300679 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd3a30-a282-40c2-a565-e832760cfdb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:56.302679 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd3a30-a282-40c2-a565-e832760cfdb4 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:56.316627 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1365/2715] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:56.321367 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264b298-5602-4e86-a20f-2a53326bf536 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:56.335068 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264b298-5602-4e86-a20f-2a53326bf536 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:56.342254 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6667dc-9b90-4ff2-94dc-b977fdebdcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:56.343018 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6667dc-9b90-4ff2-94dc-b977fdebdcfb admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:56.343301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6667dc-9b90-4ff2-94dc-b977fdebdcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:56.343753 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6667dc-9b90-4ff2-94dc-b977fdebdcfb admin admin] PATH_INFO: `/v3/projects/6a6bcc2ef345435b965f190cdef82cea/users/d742f95d78044182bf271e18393e66d3/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:56.363485 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6667dc-9b90-4ff2-94dc-b977fdebdcfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a6bcc2ef345435b965f190cdef82cea, user_id=d742f95d78044182bf271e18393e66d3, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:56.366020 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6667dc-9b90-4ff2-94dc-b977fdebdcfb admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:56.390408 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1351/2716] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:59:56 2022] PUT /identity/v3/projects/6a6bcc2ef345435b965f190cdef82cea/users/d742f95d78044182bf271e18393e66d3/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:59:56.395141 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03bd4b-b23a-4fbb-9709-f46a8fe7c07f None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:56.395468 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03bd4b-b23a-4fbb-9709-f46a8fe7c07f None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:56.396895 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03bd4b-b23a-4fbb-9709-f46a8fe7c07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:56.437242 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-da03bd4b-b23a-4fbb-9709-f46a8fe7c07f None None] MFA Rules not processed for user `d742f95d78044182bf271e18393e66d3`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:56.439786 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-da03bd4b-b23a-4fbb-9709-f46a8fe7c07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:56.555962 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1366/2717] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:56.563075 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6667dc-9b90-4ff2-94dc-b977fdebdcfb admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:56.687545 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6667dc-9b90-4ff2-94dc-b977fdebdcfb admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:56.696404 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9da197-0145-4d6e-9aa2-940e1710ec23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:56.697462 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9da197-0145-4d6e-9aa2-940e1710ec23 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:56.697949 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9da197-0145-4d6e-9aa2-940e1710ec23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:56.698526 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9da197-0145-4d6e-9aa2-940e1710ec23 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:56.699830 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9da197-0145-4d6e-9aa2-940e1710ec23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:56.703793 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9da197-0145-4d6e-9aa2-940e1710ec23 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:56.728704 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:56.759579 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1352/2718] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 04:59:56 2022] POST /identity/v3/projects => generated 369 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:56.766078 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03bd4b-b23a-4fbb-9709-f46a8fe7c07f None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:56.786251 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03bd4b-b23a-4fbb-9709-f46a8fe7c07f None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:56.893544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a30ab-983b-4679-bdfb-6af96405993c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:56.894089 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a30ab-983b-4679-bdfb-6af96405993c admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:56.894403 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a30ab-983b-4679-bdfb-6af96405993c admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:56.894674 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a30ab-983b-4679-bdfb-6af96405993c admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:56.895382 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a30ab-983b-4679-bdfb-6af96405993c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:56.897409 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a30ab-983b-4679-bdfb-6af96405993c admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:56.928008 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1367/2719] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 04:59:56 2022] POST /identity/v3/users => generated 291 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 04:59:56.932727 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9da197-0145-4d6e-9aa2-940e1710ec23 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:56.947325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9da197-0145-4d6e-9aa2-940e1710ec23 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:56.955652 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77959e-2dbb-44a7-a5d8-6e93c2f59948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:56.956952 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77959e-2dbb-44a7-a5d8-6e93c2f59948 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:56.957623 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77959e-2dbb-44a7-a5d8-6e93c2f59948 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:56.958130 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77959e-2dbb-44a7-a5d8-6e93c2f59948 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:56.959343 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77959e-2dbb-44a7-a5d8-6e93c2f59948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:56.961530 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77959e-2dbb-44a7-a5d8-6e93c2f59948 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:56.977760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1353/2720] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:56.983190 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a30ab-983b-4679-bdfb-6af96405993c admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:56.995492 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a30ab-983b-4679-bdfb-6af96405993c admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:57.000957 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b40d24-f887-42b6-b27f-420846dfeea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:57.001835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b40d24-f887-42b6-b27f-420846dfeea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:57.002025 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b40d24-f887-42b6-b27f-420846dfeea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:57.002268 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b40d24-f887-42b6-b27f-420846dfeea7 admin admin] PATH_INFO: `/v3/projects/95a3e3db602b4e91a36cdc479858e947/users/4c06b349c68749329936206ed0a3c65a/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:57.005128 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:57.024372 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b40d24-f887-42b6-b27f-420846dfeea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a3e3db602b4e91a36cdc479858e947, user_id=4c06b349c68749329936206ed0a3c65a, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:57.028308 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b40d24-f887-42b6-b27f-420846dfeea7 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:57.047230 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1368/2721] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:59:56 2022] PUT /identity/v3/projects/95a3e3db602b4e91a36cdc479858e947/users/4c06b349c68749329936206ed0a3c65a/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 04:59:57.052320 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77959e-2dbb-44a7-a5d8-6e93c2f59948 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:57.066722 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77959e-2dbb-44a7-a5d8-6e93c2f59948 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:57.183571 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42197d73-f8e9-4b3d-accc-ad7192e56f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:57.184377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42197d73-f8e9-4b3d-accc-ad7192e56f95 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:57.184649 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42197d73-f8e9-4b3d-accc-ad7192e56f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:57.184970 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42197d73-f8e9-4b3d-accc-ad7192e56f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:57.185632 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42197d73-f8e9-4b3d-accc-ad7192e56f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:57.187522 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42197d73-f8e9-4b3d-accc-ad7192e56f95 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:57.204903 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1354/2722] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 04:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 04:59:57.210474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b40d24-f887-42b6-b27f-420846dfeea7 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:57.228876 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b40d24-f887-42b6-b27f-420846dfeea7 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:57.237750 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b856a22-8ecd-4cab-80f2-aea8fb5750cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:57.238858 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b856a22-8ecd-4cab-80f2-aea8fb5750cb admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:57.239295 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b856a22-8ecd-4cab-80f2-aea8fb5750cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:57.239916 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b856a22-8ecd-4cab-80f2-aea8fb5750cb admin admin] PATH_INFO: `/v3/projects/95a3e3db602b4e91a36cdc479858e947/users/4c06b349c68749329936206ed0a3c65a/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:57.243523 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b856a22-8ecd-4cab-80f2-aea8fb5750cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a3e3db602b4e91a36cdc479858e947, user_id=4c06b349c68749329936206ed0a3c65a, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:57.246989 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b856a22-8ecd-4cab-80f2-aea8fb5750cb admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:57.259657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1369/2723] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 04:59:57 2022] PUT /identity/v3/projects/95a3e3db602b4e91a36cdc479858e947/users/4c06b349c68749329936206ed0a3c65a/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:57.272624 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870e6ea-cd16-4592-a1c9-a6949a90e127 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:57.273466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870e6ea-cd16-4592-a1c9-a6949a90e127 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:57.274161 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870e6ea-cd16-4592-a1c9-a6949a90e127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:57.334438 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-6870e6ea-cd16-4592-a1c9-a6949a90e127 None None] MFA Rules not processed for user `4c06b349c68749329936206ed0a3c65a`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:57.336080 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-6870e6ea-cd16-4592-a1c9-a6949a90e127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:57.451104 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1355/2724] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:57 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:57.464335 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b856a22-8ecd-4cab-80f2-aea8fb5750cb admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:57.467431 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-3b856a22-8ecd-4cab-80f2-aea8fb5750cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:57.544675 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b856a22-8ecd-4cab-80f2-aea8fb5750cb admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:57.548714 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a06ba-8b24-4d93-9a6b-f1d9dcde341d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:57.549379 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a06ba-8b24-4d93-9a6b-f1d9dcde341d service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:57.549911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a06ba-8b24-4d93-9a6b-f1d9dcde341d service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:57.550238 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a06ba-8b24-4d93-9a6b-f1d9dcde341d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:57.561069 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a06ba-8b24-4d93-9a6b-f1d9dcde341d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:57.562703 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248a06ba-8b24-4d93-9a6b-f1d9dcde341d service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:57.574519 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1370/2725] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:57 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 04:59:59.431281 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870e6ea-cd16-4592-a1c9-a6949a90e127 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:59.521175 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870e6ea-cd16-4592-a1c9-a6949a90e127 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:59.529523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d08e09-bd95-495d-8215-78f810f76c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:59.530667 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d08e09-bd95-495d-8215-78f810f76c59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:59.531165 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d08e09-bd95-495d-8215-78f810f76c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:59.531650 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d08e09-bd95-495d-8215-78f810f76c59 admin admin] PATH_INFO: `/v3/users/d742f95d78044182bf271e18393e66d3` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:59.533917 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d08e09-bd95-495d-8215-78f810f76c59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d742f95d78044182bf271e18393e66d3)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:59.537731 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d08e09-bd95-495d-8215-78f810f76c59 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:59.542706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 04:59:59.626824 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-64d08e09-bd95-495d-8215-78f810f76c59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd742f95d78044182bf271e18393e66d3'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:59.638823 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-64d08e09-bd95-495d-8215-78f810f76c59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd742f95d78044182bf271e18393e66d3'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:59.654132 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-64d08e09-bd95-495d-8215-78f810f76c59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd742f95d78044182bf271e18393e66d3'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:59.662181 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-64d08e09-bd95-495d-8215-78f810f76c59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd742f95d78044182bf271e18393e66d3'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:59.662934 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-64d08e09-bd95-495d-8215-78f810f76c59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd742f95d78044182bf271e18393e66d3'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 04:59:59.669477 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1356/2726] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 04:59:59 2022] DELETE /identity/v3/users/d742f95d78044182bf271e18393e66d3 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 04:59:59.674965 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af7008-4ac9-4cf2-8676-ee1a1afa4195 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:59.675742 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af7008-4ac9-4cf2-8676-ee1a1afa4195 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:59.675742 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af7008-4ac9-4cf2-8676-ee1a1afa4195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:59.700357 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-82af7008-4ac9-4cf2-8676-ee1a1afa4195 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 04:59:59.702182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-82af7008-4ac9-4cf2-8676-ee1a1afa4195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:59.804237 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1371/2727] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 04:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 04:59:59.815963 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d08e09-bd95-495d-8215-78f810f76c59 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 04:59:59.817730 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-64d08e09-bd95-495d-8215-78f810f76c59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 04:59:59.921325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d08e09-bd95-495d-8215-78f810f76c59 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 04:59:59.927835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0ae7d-f69f-48ee-ab5a-0fe1ebae671f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 04:59:59.928832 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0ae7d-f69f-48ee-ab5a-0fe1ebae671f service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 04:59:59.929304 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0ae7d-f69f-48ee-ab5a-0fe1ebae671f service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 04:59:59.929761 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0ae7d-f69f-48ee-ab5a-0fe1ebae671f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 04:59:59.948119 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0ae7d-f69f-48ee-ab5a-0fe1ebae671f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 04:59:59.951052 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0ae7d-f69f-48ee-ab5a-0fe1ebae671f service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 04:59:59.972896 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1357/2728] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 04:59:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 05:00:00.546658 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af7008-4ac9-4cf2-8676-ee1a1afa4195 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:00.549966 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-82af7008-4ac9-4cf2-8676-ee1a1afa4195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:00.571575 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af7008-4ac9-4cf2-8676-ee1a1afa4195 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:00.578206 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f88055-0cfd-4c1d-83dc-b7ef561c335a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:00.580054 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f88055-0cfd-4c1d-83dc-b7ef561c335a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:00.580309 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f88055-0cfd-4c1d-83dc-b7ef561c335a admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:00.580662 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f88055-0cfd-4c1d-83dc-b7ef561c335a admin admin] PATH_INFO: `/v3/projects/6a6bcc2ef345435b965f190cdef82cea` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:00.582710 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f88055-0cfd-4c1d-83dc-b7ef561c335a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a6bcc2ef345435b965f190cdef82cea)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:00.584996 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f88055-0cfd-4c1d-83dc-b7ef561c335a admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:00.656034 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-85f88055-0cfd-4c1d-83dc-b7ef561c335a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a6bcc2ef345435b965f190cdef82cea', 'request_id': 'req-85f88055-0cfd-4c1d-83dc-b7ef561c335a'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:00.665845 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-85f88055-0cfd-4c1d-83dc-b7ef561c335a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a6bcc2ef345435b965f190cdef82cea', 'request_id': 'req-85f88055-0cfd-4c1d-83dc-b7ef561c335a'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:00.673642 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-85f88055-0cfd-4c1d-83dc-b7ef561c335a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a6bcc2ef345435b965f190cdef82cea', 'request_id': 'req-85f88055-0cfd-4c1d-83dc-b7ef561c335a'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:00.677330 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:00.697208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-85f88055-0cfd-4c1d-83dc-b7ef561c335a admin admin] The token cache is being invalidate because project 6a6bcc2ef345435b965f190cdef82cea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 05:00:00.697698 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-85f88055-0cfd-4c1d-83dc-b7ef561c335a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:00.698974 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-85f88055-0cfd-4c1d-83dc-b7ef561c335a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:00.701046 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1372/2729] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 05:00:00 2022] DELETE /identity/v3/projects/6a6bcc2ef345435b965f190cdef82cea => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:00.707435 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0ae7d-f69f-48ee-ab5a-0fe1ebae671f service neutron] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:00.720720 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0ae7d-f69f-48ee-ab5a-0fe1ebae671f service neutron] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:00.832036 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbf4c3-3dcb-4a80-a3fd-ffb9772c4d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:00.832628 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbf4c3-3dcb-4a80-a3fd-ffb9772c4d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:00.832879 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbf4c3-3dcb-4a80-a3fd-ffb9772c4d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:00.833160 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbf4c3-3dcb-4a80-a3fd-ffb9772c4d21 admin admin] PATH_INFO: `/v3/users/4c06b349c68749329936206ed0a3c65a` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:00.834738 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bbf4c3-3dcb-4a80-a3fd-ffb9772c4d21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c06b349c68749329936206ed0a3c65a)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:00.836897 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bbf4c3-3dcb-4a80-a3fd-ffb9772c4d21 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:00.873787 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:00.904126 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-07bbf4c3-3dcb-4a80-a3fd-ffb9772c4d21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c06b349c68749329936206ed0a3c65a'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:00.916048 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-07bbf4c3-3dcb-4a80-a3fd-ffb9772c4d21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c06b349c68749329936206ed0a3c65a'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:00.938618 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-07bbf4c3-3dcb-4a80-a3fd-ffb9772c4d21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c06b349c68749329936206ed0a3c65a'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:00.948262 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-07bbf4c3-3dcb-4a80-a3fd-ffb9772c4d21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c06b349c68749329936206ed0a3c65a'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:00.949224 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-07bbf4c3-3dcb-4a80-a3fd-ffb9772c4d21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c06b349c68749329936206ed0a3c65a'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:00.957386 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1358/2730] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 05:00:00 2022] DELETE /identity/v3/users/4c06b349c68749329936206ed0a3c65a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:01.501767 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f88055-0cfd-4c1d-83dc-b7ef561c335a admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:01.503825 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-85f88055-0cfd-4c1d-83dc-b7ef561c335a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:01.521688 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f88055-0cfd-4c1d-83dc-b7ef561c335a admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:01.641859 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4760eb-8ce4-4f9d-bfc0-516c9be08b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:01.643033 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4760eb-8ce4-4f9d-bfc0-516c9be08b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:01.643522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4760eb-8ce4-4f9d-bfc0-516c9be08b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:01.644257 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4760eb-8ce4-4f9d-bfc0-516c9be08b85 admin admin] PATH_INFO: `/v3/projects/95a3e3db602b4e91a36cdc479858e947` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:01.647208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4760eb-8ce4-4f9d-bfc0-516c9be08b85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95a3e3db602b4e91a36cdc479858e947)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:01.650876 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4760eb-8ce4-4f9d-bfc0-516c9be08b85 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:01.754060 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-df4760eb-8ce4-4f9d-bfc0-516c9be08b85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95a3e3db602b4e91a36cdc479858e947', 'request_id': 'req-df4760eb-8ce4-4f9d-bfc0-516c9be08b85'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:01.771419 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-df4760eb-8ce4-4f9d-bfc0-516c9be08b85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95a3e3db602b4e91a36cdc479858e947', 'request_id': 'req-df4760eb-8ce4-4f9d-bfc0-516c9be08b85'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:01.784629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-df4760eb-8ce4-4f9d-bfc0-516c9be08b85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95a3e3db602b4e91a36cdc479858e947', 'request_id': 'req-df4760eb-8ce4-4f9d-bfc0-516c9be08b85'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:01.807115 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-df4760eb-8ce4-4f9d-bfc0-516c9be08b85 admin admin] The token cache is being invalidate because project 95a3e3db602b4e91a36cdc479858e947 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 05:00:01.807620 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-df4760eb-8ce4-4f9d-bfc0-516c9be08b85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:01.808732 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-df4760eb-8ce4-4f9d-bfc0-516c9be08b85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:01.811905 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1373/2731] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 05:00:01 2022] DELETE /identity/v3/projects/95a3e3db602b4e91a36cdc479858e947 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:01.818644 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdcb6f-d1f2-4aa4-9ced-19bcda8f8832 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:01.819459 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdcb6f-d1f2-4aa4-9ced-19bcda8f8832 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:01.819459 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdcb6f-d1f2-4aa4-9ced-19bcda8f8832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:01.857731 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-60bdcb6f-d1f2-4aa4-9ced-19bcda8f8832 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:00:01.858942 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-60bdcb6f-d1f2-4aa4-9ced-19bcda8f8832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:01.932650 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1359/2732] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:00:01.942735 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041c054-e272-4695-8e2c-3e4b926f890d None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:01.943183 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041c054-e272-4695-8e2c-3e4b926f890d None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:01.943609 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041c054-e272-4695-8e2c-3e4b926f890d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:01.967563 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-3041c054-e272-4695-8e2c-3e4b926f890d None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:00:01.969045 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-3041c054-e272-4695-8e2c-3e4b926f890d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:01.978524 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1374/2733] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:00:01.985617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdcb6f-d1f2-4aa4-9ced-19bcda8f8832 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:02.004257 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdcb6f-d1f2-4aa4-9ced-19bcda8f8832 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:02.012214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd407e6-1efd-41de-9e4d-46668a371121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:02.013329 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd407e6-1efd-41de-9e4d-46668a371121 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:02.013835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd407e6-1efd-41de-9e4d-46668a371121 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:02.014354 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd407e6-1efd-41de-9e4d-46668a371121 admin admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:02.015752 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd407e6-1efd-41de-9e4d-46668a371121 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 05:00:02.016303 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd407e6-1efd-41de-9e4d-46668a371121 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:02.019652 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd407e6-1efd-41de-9e4d-46668a371121 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:02.044256 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1360/2734] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 05:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 05:00:02.049616 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041c054-e272-4695-8e2c-3e4b926f890d None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:02.060911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041c054-e272-4695-8e2c-3e4b926f890d None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:02.066749 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28248b-90c1-43fe-a7a3-ff2cac4c60d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:02.067589 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28248b-90c1-43fe-a7a3-ff2cac4c60d3 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:02.068063 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28248b-90c1-43fe-a7a3-ff2cac4c60d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:02.068459 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28248b-90c1-43fe-a7a3-ff2cac4c60d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:02.069239 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28248b-90c1-43fe-a7a3-ff2cac4c60d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:02.071553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28248b-90c1-43fe-a7a3-ff2cac4c60d3 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:02.105628 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1375/2735] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 05:00:02 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 05:00:02.112149 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd407e6-1efd-41de-9e4d-46668a371121 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:02.124539 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd407e6-1efd-41de-9e4d-46668a371121 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:02.194381 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f95d7f-18b6-4a16-9336-63b7019b349f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:02.195051 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f95d7f-18b6-4a16-9336-63b7019b349f admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:02.195370 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f95d7f-18b6-4a16-9336-63b7019b349f admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:02.195645 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f95d7f-18b6-4a16-9336-63b7019b349f admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:02.196347 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f95d7f-18b6-4a16-9336-63b7019b349f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:02.198390 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f95d7f-18b6-4a16-9336-63b7019b349f admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:02.227885 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1361/2736] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 05:00:02 2022] POST /identity/v3/users => generated 288 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 05:00:02.232928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28248b-90c1-43fe-a7a3-ff2cac4c60d3 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:02.245283 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28248b-90c1-43fe-a7a3-ff2cac4c60d3 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:02.252049 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca7b203-9062-4913-905b-624db8741d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:02.253182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7b203-9062-4913-905b-624db8741d38 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:02.253692 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7b203-9062-4913-905b-624db8741d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:02.254114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca7b203-9062-4913-905b-624db8741d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:02.255196 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca7b203-9062-4913-905b-624db8741d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:02.257035 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca7b203-9062-4913-905b-624db8741d38 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:02.269936 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1376/2737] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 05:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 05:00:02.274042 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f95d7f-18b6-4a16-9336-63b7019b349f admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:02.286236 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f95d7f-18b6-4a16-9336-63b7019b349f admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:02.291884 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80aa504-2718-4354-b81e-5e506cab1976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:02.292546 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80aa504-2718-4354-b81e-5e506cab1976 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:02.292827 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80aa504-2718-4354-b81e-5e506cab1976 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:02.293103 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80aa504-2718-4354-b81e-5e506cab1976 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:02.293862 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80aa504-2718-4354-b81e-5e506cab1976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:02.295593 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80aa504-2718-4354-b81e-5e506cab1976 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:02.308779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1362/2738] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 05:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 05:00:02.313471 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca7b203-9062-4913-905b-624db8741d38 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:02.325318 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca7b203-9062-4913-905b-624db8741d38 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:02.330663 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c9efc-31c4-405b-95bd-790c9d0ae303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:02.331415 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c9efc-31c4-405b-95bd-790c9d0ae303 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:02.331708 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c9efc-31c4-405b-95bd-790c9d0ae303 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:02.331984 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c9efc-31c4-405b-95bd-790c9d0ae303 admin admin] PATH_INFO: `/v3/projects/7a5708d5324c4ed79d33d8348a5f9778/users/4a88c022cdb240cfabf4d2b3a8d6a7b1/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:02.349699 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c9efc-31c4-405b-95bd-790c9d0ae303 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a5708d5324c4ed79d33d8348a5f9778, user_id=4a88c022cdb240cfabf4d2b3a8d6a7b1, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:02.352682 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c9efc-31c4-405b-95bd-790c9d0ae303 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:02.368835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1377/2739] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 05:00:02 2022] PUT /identity/v3/projects/7a5708d5324c4ed79d33d8348a5f9778/users/4a88c022cdb240cfabf4d2b3a8d6a7b1/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:02.382134 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c359db-b0ab-43dc-adec-e17f5466c374 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:02.382601 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c359db-b0ab-43dc-adec-e17f5466c374 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:02.383027 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c359db-b0ab-43dc-adec-e17f5466c374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:02.407456 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:02.421642 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-e2c359db-b0ab-43dc-adec-e17f5466c374 None None] MFA Rules not processed for user `4a88c022cdb240cfabf4d2b3a8d6a7b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:00:02.423025 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-e2c359db-b0ab-43dc-adec-e17f5466c374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:02.500654 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1363/2740] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:00:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:00:02.506047 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c9efc-31c4-405b-95bd-790c9d0ae303 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:02.551281 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:02.607934 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c9efc-31c4-405b-95bd-790c9d0ae303 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:02.615976 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05024a0-1c53-48da-805b-8c05efdad29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:02.617033 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05024a0-1c53-48da-805b-8c05efdad29f admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:02.617522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05024a0-1c53-48da-805b-8c05efdad29f admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:02.618067 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05024a0-1c53-48da-805b-8c05efdad29f admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:02.619425 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05024a0-1c53-48da-805b-8c05efdad29f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:02.623298 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05024a0-1c53-48da-805b-8c05efdad29f admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:02.667716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1378/2741] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 05:00:02 2022] POST /identity/v3/projects => generated 379 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 05:00:02.673418 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c359db-b0ab-43dc-adec-e17f5466c374 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:02.685408 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c359db-b0ab-43dc-adec-e17f5466c374 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:02.769425 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e2732-d9b9-4b69-bdb8-0fca9a1c17da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:02.770108 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e2732-d9b9-4b69-bdb8-0fca9a1c17da admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:02.770379 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e2732-d9b9-4b69-bdb8-0fca9a1c17da admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:02.770692 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e2732-d9b9-4b69-bdb8-0fca9a1c17da admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:02.771388 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e2732-d9b9-4b69-bdb8-0fca9a1c17da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:02.773464 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907e2732-d9b9-4b69-bdb8-0fca9a1c17da admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:02.799714 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1364/2742] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 05:00:02 2022] POST /identity/v3/users => generated 296 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 05:00:02.803404 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05024a0-1c53-48da-805b-8c05efdad29f admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:02.815397 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05024a0-1c53-48da-805b-8c05efdad29f admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:02.820735 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e228c-5dfd-4863-845c-f33663264f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:02.821503 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e228c-5dfd-4863-845c-f33663264f2c admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:02.821889 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e228c-5dfd-4863-845c-f33663264f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:02.822350 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e228c-5dfd-4863-845c-f33663264f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:02.823226 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e228c-5dfd-4863-845c-f33663264f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:02.825029 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e228c-5dfd-4863-845c-f33663264f2c admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:02.973929 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1379/2743] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 05:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 05:00:02.981359 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e2732-d9b9-4b69-bdb8-0fca9a1c17da admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:03.000445 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e2732-d9b9-4b69-bdb8-0fca9a1c17da admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:03.010214 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbf600-1490-4c3a-bd5f-36bff307bd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:03.010925 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbf600-1490-4c3a-bd5f-36bff307bd00 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:03.011217 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbf600-1490-4c3a-bd5f-36bff307bd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:03.011490 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbf600-1490-4c3a-bd5f-36bff307bd00 admin admin] PATH_INFO: `/v3/projects/2b97a15a779d4f5c9c6833af54b1b4b3/users/5c58903c4aec4cf3acb455557ffd3640/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:03.044301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbf600-1490-4c3a-bd5f-36bff307bd00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b97a15a779d4f5c9c6833af54b1b4b3, user_id=5c58903c4aec4cf3acb455557ffd3640, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:03.050140 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbf600-1490-4c3a-bd5f-36bff307bd00 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:03.075227 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1365/2744] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 05:00:02 2022] PUT /identity/v3/projects/2b97a15a779d4f5c9c6833af54b1b4b3/users/5c58903c4aec4cf3acb455557ffd3640/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:03.079393 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e228c-5dfd-4863-845c-f33663264f2c admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:03.096187 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e228c-5dfd-4863-845c-f33663264f2c admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:03.207269 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3fbf9d-a5d7-481c-8496-b1816f12acef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:03.207768 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fbf9d-a5d7-481c-8496-b1816f12acef admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:03.208220 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fbf9d-a5d7-481c-8496-b1816f12acef admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:03.210775 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3fbf9d-a5d7-481c-8496-b1816f12acef admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:03.210775 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3fbf9d-a5d7-481c-8496-b1816f12acef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:03.212871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3fbf9d-a5d7-481c-8496-b1816f12acef admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:03.231413 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1380/2745] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 05:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 05:00:03.232753 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbf600-1490-4c3a-bd5f-36bff307bd00 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:03.246093 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbf600-1490-4c3a-bd5f-36bff307bd00 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:03.252015 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5fa2e0-e922-4a44-b2c5-5cdca49bbc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:03.252856 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fa2e0-e922-4a44-b2c5-5cdca49bbc05 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:03.253054 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fa2e0-e922-4a44-b2c5-5cdca49bbc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:03.253231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fa2e0-e922-4a44-b2c5-5cdca49bbc05 admin admin] PATH_INFO: `/v3/projects/2b97a15a779d4f5c9c6833af54b1b4b3/users/5c58903c4aec4cf3acb455557ffd3640/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:03.255592 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5fa2e0-e922-4a44-b2c5-5cdca49bbc05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b97a15a779d4f5c9c6833af54b1b4b3, user_id=5c58903c4aec4cf3acb455557ffd3640, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:03.258476 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5fa2e0-e922-4a44-b2c5-5cdca49bbc05 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:03.287729 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1366/2746] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 05:00:03 2022] PUT /identity/v3/projects/2b97a15a779d4f5c9c6833af54b1b4b3/users/5c58903c4aec4cf3acb455557ffd3640/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 05:00:03.301667 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f597bb-3a14-4516-ad94-3b8ddafdd828 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:03.303234 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f597bb-3a14-4516-ad94-3b8ddafdd828 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:03.303234 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f597bb-3a14-4516-ad94-3b8ddafdd828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:03.338769 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-81f597bb-3a14-4516-ad94-3b8ddafdd828 None None] MFA Rules not processed for user `5c58903c4aec4cf3acb455557ffd3640`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:00:03.341139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-81f597bb-3a14-4516-ad94-3b8ddafdd828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:03.450934 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1381/2747] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:00:03 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:00:03.464679 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5fa2e0-e922-4a44-b2c5-5cdca49bbc05 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:03.466931 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-8c5fa2e0-e922-4a44-b2c5-5cdca49bbc05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:03.538669 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5fa2e0-e922-4a44-b2c5-5cdca49bbc05 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:03.542839 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da4c9a-0ef1-484c-85ed-d6ceb6f83615 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:03.543513 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da4c9a-0ef1-484c-85ed-d6ceb6f83615 service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:03.543794 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da4c9a-0ef1-484c-85ed-d6ceb6f83615 service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:03.544067 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da4c9a-0ef1-484c-85ed-d6ceb6f83615 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:03.549513 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:03.616422 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da4c9a-0ef1-484c-85ed-d6ceb6f83615 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:03.617908 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da4c9a-0ef1-484c-85ed-d6ceb6f83615 service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:03.628865 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1367/2748] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 05:00:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 05:00:05.207305 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f597bb-3a14-4516-ad94-3b8ddafdd828 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:05.218537 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f597bb-3a14-4516-ad94-3b8ddafdd828 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:05.224521 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16431c89-f951-4dbb-ad12-84112507b272 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:05.226739 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16431c89-f951-4dbb-ad12-84112507b272 service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:05.227953 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16431c89-f951-4dbb-ad12-84112507b272 service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:05.228680 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16431c89-f951-4dbb-ad12-84112507b272 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:05.245938 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16431c89-f951-4dbb-ad12-84112507b272 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:05.249210 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16431c89-f951-4dbb-ad12-84112507b272 service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:05.271574 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1382/2749] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 05:00:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 05:00:06.645465 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da4c9a-0ef1-484c-85ed-d6ceb6f83615 service cinder] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:06.648097 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-c7da4c9a-0ef1-484c-85ed-d6ceb6f83615 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:06.771438 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da4c9a-0ef1-484c-85ed-d6ceb6f83615 service cinder] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:06.779859 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c922a4-27c4-4041-82fa-95f4864b709f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:06.780988 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c922a4-27c4-4041-82fa-95f4864b709f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:06.781455 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c922a4-27c4-4041-82fa-95f4864b709f admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:06.781936 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c922a4-27c4-4041-82fa-95f4864b709f admin admin] PATH_INFO: `/v3/users/acb1d598f8ab48eeb9a5a274bb6533ed` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:06.784032 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c922a4-27c4-4041-82fa-95f4864b709f admin admin] RBAC: Authorizing `identity:delete_user(user_id=acb1d598f8ab48eeb9a5a274bb6533ed)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:06.787757 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c922a4-27c4-4041-82fa-95f4864b709f admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:06.866929 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-b6c922a4-27c4-4041-82fa-95f4864b709f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acb1d598f8ab48eeb9a5a274bb6533ed'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:06.878571 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-b6c922a4-27c4-4041-82fa-95f4864b709f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acb1d598f8ab48eeb9a5a274bb6533ed'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:06.901144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-b6c922a4-27c4-4041-82fa-95f4864b709f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acb1d598f8ab48eeb9a5a274bb6533ed'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:06.913338 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-b6c922a4-27c4-4041-82fa-95f4864b709f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acb1d598f8ab48eeb9a5a274bb6533ed'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:06.914279 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-b6c922a4-27c4-4041-82fa-95f4864b709f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acb1d598f8ab48eeb9a5a274bb6533ed'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:06.927457 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1368/2750] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 05:00:06 2022] DELETE /identity/v3/users/acb1d598f8ab48eeb9a5a274bb6533ed => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:06.933167 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742d7bb-985c-4376-b92a-4374ba8d0172 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:06.934095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742d7bb-985c-4376-b92a-4374ba8d0172 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:06.934475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742d7bb-985c-4376-b92a-4374ba8d0172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:06.950183 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:06.973716 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-5742d7bb-985c-4376-b92a-4374ba8d0172 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:00:06.975930 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-5742d7bb-985c-4376-b92a-4374ba8d0172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:07.059249 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1383/2751] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:00:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 05:00:07.069963 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c922a4-27c4-4041-82fa-95f4864b709f admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:07.071746 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-b6c922a4-27c4-4041-82fa-95f4864b709f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:07.113879 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:07.159810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c922a4-27c4-4041-82fa-95f4864b709f admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:07.164065 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb2233-4c13-4850-bf26-ea0a67ca66d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:07.164837 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb2233-4c13-4850-bf26-ea0a67ca66d8 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:07.165212 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb2233-4c13-4850-bf26-ea0a67ca66d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:07.165601 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb2233-4c13-4850-bf26-ea0a67ca66d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:07.176998 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb2233-4c13-4850-bf26-ea0a67ca66d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:07.178506 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb2233-4c13-4850-bf26-ea0a67ca66d8 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:07.189636 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1369/2752] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 05:00:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 05:00:07.590232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742d7bb-985c-4376-b92a-4374ba8d0172 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:07.593927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-5742d7bb-985c-4376-b92a-4374ba8d0172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:07.620435 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742d7bb-985c-4376-b92a-4374ba8d0172 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:07.633138 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74876e4-cd7f-4050-81aa-2cc4ae1c5c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:07.634369 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74876e4-cd7f-4050-81aa-2cc4ae1c5c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:07.634870 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74876e4-cd7f-4050-81aa-2cc4ae1c5c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:07.635362 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74876e4-cd7f-4050-81aa-2cc4ae1c5c4a admin admin] PATH_INFO: `/v3/projects/17012cd699d5460097c088c93352ab65` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:07.637934 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74876e4-cd7f-4050-81aa-2cc4ae1c5c4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=17012cd699d5460097c088c93352ab65)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:07.641643 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74876e4-cd7f-4050-81aa-2cc4ae1c5c4a admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:07.709875 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-c74876e4-cd7f-4050-81aa-2cc4ae1c5c4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17012cd699d5460097c088c93352ab65', 'request_id': 'req-c74876e4-cd7f-4050-81aa-2cc4ae1c5c4a'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:07.724320 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-c74876e4-cd7f-4050-81aa-2cc4ae1c5c4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17012cd699d5460097c088c93352ab65', 'request_id': 'req-c74876e4-cd7f-4050-81aa-2cc4ae1c5c4a'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:07.732990 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-c74876e4-cd7f-4050-81aa-2cc4ae1c5c4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17012cd699d5460097c088c93352ab65', 'request_id': 'req-c74876e4-cd7f-4050-81aa-2cc4ae1c5c4a'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:07.748124 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-c74876e4-cd7f-4050-81aa-2cc4ae1c5c4a admin admin] The token cache is being invalidate because project 17012cd699d5460097c088c93352ab65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 05:00:07.748418 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-c74876e4-cd7f-4050-81aa-2cc4ae1c5c4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:07.749096 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-c74876e4-cd7f-4050-81aa-2cc4ae1c5c4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:07.750738 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1384/2753] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 05:00:07 2022] DELETE /identity/v3/projects/17012cd699d5460097c088c93352ab65 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:07.756579 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe4367-41d6-4b29-816d-115beb49d231 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:07.757405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe4367-41d6-4b29-816d-115beb49d231 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:07.757632 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe4367-41d6-4b29-816d-115beb49d231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:07.782899 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-92fe4367-41d6-4b29-816d-115beb49d231 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:00:07.784323 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-92fe4367-41d6-4b29-816d-115beb49d231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:07.883843 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1370/2754] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:00:07.887082 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc346aa2-e3a5-4ac1-a2f6-09053c854edf None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:07.887855 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc346aa2-e3a5-4ac1-a2f6-09053c854edf None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:07.888424 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc346aa2-e3a5-4ac1-a2f6-09053c854edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:07.914495 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-dc346aa2-e3a5-4ac1-a2f6-09053c854edf None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:00:07.916095 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-dc346aa2-e3a5-4ac1-a2f6-09053c854edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:07.925872 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1385/2755] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:00:07.931871 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe4367-41d6-4b29-816d-115beb49d231 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:07.950184 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe4367-41d6-4b29-816d-115beb49d231 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:07.956454 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2783a8-3ce3-47b2-a177-648295c151ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:07.957322 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2783a8-3ce3-47b2-a177-648295c151ad admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:07.957660 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2783a8-3ce3-47b2-a177-648295c151ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:07.957968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2783a8-3ce3-47b2-a177-648295c151ad admin admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:07.959061 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2783a8-3ce3-47b2-a177-648295c151ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 05:00:07.959556 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2783a8-3ce3-47b2-a177-648295c151ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:07.961483 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2783a8-3ce3-47b2-a177-648295c151ad admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:07.980170 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1371/2756] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 05:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 05:00:07.985621 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc346aa2-e3a5-4ac1-a2f6-09053c854edf None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:07.999957 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc346aa2-e3a5-4ac1-a2f6-09053c854edf None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:08.007809 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016f349-86bb-43a2-91f2-dee049d6af11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:08.008309 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016f349-86bb-43a2-91f2-dee049d6af11 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:08.010030 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016f349-86bb-43a2-91f2-dee049d6af11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:08.010030 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016f349-86bb-43a2-91f2-dee049d6af11 admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:08.010837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016f349-86bb-43a2-91f2-dee049d6af11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:08.013652 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016f349-86bb-43a2-91f2-dee049d6af11 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:08.090961 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1386/2757] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 05:00:07 2022] POST /identity/v3/projects => generated 391 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 05:00:08.094177 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2783a8-3ce3-47b2-a177-648295c151ad admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:08.114506 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2783a8-3ce3-47b2-a177-648295c151ad admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:08.257457 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463237c-3bea-4fe5-abbc-8ab71e194652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:08.258602 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463237c-3bea-4fe5-abbc-8ab71e194652 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:08.259129 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463237c-3bea-4fe5-abbc-8ab71e194652 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:08.259576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463237c-3bea-4fe5-abbc-8ab71e194652 admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:08.266917 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463237c-3bea-4fe5-abbc-8ab71e194652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:08.270587 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463237c-3bea-4fe5-abbc-8ab71e194652 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:08.314896 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1372/2758] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 05:00:08 2022] POST /identity/v3/users => generated 296 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 05:00:08.316711 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016f349-86bb-43a2-91f2-dee049d6af11 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:08.332359 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016f349-86bb-43a2-91f2-dee049d6af11 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:08.341114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c490b-55e2-48d6-8b8d-5912d1628098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:08.341923 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c490b-55e2-48d6-8b8d-5912d1628098 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:08.342242 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c490b-55e2-48d6-8b8d-5912d1628098 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:08.342785 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c490b-55e2-48d6-8b8d-5912d1628098 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:08.343828 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c490b-55e2-48d6-8b8d-5912d1628098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:08.346531 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c490b-55e2-48d6-8b8d-5912d1628098 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:08.378560 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1387/2759] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 05:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 05:00:08.381965 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463237c-3bea-4fe5-abbc-8ab71e194652 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:08.406387 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463237c-3bea-4fe5-abbc-8ab71e194652 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:08.417927 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f96551-8fa5-403c-93e6-3069455eaf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:08.418831 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f96551-8fa5-403c-93e6-3069455eaf78 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:08.419245 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f96551-8fa5-403c-93e6-3069455eaf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:08.419657 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f96551-8fa5-403c-93e6-3069455eaf78 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:08.420847 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f96551-8fa5-403c-93e6-3069455eaf78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:08.424018 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f96551-8fa5-403c-93e6-3069455eaf78 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:08.444641 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1373/2760] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 05:00:08 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 05:00:08.449710 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c490b-55e2-48d6-8b8d-5912d1628098 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:08.463440 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c490b-55e2-48d6-8b8d-5912d1628098 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:08.469905 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3202b0b-2c89-455c-b9ff-a26b769e7722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:08.471070 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3202b0b-2c89-455c-b9ff-a26b769e7722 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:08.471625 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3202b0b-2c89-455c-b9ff-a26b769e7722 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:08.472074 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3202b0b-2c89-455c-b9ff-a26b769e7722 admin admin] PATH_INFO: `/v3/projects/45f9aea005c149f792103b660bc0e443/users/ca6f99a13aba40abbd993a7bf6429746/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:08.496561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3202b0b-2c89-455c-b9ff-a26b769e7722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45f9aea005c149f792103b660bc0e443, user_id=ca6f99a13aba40abbd993a7bf6429746, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:08.500007 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3202b0b-2c89-455c-b9ff-a26b769e7722 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:08.529183 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1388/2761] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 05:00:08 2022] PUT /identity/v3/projects/45f9aea005c149f792103b660bc0e443/users/ca6f99a13aba40abbd993a7bf6429746/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:08.543606 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd89fd-8f8f-4e4c-a0ab-97d8a052d7cd None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:08.544137 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd89fd-8f8f-4e4c-a0ab-97d8a052d7cd None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:08.544616 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd89fd-8f8f-4e4c-a0ab-97d8a052d7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:08.606560 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-9bdd89fd-8f8f-4e4c-a0ab-97d8a052d7cd None None] MFA Rules not processed for user `ca6f99a13aba40abbd993a7bf6429746`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:00:08.608608 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-9bdd89fd-8f8f-4e4c-a0ab-97d8a052d7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:08.639490 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:08.718032 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1374/2762] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:00:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:00:08.727553 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3202b0b-2c89-455c-b9ff-a26b769e7722 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:08.729927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-c3202b0b-2c89-455c-b9ff-a26b769e7722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:08.770535 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:08.821096 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3202b0b-2c89-455c-b9ff-a26b769e7722 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:08.825225 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d7c6b-f016-4925-8915-f7020d322c10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:08.825892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d7c6b-f016-4925-8915-f7020d322c10 service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:08.826208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d7c6b-f016-4925-8915-f7020d322c10 service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:08.827159 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d7c6b-f016-4925-8915-f7020d322c10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:08.837517 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d7c6b-f016-4925-8915-f7020d322c10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:08.839086 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d7c6b-f016-4925-8915-f7020d322c10 service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:08.850959 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1389/2763] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 05:00:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 05:00:09.532496 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd89fd-8f8f-4e4c-a0ab-97d8a052d7cd None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:09.535279 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-9bdd89fd-8f8f-4e4c-a0ab-97d8a052d7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:09.584079 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820f9bb-5591-4158-b57a-f17ac63ad225 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:09.585299 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820f9bb-5591-4158-b57a-f17ac63ad225 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:09.585299 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820f9bb-5591-4158-b57a-f17ac63ad225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:09.617103 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-2820f9bb-5591-4158-b57a-f17ac63ad225 None None] MFA Rules not processed for user `4128804de02b42bc81bb2950cb698b3c`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:00:09.619113 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-2820f9bb-5591-4158-b57a-f17ac63ad225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:09.646489 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd89fd-8f8f-4e4c-a0ab-97d8a052d7cd None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:09.651518 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792f921-1070-44d8-8cd8-cb1836b404ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:09.652201 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792f921-1070-44d8-8cd8-cb1836b404ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:09.652479 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792f921-1070-44d8-8cd8-cb1836b404ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:09.652749 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792f921-1070-44d8-8cd8-cb1836b404ac admin admin] PATH_INFO: `/v3/users/4a88c022cdb240cfabf4d2b3a8d6a7b1` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:09.654103 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792f921-1070-44d8-8cd8-cb1836b404ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a88c022cdb240cfabf4d2b3a8d6a7b1)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:09.656101 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792f921-1070-44d8-8cd8-cb1836b404ac admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:09.708539 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1390/2764] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:00:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 05:00:09.727003 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-9792f921-1070-44d8-8cd8-cb1836b404ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a88c022cdb240cfabf4d2b3a8d6a7b1'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:09.739807 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-9792f921-1070-44d8-8cd8-cb1836b404ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a88c022cdb240cfabf4d2b3a8d6a7b1'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:09.757679 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-9792f921-1070-44d8-8cd8-cb1836b404ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a88c022cdb240cfabf4d2b3a8d6a7b1'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:09.769734 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-9792f921-1070-44d8-8cd8-cb1836b404ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a88c022cdb240cfabf4d2b3a8d6a7b1'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:09.770762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-9792f921-1070-44d8-8cd8-cb1836b404ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a88c022cdb240cfabf4d2b3a8d6a7b1'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:09.780598 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1375/2765] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 05:00:09 2022] DELETE /identity/v3/users/4a88c022cdb240cfabf4d2b3a8d6a7b1 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:09.786655 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03116361-bebf-4a03-8b03-577c0f205319 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:09.787104 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03116361-bebf-4a03-8b03-577c0f205319 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:09.787544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03116361-bebf-4a03-8b03-577c0f205319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:09.815700 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-03116361-bebf-4a03-8b03-577c0f205319 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:00:09.817255 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-03116361-bebf-4a03-8b03-577c0f205319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:09.907126 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1391/2766] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:00:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:00:09.918954 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792f921-1070-44d8-8cd8-cb1836b404ac admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:09.921509 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-9792f921-1070-44d8-8cd8-cb1836b404ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:09.985607 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:10.004984 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792f921-1070-44d8-8cd8-cb1836b404ac admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:10.009061 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9723249-25d6-4e6f-9549-f87836d41976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:10.009722 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9723249-25d6-4e6f-9549-f87836d41976 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:10.010206 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9723249-25d6-4e6f-9549-f87836d41976 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:10.010391 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9723249-25d6-4e6f-9549-f87836d41976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:10.021879 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9723249-25d6-4e6f-9549-f87836d41976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:10.023562 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9723249-25d6-4e6f-9549-f87836d41976 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:10.036518 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1376/2767] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 05:00:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 05:00:10.437956 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03116361-bebf-4a03-8b03-577c0f205319 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:10.440601 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-03116361-bebf-4a03-8b03-577c0f205319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:10.457062 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03116361-bebf-4a03-8b03-577c0f205319 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:10.482315 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e742b8-b310-4ccb-b388-dc9ebd4cf8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:10.483584 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e742b8-b310-4ccb-b388-dc9ebd4cf8cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:10.484077 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e742b8-b310-4ccb-b388-dc9ebd4cf8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:10.484536 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e742b8-b310-4ccb-b388-dc9ebd4cf8cf admin admin] PATH_INFO: `/v3/projects/7a5708d5324c4ed79d33d8348a5f9778` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:10.490535 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e742b8-b310-4ccb-b388-dc9ebd4cf8cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a5708d5324c4ed79d33d8348a5f9778)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:10.494873 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e742b8-b310-4ccb-b388-dc9ebd4cf8cf admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:10.589780 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-f2e742b8-b310-4ccb-b388-dc9ebd4cf8cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a5708d5324c4ed79d33d8348a5f9778', 'request_id': 'req-f2e742b8-b310-4ccb-b388-dc9ebd4cf8cf'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:10.603291 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-f2e742b8-b310-4ccb-b388-dc9ebd4cf8cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a5708d5324c4ed79d33d8348a5f9778', 'request_id': 'req-f2e742b8-b310-4ccb-b388-dc9ebd4cf8cf'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:10.630560 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-f2e742b8-b310-4ccb-b388-dc9ebd4cf8cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a5708d5324c4ed79d33d8348a5f9778', 'request_id': 'req-f2e742b8-b310-4ccb-b388-dc9ebd4cf8cf'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:10.635082 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:10.676952 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-f2e742b8-b310-4ccb-b388-dc9ebd4cf8cf admin admin] The token cache is being invalidate because project 7a5708d5324c4ed79d33d8348a5f9778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 05:00:10.677642 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-f2e742b8-b310-4ccb-b388-dc9ebd4cf8cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:10.678670 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-f2e742b8-b310-4ccb-b388-dc9ebd4cf8cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:10.681676 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1392/2768] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 05:00:10 2022] DELETE /identity/v3/projects/7a5708d5324c4ed79d33d8348a5f9778 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 05:00:10.687963 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9723249-25d6-4e6f-9549-f87836d41976 service neutron] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:10.733838 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9723249-25d6-4e6f-9549-f87836d41976 service neutron] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:10.840216 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134f49a-8e7d-4948-9e30-a3883d11244a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:10.841672 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134f49a-8e7d-4948-9e30-a3883d11244a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:10.842466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134f49a-8e7d-4948-9e30-a3883d11244a admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:10.843534 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134f49a-8e7d-4948-9e30-a3883d11244a admin admin] PATH_INFO: `/v3/users/5c58903c4aec4cf3acb455557ffd3640` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:10.845862 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134f49a-8e7d-4948-9e30-a3883d11244a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c58903c4aec4cf3acb455557ffd3640)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:10.849544 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134f49a-8e7d-4948-9e30-a3883d11244a admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:10.922448 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-7134f49a-8e7d-4948-9e30-a3883d11244a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c58903c4aec4cf3acb455557ffd3640'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:10.932685 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-7134f49a-8e7d-4948-9e30-a3883d11244a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c58903c4aec4cf3acb455557ffd3640'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:10.953603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-7134f49a-8e7d-4948-9e30-a3883d11244a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c58903c4aec4cf3acb455557ffd3640'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:10.965835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-7134f49a-8e7d-4948-9e30-a3883d11244a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c58903c4aec4cf3acb455557ffd3640'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:10.967177 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-7134f49a-8e7d-4948-9e30-a3883d11244a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c58903c4aec4cf3acb455557ffd3640'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:10.981585 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1377/2769] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 05:00:10 2022] DELETE /identity/v3/users/5c58903c4aec4cf3acb455557ffd3640 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:11.369103 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e742b8-b310-4ccb-b388-dc9ebd4cf8cf admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:11.371247 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-f2e742b8-b310-4ccb-b388-dc9ebd4cf8cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:11.393919 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e742b8-b310-4ccb-b388-dc9ebd4cf8cf admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:11.504593 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a429dc5-47a6-4b10-8bcc-94d280863498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:11.505757 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a429dc5-47a6-4b10-8bcc-94d280863498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:11.507161 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a429dc5-47a6-4b10-8bcc-94d280863498 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:11.507689 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a429dc5-47a6-4b10-8bcc-94d280863498 admin admin] PATH_INFO: `/v3/projects/2b97a15a779d4f5c9c6833af54b1b4b3` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:11.510337 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a429dc5-47a6-4b10-8bcc-94d280863498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b97a15a779d4f5c9c6833af54b1b4b3)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:11.513529 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a429dc5-47a6-4b10-8bcc-94d280863498 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:11.577789 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-3a429dc5-47a6-4b10-8bcc-94d280863498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b97a15a779d4f5c9c6833af54b1b4b3', 'request_id': 'req-3a429dc5-47a6-4b10-8bcc-94d280863498'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:11.588310 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-3a429dc5-47a6-4b10-8bcc-94d280863498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b97a15a779d4f5c9c6833af54b1b4b3', 'request_id': 'req-3a429dc5-47a6-4b10-8bcc-94d280863498'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:11.596963 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-3a429dc5-47a6-4b10-8bcc-94d280863498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b97a15a779d4f5c9c6833af54b1b4b3', 'request_id': 'req-3a429dc5-47a6-4b10-8bcc-94d280863498'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:11.610845 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-3a429dc5-47a6-4b10-8bcc-94d280863498 admin admin] The token cache is being invalidate because project 2b97a15a779d4f5c9c6833af54b1b4b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 05:00:11.611140 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-3a429dc5-47a6-4b10-8bcc-94d280863498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:11.612094 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-3a429dc5-47a6-4b10-8bcc-94d280863498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:11.614616 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1393/2770] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 05:00:11 2022] DELETE /identity/v3/projects/2b97a15a779d4f5c9c6833af54b1b4b3 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:11.620284 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d85b9-0310-4d02-8cd2-54728ed069ab None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:11.620549 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d85b9-0310-4d02-8cd2-54728ed069ab None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:11.620971 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d85b9-0310-4d02-8cd2-54728ed069ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:11.647410 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-4a1d85b9-0310-4d02-8cd2-54728ed069ab None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:00:11.648862 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-4a1d85b9-0310-4d02-8cd2-54728ed069ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:11.741813 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1378/2771] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:00:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:00:11.751693 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92681a-0542-4b83-a6df-972a41aa401f None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:11.752039 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92681a-0542-4b83-a6df-972a41aa401f None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:11.752436 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd92681a-0542-4b83-a6df-972a41aa401f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:11.776019 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-dd92681a-0542-4b83-a6df-972a41aa401f None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:00:11.777630 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-dd92681a-0542-4b83-a6df-972a41aa401f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:11.788846 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1394/2772] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:00:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:00:11.796678 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d85b9-0310-4d02-8cd2-54728ed069ab None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:11.810893 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:11.821543 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d85b9-0310-4d02-8cd2-54728ed069ab None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:11.831482 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd771703-3e3b-40fa-a952-60cc02e1cf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:11.832352 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd771703-3e3b-40fa-a952-60cc02e1cf49 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:11.832609 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd771703-3e3b-40fa-a952-60cc02e1cf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:11.833222 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd771703-3e3b-40fa-a952-60cc02e1cf49 admin admin] PATH_INFO: `/v3/domains` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:11.833954 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd771703-3e3b-40fa-a952-60cc02e1cf49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86745) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 05:00:11.834306 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd771703-3e3b-40fa-a952-60cc02e1cf49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:11.836638 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd771703-3e3b-40fa-a952-60cc02e1cf49 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:11.854567 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1379/2773] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 05:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 05:00:11.861758 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92681a-0542-4b83-a6df-972a41aa401f None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:11.888067 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd92681a-0542-4b83-a6df-972a41aa401f None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:11.896218 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d359efe-f632-468a-bd61-210953e874d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:11.897592 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d359efe-f632-468a-bd61-210953e874d1 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:11.898323 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d359efe-f632-468a-bd61-210953e874d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:11.899038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d359efe-f632-468a-bd61-210953e874d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:11.900208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d359efe-f632-468a-bd61-210953e874d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:11.903604 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d359efe-f632-468a-bd61-210953e874d1 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:11.962550 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1395/2774] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 05:00:11 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 05:00:11.967926 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd771703-3e3b-40fa-a952-60cc02e1cf49 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:11.988997 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd771703-3e3b-40fa-a952-60cc02e1cf49 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:12.109395 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f2a51-c53a-4fd5-91cf-bb59c8d331ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:12.110321 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f2a51-c53a-4fd5-91cf-bb59c8d331ec admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:12.110630 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f2a51-c53a-4fd5-91cf-bb59c8d331ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:12.110865 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f2a51-c53a-4fd5-91cf-bb59c8d331ec admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:12.111792 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f2a51-c53a-4fd5-91cf-bb59c8d331ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:12.113835 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f2a51-c53a-4fd5-91cf-bb59c8d331ec admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:12.150070 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1380/2775] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 05:00:11 2022] POST /identity/v3/users => generated 291 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 05:00:12.156804 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d359efe-f632-468a-bd61-210953e874d1 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:12.174469 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d359efe-f632-468a-bd61-210953e874d1 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:12.180911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039a96f-2703-4f6c-97bb-b8420e8c9598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:12.181651 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039a96f-2703-4f6c-97bb-b8420e8c9598 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:12.181837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039a96f-2703-4f6c-97bb-b8420e8c9598 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:12.182223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039a96f-2703-4f6c-97bb-b8420e8c9598 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:12.182960 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039a96f-2703-4f6c-97bb-b8420e8c9598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:12.184696 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039a96f-2703-4f6c-97bb-b8420e8c9598 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:12.205559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1396/2776] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 05:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 05:00:12.209892 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f2a51-c53a-4fd5-91cf-bb59c8d331ec admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:12.242303 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f2a51-c53a-4fd5-91cf-bb59c8d331ec admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:12.250815 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468469e1-da84-4dca-b8b6-2b882b3c4df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:12.251883 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468469e1-da84-4dca-b8b6-2b882b3c4df4 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:12.252425 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468469e1-da84-4dca-b8b6-2b882b3c4df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:12.252918 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468469e1-da84-4dca-b8b6-2b882b3c4df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:12.254281 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468469e1-da84-4dca-b8b6-2b882b3c4df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:12.257418 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468469e1-da84-4dca-b8b6-2b882b3c4df4 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:12.280148 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1381/2777] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 05:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 05:00:12.284442 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039a96f-2703-4f6c-97bb-b8420e8c9598 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:12.299042 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039a96f-2703-4f6c-97bb-b8420e8c9598 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:12.307371 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2e1f0-4ed1-4f4d-949a-c5be3ad847e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:12.308711 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2e1f0-4ed1-4f4d-949a-c5be3ad847e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:12.309288 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2e1f0-4ed1-4f4d-949a-c5be3ad847e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:12.309861 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2e1f0-4ed1-4f4d-949a-c5be3ad847e8 admin admin] PATH_INFO: `/v3/projects/ad51d6664e1c46538cb4dc556a22fa52/users/a49cc91b30f246bf80688114ac59b0cd/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:12.340406 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2e1f0-4ed1-4f4d-949a-c5be3ad847e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad51d6664e1c46538cb4dc556a22fa52, user_id=a49cc91b30f246bf80688114ac59b0cd, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:12.346857 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2e1f0-4ed1-4f4d-949a-c5be3ad847e8 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:12.365886 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1397/2778] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 05:00:12 2022] PUT /identity/v3/projects/ad51d6664e1c46538cb4dc556a22fa52/users/a49cc91b30f246bf80688114ac59b0cd/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:12.470427 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a4f12-aabc-4042-b1b8-e2bf14d651b8 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:12.471028 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a4f12-aabc-4042-b1b8-e2bf14d651b8 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:12.471536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a4f12-aabc-4042-b1b8-e2bf14d651b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:12.515022 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-cf1a4f12-aabc-4042-b1b8-e2bf14d651b8 None None] MFA Rules not processed for user `a49cc91b30f246bf80688114ac59b0cd`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:00:12.516620 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-cf1a4f12-aabc-4042-b1b8-e2bf14d651b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:12.601072 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1382/2779] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:00:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:00:12.606121 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2e1f0-4ed1-4f4d-949a-c5be3ad847e8 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:12.641654 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:12.688997 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2e1f0-4ed1-4f4d-949a-c5be3ad847e8 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:12.694614 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab293935-f8d1-4c58-a0db-d8d26279cc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:12.695277 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab293935-f8d1-4c58-a0db-d8d26279cc60 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:12.695556 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab293935-f8d1-4c58-a0db-d8d26279cc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:12.695835 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab293935-f8d1-4c58-a0db-d8d26279cc60 admin admin] PATH_INFO: `/v3/projects` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:12.696519 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab293935-f8d1-4c58-a0db-d8d26279cc60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:12.698555 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab293935-f8d1-4c58-a0db-d8d26279cc60 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:12.735654 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1398/2780] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 05:00:12 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 05:00:12.737120 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a4f12-aabc-4042-b1b8-e2bf14d651b8 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:12.749765 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a4f12-aabc-4042-b1b8-e2bf14d651b8 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:12.825609 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ceee0-f181-4252-9341-9ac3a1048414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:12.826408 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ceee0-f181-4252-9341-9ac3a1048414 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:12.826692 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ceee0-f181-4252-9341-9ac3a1048414 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:12.826968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ceee0-f181-4252-9341-9ac3a1048414 admin admin] PATH_INFO: `/v3/users` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:12.827670 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ceee0-f181-4252-9341-9ac3a1048414 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:12.829686 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ceee0-f181-4252-9341-9ac3a1048414 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:12.838737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:12.858294 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1383/2781] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 05:00:12 2022] POST /identity/v3/users => generated 296 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 05:00:12.859969 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab293935-f8d1-4c58-a0db-d8d26279cc60 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:12.875989 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab293935-f8d1-4c58-a0db-d8d26279cc60 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:12.882308 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9b73f-7ad2-422d-868d-cbd15fb76961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:12.883010 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9b73f-7ad2-422d-868d-cbd15fb76961 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:12.883387 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9b73f-7ad2-422d-868d-cbd15fb76961 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:12.883720 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9b73f-7ad2-422d-868d-cbd15fb76961 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:12.884596 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9b73f-7ad2-422d-868d-cbd15fb76961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:12.886523 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9b73f-7ad2-422d-868d-cbd15fb76961 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:12.900819 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1399/2782] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 05:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 05:00:12.906067 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ceee0-f181-4252-9341-9ac3a1048414 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:12.918954 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ceee0-f181-4252-9341-9ac3a1048414 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:12.925837 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625953d-3d6b-492a-84a7-dd9bb9772065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:12.927267 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625953d-3d6b-492a-84a7-dd9bb9772065 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:12.927489 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625953d-3d6b-492a-84a7-dd9bb9772065 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:12.927941 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625953d-3d6b-492a-84a7-dd9bb9772065 admin admin] PATH_INFO: `/v3/projects/b73820dd0a7645bcbfe8448a1f01c73c/users/3948ead3c6ac4f6c9764752ac4a11ca2/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:12.947306 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625953d-3d6b-492a-84a7-dd9bb9772065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b73820dd0a7645bcbfe8448a1f01c73c, user_id=3948ead3c6ac4f6c9764752ac4a11ca2, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:12.951057 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625953d-3d6b-492a-84a7-dd9bb9772065 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:12.972660 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1384/2783] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 05:00:12 2022] PUT /identity/v3/projects/b73820dd0a7645bcbfe8448a1f01c73c/users/3948ead3c6ac4f6c9764752ac4a11ca2/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:12.978672 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9b73f-7ad2-422d-868d-cbd15fb76961 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:12.990885 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9b73f-7ad2-422d-868d-cbd15fb76961 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:13.090684 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca07bc-e916-476d-9c8a-4a6721f8af70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:13.091364 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca07bc-e916-476d-9c8a-4a6721f8af70 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:13.091620 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca07bc-e916-476d-9c8a-4a6721f8af70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:13.091946 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca07bc-e916-476d-9c8a-4a6721f8af70 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:13.092873 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca07bc-e916-476d-9c8a-4a6721f8af70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:13.095617 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca07bc-e916-476d-9c8a-4a6721f8af70 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:13.108812 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1400/2784] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 05:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 05:00:13.115510 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625953d-3d6b-492a-84a7-dd9bb9772065 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:13.138301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625953d-3d6b-492a-84a7-dd9bb9772065 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:13.149828 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b2912-d0a9-4508-b89b-b12c524ee30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:13.151001 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b2912-d0a9-4508-b89b-b12c524ee30a admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:13.151463 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b2912-d0a9-4508-b89b-b12c524ee30a admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:13.151918 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b2912-d0a9-4508-b89b-b12c524ee30a admin admin] PATH_INFO: `/v3/projects/b73820dd0a7645bcbfe8448a1f01c73c/users/3948ead3c6ac4f6c9764752ac4a11ca2/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:13.156124 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b2912-d0a9-4508-b89b-b12c524ee30a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b73820dd0a7645bcbfe8448a1f01c73c, user_id=3948ead3c6ac4f6c9764752ac4a11ca2, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:13.160737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b2912-d0a9-4508-b89b-b12c524ee30a admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:13.194428 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1385/2785] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 05:00:13 2022] PUT /identity/v3/projects/b73820dd0a7645bcbfe8448a1f01c73c/users/3948ead3c6ac4f6c9764752ac4a11ca2/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 05:00:13.196478 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512964c1-8d36-4fce-af51-91241ee98eb6 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:13.197119 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512964c1-8d36-4fce-af51-91241ee98eb6 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:13.197782 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512964c1-8d36-4fce-af51-91241ee98eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:13.249335 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-512964c1-8d36-4fce-af51-91241ee98eb6 None None] MFA Rules not processed for user `3948ead3c6ac4f6c9764752ac4a11ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:00:13.251475 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-512964c1-8d36-4fce-af51-91241ee98eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:13.399829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1401/2786] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:00:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 05:00:13.417754 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b2912-d0a9-4508-b89b-b12c524ee30a admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:13.420614 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-cb5b2912-d0a9-4508-b89b-b12c524ee30a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:13.505498 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b2912-d0a9-4508-b89b-b12c524ee30a admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:13.510232 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828e1fb-3382-4f96-afda-412e79bad523 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:13.511006 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828e1fb-3382-4f96-afda-412e79bad523 service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:13.511385 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828e1fb-3382-4f96-afda-412e79bad523 service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:13.511786 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828e1fb-3382-4f96-afda-412e79bad523 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:13.524228 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828e1fb-3382-4f96-afda-412e79bad523 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:13.526108 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828e1fb-3382-4f96-afda-412e79bad523 service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:13.540398 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1386/2787] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 05:00:13 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 05:00:13.947272 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512964c1-8d36-4fce-af51-91241ee98eb6 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:13.957941 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512964c1-8d36-4fce-af51-91241ee98eb6 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:13.962944 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7779b5c-0247-441a-a005-691aa20cc8e3 tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3948ead3c6ac4f6c9764752ac4a11ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b73820dd0a7645bcbfe8448a1f01c73c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:13.963680 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7779b5c-0247-441a-a005-691aa20cc8e3 tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:13.963909 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7779b5c-0247-441a-a005-691aa20cc8e3 tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:13.964232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7779b5c-0247-441a-a005-691aa20cc8e3 tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:13.965153 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7779b5c-0247-441a-a005-691aa20cc8e3 tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 05:00:13.965515 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7779b5c-0247-441a-a005-691aa20cc8e3 tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:13.967250 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7779b5c-0247-441a-a005-691aa20cc8e3 tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:13.990025 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1402/2788] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 05:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 05:00:13.991973 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828e1fb-3382-4f96-afda-412e79bad523 service cinder] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:14.010280 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828e1fb-3382-4f96-afda-412e79bad523 service cinder] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:14.018380 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d2324-a4f1-4111-95a0-10bb4e44b8af tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3948ead3c6ac4f6c9764752ac4a11ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b73820dd0a7645bcbfe8448a1f01c73c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:14.019467 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d2324-a4f1-4111-95a0-10bb4e44b8af tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:14.020296 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d2324-a4f1-4111-95a0-10bb4e44b8af tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:14.020459 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d2324-a4f1-4111-95a0-10bb4e44b8af tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:14.021755 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d2324-a4f1-4111-95a0-10bb4e44b8af tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:14.025620 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d2324-a4f1-4111-95a0-10bb4e44b8af tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:14.065322 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1387/2789] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 05:00:13 2022] POST /identity/v3/projects => generated 353 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 05:00:14.071487 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7779b5c-0247-441a-a005-691aa20cc8e3 tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:14.085654 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:14.090955 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7779b5c-0247-441a-a005-691aa20cc8e3 tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:14.171526 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d16e64-180b-4693-8c3c-668d4df48934 tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3948ead3c6ac4f6c9764752ac4a11ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b73820dd0a7645bcbfe8448a1f01c73c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:14.172119 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d16e64-180b-4693-8c3c-668d4df48934 tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:14.172331 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d16e64-180b-4693-8c3c-668d4df48934 tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:14.172591 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d16e64-180b-4693-8c3c-668d4df48934 tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:14.173376 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d16e64-180b-4693-8c3c-668d4df48934 tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 05:00:14.173682 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d16e64-180b-4693-8c3c-668d4df48934 tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:14.175541 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d16e64-180b-4693-8c3c-668d4df48934 tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:14.190864 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1403/2790] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 05:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 05:00:14.236518 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d2324-a4f1-4111-95a0-10bb4e44b8af tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:14.249247 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d2324-a4f1-4111-95a0-10bb4e44b8af tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:14.254172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30dcf13-75d8-40fe-8918-ad9525a09177 tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3948ead3c6ac4f6c9764752ac4a11ca2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b73820dd0a7645bcbfe8448a1f01c73c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:14.254881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dcf13-75d8-40fe-8918-ad9525a09177 tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:14.255163 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dcf13-75d8-40fe-8918-ad9525a09177 tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:14.255443 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dcf13-75d8-40fe-8918-ad9525a09177 tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] PATH_INFO: `/v3/projects/d2db4c0abc52488c81bda122a8400030` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:14.256678 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30dcf13-75d8-40fe-8918-ad9525a09177 tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d2db4c0abc52488c81bda122a8400030)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:14.258710 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30dcf13-75d8-40fe-8918-ad9525a09177 tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:14.328154 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-d30dcf13-75d8-40fe-8918-ad9525a09177 tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2db4c0abc52488c81bda122a8400030', 'request_id': 'req-d30dcf13-75d8-40fe-8918-ad9525a09177'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:14.338642 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-d30dcf13-75d8-40fe-8918-ad9525a09177 tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2db4c0abc52488c81bda122a8400030', 'request_id': 'req-d30dcf13-75d8-40fe-8918-ad9525a09177'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:14.346662 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-d30dcf13-75d8-40fe-8918-ad9525a09177 tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2db4c0abc52488c81bda122a8400030', 'request_id': 'req-d30dcf13-75d8-40fe-8918-ad9525a09177'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:14.360265 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-d30dcf13-75d8-40fe-8918-ad9525a09177 tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] The token cache is being invalidate because project d2db4c0abc52488c81bda122a8400030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 05:00:14.360594 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-d30dcf13-75d8-40fe-8918-ad9525a09177 tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:14.361265 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-d30dcf13-75d8-40fe-8918-ad9525a09177 tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:14.363137 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1388/2791] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 05:00:14 2022] DELETE /identity/v3/projects/d2db4c0abc52488c81bda122a8400030 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:14.710012 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d16e64-180b-4693-8c3c-668d4df48934 tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:14.711890 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-a4d16e64-180b-4693-8c3c-668d4df48934 tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:14.806834 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d16e64-180b-4693-8c3c-668d4df48934 tempest-VolumeQuotaClassesTest-979995270 tempest-VolumeQuotaClassesTest-979995270-project-admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:14.878303 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c28a50-31db-4c99-a9c8-872f89759b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:14.879066 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c28a50-31db-4c99-a9c8-872f89759b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:14.879420 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c28a50-31db-4c99-a9c8-872f89759b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:14.879767 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c28a50-31db-4c99-a9c8-872f89759b20 admin admin] PATH_INFO: `/v3/users/a49cc91b30f246bf80688114ac59b0cd` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:14.881158 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c28a50-31db-4c99-a9c8-872f89759b20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a49cc91b30f246bf80688114ac59b0cd)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:14.883285 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c28a50-31db-4c99-a9c8-872f89759b20 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:14.945805 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-b1c28a50-31db-4c99-a9c8-872f89759b20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a49cc91b30f246bf80688114ac59b0cd'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:14.946676 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-b1c28a50-31db-4c99-a9c8-872f89759b20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a49cc91b30f246bf80688114ac59b0cd'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:14.948945 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:14.960072 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-b1c28a50-31db-4c99-a9c8-872f89759b20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a49cc91b30f246bf80688114ac59b0cd'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:14.982302 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-b1c28a50-31db-4c99-a9c8-872f89759b20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a49cc91b30f246bf80688114ac59b0cd'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:14.992127 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-b1c28a50-31db-4c99-a9c8-872f89759b20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a49cc91b30f246bf80688114ac59b0cd'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:14.999598 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1404/2792] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 05:00:14 2022] DELETE /identity/v3/users/a49cc91b30f246bf80688114ac59b0cd => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 05:00:15.004399 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e1d84-b0c2-42cc-bf0b-779247f93a47 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:15.005236 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e1d84-b0c2-42cc-bf0b-779247f93a47 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:15.005236 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e1d84-b0c2-42cc-bf0b-779247f93a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:15.033727 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-f66e1d84-b0c2-42cc-bf0b-779247f93a47 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:00:15.035034 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-f66e1d84-b0c2-42cc-bf0b-779247f93a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:15.052809 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:INSERT=7,keystone:SELECT=86,keystone:DELETE=7 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:15.145773 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1389/2793] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:00:15.162632 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c28a50-31db-4c99-a9c8-872f89759b20 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:15.164533 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-b1c28a50-31db-4c99-a9c8-872f89759b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:15.234346 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c28a50-31db-4c99-a9c8-872f89759b20 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:15.238659 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df300ac-a74f-4df0-b986-a974039a8512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:15.239314 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df300ac-a74f-4df0-b986-a974039a8512 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:15.239593 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df300ac-a74f-4df0-b986-a974039a8512 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:15.239866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df300ac-a74f-4df0-b986-a974039a8512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:15.250843 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df300ac-a74f-4df0-b986-a974039a8512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:15.252403 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df300ac-a74f-4df0-b986-a974039a8512 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:15.263538 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1405/2794] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 05:00:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 05:00:15.816016 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e1d84-b0c2-42cc-bf0b-779247f93a47 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:15.818150 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-f66e1d84-b0c2-42cc-bf0b-779247f93a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:15.839218 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e1d84-b0c2-42cc-bf0b-779247f93a47 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:15.848631 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a312bc-e665-4e76-9fcf-e4cf526de18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:15.850403 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a312bc-e665-4e76-9fcf-e4cf526de18a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:15.851007 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a312bc-e665-4e76-9fcf-e4cf526de18a admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:15.851306 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a312bc-e665-4e76-9fcf-e4cf526de18a admin admin] PATH_INFO: `/v3/projects/ad51d6664e1c46538cb4dc556a22fa52` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:15.853600 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a312bc-e665-4e76-9fcf-e4cf526de18a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad51d6664e1c46538cb4dc556a22fa52)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:15.857360 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a312bc-e665-4e76-9fcf-e4cf526de18a admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:15.955188 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-b0a312bc-e665-4e76-9fcf-e4cf526de18a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad51d6664e1c46538cb4dc556a22fa52', 'request_id': 'req-b0a312bc-e665-4e76-9fcf-e4cf526de18a'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:15.967735 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-b0a312bc-e665-4e76-9fcf-e4cf526de18a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad51d6664e1c46538cb4dc556a22fa52', 'request_id': 'req-b0a312bc-e665-4e76-9fcf-e4cf526de18a'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:15.979749 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-b0a312bc-e665-4e76-9fcf-e4cf526de18a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad51d6664e1c46538cb4dc556a22fa52', 'request_id': 'req-b0a312bc-e665-4e76-9fcf-e4cf526de18a'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:15.997462 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-b0a312bc-e665-4e76-9fcf-e4cf526de18a admin admin] The token cache is being invalidate because project ad51d6664e1c46538cb4dc556a22fa52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 05:00:15.997893 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-b0a312bc-e665-4e76-9fcf-e4cf526de18a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:15.998902 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-b0a312bc-e665-4e76-9fcf-e4cf526de18a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:16.000856 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1390/2795] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 05:00:15 2022] DELETE /identity/v3/projects/ad51d6664e1c46538cb4dc556a22fa52 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:16.006314 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df300ac-a74f-4df0-b986-a974039a8512 service neutron] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:16.020228 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df300ac-a74f-4df0-b986-a974039a8512 service neutron] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:16.103652 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed8235-8b6e-4281-b6ab-64d1cfbbced8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:16.104825 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed8235-8b6e-4281-b6ab-64d1cfbbced8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:16.105324 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed8235-8b6e-4281-b6ab-64d1cfbbced8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:16.105809 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed8235-8b6e-4281-b6ab-64d1cfbbced8 admin admin] PATH_INFO: `/v3/users/3948ead3c6ac4f6c9764752ac4a11ca2` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:16.108425 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed8235-8b6e-4281-b6ab-64d1cfbbced8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3948ead3c6ac4f6c9764752ac4a11ca2)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:16.112874 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed8235-8b6e-4281-b6ab-64d1cfbbced8 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:16.205829 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-99ed8235-8b6e-4281-b6ab-64d1cfbbced8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3948ead3c6ac4f6c9764752ac4a11ca2'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:16.206960 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-99ed8235-8b6e-4281-b6ab-64d1cfbbced8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3948ead3c6ac4f6c9764752ac4a11ca2'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:16.220999 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-99ed8235-8b6e-4281-b6ab-64d1cfbbced8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3948ead3c6ac4f6c9764752ac4a11ca2'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:16.245660 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:16.247929 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-99ed8235-8b6e-4281-b6ab-64d1cfbbced8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3948ead3c6ac4f6c9764752ac4a11ca2'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:16.261247 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-99ed8235-8b6e-4281-b6ab-64d1cfbbced8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3948ead3c6ac4f6c9764752ac4a11ca2'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:16.273830 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1406/2796] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 05:00:16 2022] DELETE /identity/v3/users/3948ead3c6ac4f6c9764752ac4a11ca2 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 05:00:16.709849 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a312bc-e665-4e76-9fcf-e4cf526de18a admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:16.712146 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-b0a312bc-e665-4e76-9fcf-e4cf526de18a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:16.729732 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a312bc-e665-4e76-9fcf-e4cf526de18a admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:16.813490 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e3673-7ff3-4eb4-b060-642518986dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:16.814358 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e3673-7ff3-4eb4-b060-642518986dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:16.814786 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e3673-7ff3-4eb4-b060-642518986dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:16.815115 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e3673-7ff3-4eb4-b060-642518986dfb admin admin] PATH_INFO: `/v3/projects/b73820dd0a7645bcbfe8448a1f01c73c` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:16.816839 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e3673-7ff3-4eb4-b060-642518986dfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b73820dd0a7645bcbfe8448a1f01c73c)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:16.819070 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e3673-7ff3-4eb4-b060-642518986dfb admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:16.869037 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:16.878317 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2f6e3673-7ff3-4eb4-b060-642518986dfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b73820dd0a7645bcbfe8448a1f01c73c', 'request_id': 'req-2f6e3673-7ff3-4eb4-b060-642518986dfb'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:16.888148 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2f6e3673-7ff3-4eb4-b060-642518986dfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b73820dd0a7645bcbfe8448a1f01c73c', 'request_id': 'req-2f6e3673-7ff3-4eb4-b060-642518986dfb'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:16.895974 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2f6e3673-7ff3-4eb4-b060-642518986dfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b73820dd0a7645bcbfe8448a1f01c73c', 'request_id': 'req-2f6e3673-7ff3-4eb4-b060-642518986dfb'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:16.910395 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2f6e3673-7ff3-4eb4-b060-642518986dfb admin admin] The token cache is being invalidate because project b73820dd0a7645bcbfe8448a1f01c73c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 05:00:16.910680 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2f6e3673-7ff3-4eb4-b060-642518986dfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:16.911450 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-2f6e3673-7ff3-4eb4-b060-642518986dfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:16.913105 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1391/2797] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 05:00:16 2022] DELETE /identity/v3/projects/b73820dd0a7645bcbfe8448a1f01c73c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:16.918629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413cf0f5-69f5-4a98-87cd-7b08ab06e370 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:16.918907 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413cf0f5-69f5-4a98-87cd-7b08ab06e370 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:16.919187 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413cf0f5-69f5-4a98-87cd-7b08ab06e370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:16.940905 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-413cf0f5-69f5-4a98-87cd-7b08ab06e370 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:00:16.942219 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-413cf0f5-69f5-4a98-87cd-7b08ab06e370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:17.015276 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1407/2798] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:00:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:00:17.024859 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67648f4-7d36-45e2-856e-540fc2ebf3c0 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:17.025190 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67648f4-7d36-45e2-856e-540fc2ebf3c0 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:17.025352 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67648f4-7d36-45e2-856e-540fc2ebf3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:17.048619 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-b67648f4-7d36-45e2-856e-540fc2ebf3c0 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:00:17.049903 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-b67648f4-7d36-45e2-856e-540fc2ebf3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:17.058502 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1392/2799] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:00:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:00:17.063457 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413cf0f5-69f5-4a98-87cd-7b08ab06e370 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:17.074205 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413cf0f5-69f5-4a98-87cd-7b08ab06e370 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:17.079520 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7398f9-ec69-49c6-8ee0-e783ac65f270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:17.080185 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7398f9-ec69-49c6-8ee0-e783ac65f270 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:17.080465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7398f9-ec69-49c6-8ee0-e783ac65f270 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:17.080770 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7398f9-ec69-49c6-8ee0-e783ac65f270 admin admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:17.081505 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7398f9-ec69-49c6-8ee0-e783ac65f270 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 05:00:17.081789 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7398f9-ec69-49c6-8ee0-e783ac65f270 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:17.083550 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7398f9-ec69-49c6-8ee0-e783ac65f270 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:17.097604 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1408/2800] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 05:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 05:00:17.102877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67648f4-7d36-45e2-856e-540fc2ebf3c0 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:17.113582 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67648f4-7d36-45e2-856e-540fc2ebf3c0 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:17.118701 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb4974-d1ef-46cc-a694-0dbd725fc665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:17.119381 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb4974-d1ef-46cc-a694-0dbd725fc665 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:17.119662 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb4974-d1ef-46cc-a694-0dbd725fc665 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:17.119930 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb4974-d1ef-46cc-a694-0dbd725fc665 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:17.120623 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb4974-d1ef-46cc-a694-0dbd725fc665 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:17.122993 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb4974-d1ef-46cc-a694-0dbd725fc665 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:17.158166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1393/2801] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 05:00:17 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 05:00:17.163141 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7398f9-ec69-49c6-8ee0-e783ac65f270 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:17.176200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7398f9-ec69-49c6-8ee0-e783ac65f270 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:17.285839 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39077aa2-3e09-4c8a-91f2-ac53c56a7c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:17.287870 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39077aa2-3e09-4c8a-91f2-ac53c56a7c3d admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:17.290132 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39077aa2-3e09-4c8a-91f2-ac53c56a7c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:17.290678 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39077aa2-3e09-4c8a-91f2-ac53c56a7c3d admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:17.291916 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39077aa2-3e09-4c8a-91f2-ac53c56a7c3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:17.295698 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39077aa2-3e09-4c8a-91f2-ac53c56a7c3d admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:17.333121 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1409/2802] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 05:00:17 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 05:00:17.338617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb4974-d1ef-46cc-a694-0dbd725fc665 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:17.362761 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb4974-d1ef-46cc-a694-0dbd725fc665 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:17.371032 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d6d5a-8aec-49ef-bad9-16addec84b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:17.372474 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d6d5a-8aec-49ef-bad9-16addec84b59 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:17.372965 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d6d5a-8aec-49ef-bad9-16addec84b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:17.373452 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d6d5a-8aec-49ef-bad9-16addec84b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:17.374826 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d6d5a-8aec-49ef-bad9-16addec84b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:17.377877 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d6d5a-8aec-49ef-bad9-16addec84b59 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:17.402895 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1394/2803] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 05:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 05:00:17.407920 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39077aa2-3e09-4c8a-91f2-ac53c56a7c3d admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:17.422301 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39077aa2-3e09-4c8a-91f2-ac53c56a7c3d admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:17.429029 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4c1a8-fbe8-4977-9b54-491745402bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:17.429917 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4c1a8-fbe8-4977-9b54-491745402bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:17.430250 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4c1a8-fbe8-4977-9b54-491745402bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:17.430522 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4c1a8-fbe8-4977-9b54-491745402bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:17.431350 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4c1a8-fbe8-4977-9b54-491745402bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:17.433459 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4c1a8-fbe8-4977-9b54-491745402bc5 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:17.448423 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1410/2804] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 05:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 05:00:17.453844 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d6d5a-8aec-49ef-bad9-16addec84b59 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:17.470404 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d6d5a-8aec-49ef-bad9-16addec84b59 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:17.475919 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ffafe4-f800-4d85-991f-df5c68747154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:17.476639 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffafe4-f800-4d85-991f-df5c68747154 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:17.476941 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffafe4-f800-4d85-991f-df5c68747154 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:17.477634 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffafe4-f800-4d85-991f-df5c68747154 admin admin] PATH_INFO: `/v3/projects/d748449049fd436991f942892e594e83/users/70b282ba6b1c48eab567431ab374d385/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:17.496814 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ffafe4-f800-4d85-991f-df5c68747154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d748449049fd436991f942892e594e83, user_id=70b282ba6b1c48eab567431ab374d385, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:17.499738 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ffafe4-f800-4d85-991f-df5c68747154 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:17.517199 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1395/2805] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 05:00:17 2022] PUT /identity/v3/projects/d748449049fd436991f942892e594e83/users/70b282ba6b1c48eab567431ab374d385/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:17.528537 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52789049-93dc-450c-be1e-a5ffc8896047 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:17.528703 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52789049-93dc-450c-be1e-a5ffc8896047 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:17.528905 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52789049-93dc-450c-be1e-a5ffc8896047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:17.577640 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-52789049-93dc-450c-be1e-a5ffc8896047 None None] MFA Rules not processed for user `70b282ba6b1c48eab567431ab374d385`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:00:17.579824 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-52789049-93dc-450c-be1e-a5ffc8896047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:17.646414 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:17.715944 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1411/2806] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:00:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:00:17.722397 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ffafe4-f800-4d85-991f-df5c68747154 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:17.883760 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ffafe4-f800-4d85-991f-df5c68747154 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:17.889434 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89071af6-51e1-47eb-aa1b-1630254d3b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:17.890150 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89071af6-51e1-47eb-aa1b-1630254d3b9c admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:17.890419 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89071af6-51e1-47eb-aa1b-1630254d3b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:17.890694 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89071af6-51e1-47eb-aa1b-1630254d3b9c admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:17.891418 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89071af6-51e1-47eb-aa1b-1630254d3b9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:17.893493 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89071af6-51e1-47eb-aa1b-1630254d3b9c admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:17.933282 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1396/2807] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 05:00:17 2022] POST /identity/v3/projects => generated 385 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 05:00:17.939257 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52789049-93dc-450c-be1e-a5ffc8896047 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:17.954267 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52789049-93dc-450c-be1e-a5ffc8896047 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:18.057414 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75dd37-2372-4fbe-b5b3-122330e615fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:18.058537 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75dd37-2372-4fbe-b5b3-122330e615fd admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:18.059195 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75dd37-2372-4fbe-b5b3-122330e615fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:18.059666 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75dd37-2372-4fbe-b5b3-122330e615fd admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:18.061385 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab75dd37-2372-4fbe-b5b3-122330e615fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:18.065817 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab75dd37-2372-4fbe-b5b3-122330e615fd admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:18.098398 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1412/2808] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 05:00:17 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 05:00:18.104377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89071af6-51e1-47eb-aa1b-1630254d3b9c admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:18.116985 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89071af6-51e1-47eb-aa1b-1630254d3b9c admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:18.123586 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35f890-e37b-4a35-a105-4d0cf0280f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:18.124375 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35f890-e37b-4a35-a105-4d0cf0280f3e admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:18.124749 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35f890-e37b-4a35-a105-4d0cf0280f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:18.125118 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e35f890-e37b-4a35-a105-4d0cf0280f3e admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:18.125921 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35f890-e37b-4a35-a105-4d0cf0280f3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:18.127885 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e35f890-e37b-4a35-a105-4d0cf0280f3e admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:18.146631 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1397/2809] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 05:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 05:00:18.151099 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75dd37-2372-4fbe-b5b3-122330e615fd admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:18.162473 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75dd37-2372-4fbe-b5b3-122330e615fd admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:18.167754 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f998e6-8c59-46f2-9a1f-87854c9d227a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:18.168424 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f998e6-8c59-46f2-9a1f-87854c9d227a admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:18.168687 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f998e6-8c59-46f2-9a1f-87854c9d227a admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:18.168990 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f998e6-8c59-46f2-9a1f-87854c9d227a admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:18.169726 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f998e6-8c59-46f2-9a1f-87854c9d227a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:18.171467 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f998e6-8c59-46f2-9a1f-87854c9d227a admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:18.183276 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1413/2810] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 05:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 05:00:18.188133 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35f890-e37b-4a35-a105-4d0cf0280f3e admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:18.200256 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e35f890-e37b-4a35-a105-4d0cf0280f3e admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:18.205607 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520686b-c0df-41d0-a242-981a30925d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:18.206357 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520686b-c0df-41d0-a242-981a30925d0f admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:18.206642 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520686b-c0df-41d0-a242-981a30925d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:18.206920 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520686b-c0df-41d0-a242-981a30925d0f admin admin] PATH_INFO: `/v3/projects/b2962bba51b942bc9025c49deb48b92c/users/7fc90e883bc84b53a557ecdaf4900624/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:18.225664 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6520686b-c0df-41d0-a242-981a30925d0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2962bba51b942bc9025c49deb48b92c, user_id=7fc90e883bc84b53a557ecdaf4900624, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:18.228499 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6520686b-c0df-41d0-a242-981a30925d0f admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:18.250417 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1398/2811] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 05:00:18 2022] PUT /identity/v3/projects/b2962bba51b942bc9025c49deb48b92c/users/7fc90e883bc84b53a557ecdaf4900624/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:18.269594 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b196191-3356-4bb7-a201-ebd161e33925 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:18.270092 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b196191-3356-4bb7-a201-ebd161e33925 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:18.270570 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b196191-3356-4bb7-a201-ebd161e33925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:18.307178 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-0b196191-3356-4bb7-a201-ebd161e33925 None None] MFA Rules not processed for user `7fc90e883bc84b53a557ecdaf4900624`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:00:18.308647 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-0b196191-3356-4bb7-a201-ebd161e33925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:18.388559 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1414/2812] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:00:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:00:18.394112 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520686b-c0df-41d0-a242-981a30925d0f admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:18.425845 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:18.511313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6520686b-c0df-41d0-a242-981a30925d0f admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:18.518505 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace5eb6-1f9f-4aeb-aa40-e6c8a01b6e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:18.519233 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace5eb6-1f9f-4aeb-aa40-e6c8a01b6e8c admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:18.519658 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace5eb6-1f9f-4aeb-aa40-e6c8a01b6e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:18.520120 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace5eb6-1f9f-4aeb-aa40-e6c8a01b6e8c admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:18.521298 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace5eb6-1f9f-4aeb-aa40-e6c8a01b6e8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:18.524598 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace5eb6-1f9f-4aeb-aa40-e6c8a01b6e8c admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:18.578071 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1399/2813] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 05:00:18 2022] POST /identity/v3/projects => generated 387 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 05:00:18.580552 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b196191-3356-4bb7-a201-ebd161e33925 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:18.596778 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b196191-3356-4bb7-a201-ebd161e33925 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:18.695114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:18.715190 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e1aac-876f-40ad-8c65-dab4607038e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:18.716215 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e1aac-876f-40ad-8c65-dab4607038e6 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:18.716668 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e1aac-876f-40ad-8c65-dab4607038e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:18.717276 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e1aac-876f-40ad-8c65-dab4607038e6 admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:18.718411 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e1aac-876f-40ad-8c65-dab4607038e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:18.722173 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e1aac-876f-40ad-8c65-dab4607038e6 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:18.758040 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1415/2814] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 05:00:18 2022] POST /identity/v3/users => generated 300 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 05:00:18.762066 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace5eb6-1f9f-4aeb-aa40-e6c8a01b6e8c admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:18.780528 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace5eb6-1f9f-4aeb-aa40-e6c8a01b6e8c admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:18.788162 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef69af6-a648-48b4-8cbd-1429ceb643fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:18.789133 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef69af6-a648-48b4-8cbd-1429ceb643fe admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:18.789557 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef69af6-a648-48b4-8cbd-1429ceb643fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:18.790035 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef69af6-a648-48b4-8cbd-1429ceb643fe admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:18.791332 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef69af6-a648-48b4-8cbd-1429ceb643fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:18.794460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef69af6-a648-48b4-8cbd-1429ceb643fe admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:18.816180 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1400/2815] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 05:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 05:00:18.821473 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e1aac-876f-40ad-8c65-dab4607038e6 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:18.840213 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e1aac-876f-40ad-8c65-dab4607038e6 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:18.847731 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd635051-97e4-4dee-80e7-9dc54c497d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:18.848904 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd635051-97e4-4dee-80e7-9dc54c497d14 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:18.849420 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd635051-97e4-4dee-80e7-9dc54c497d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:18.849886 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd635051-97e4-4dee-80e7-9dc54c497d14 admin admin] PATH_INFO: `/v3/projects/cbc3a20d3ce24cbb8014ff00190299d4/users/8ff3ff9cf7184ea2b60f9eba41e9e043/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:18.876190 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd635051-97e4-4dee-80e7-9dc54c497d14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc3a20d3ce24cbb8014ff00190299d4, user_id=8ff3ff9cf7184ea2b60f9eba41e9e043, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:18.879629 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd635051-97e4-4dee-80e7-9dc54c497d14 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:18.904232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1416/2816] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 05:00:18 2022] PUT /identity/v3/projects/cbc3a20d3ce24cbb8014ff00190299d4/users/8ff3ff9cf7184ea2b60f9eba41e9e043/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:18.910770 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef69af6-a648-48b4-8cbd-1429ceb643fe admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:18.925710 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef69af6-a648-48b4-8cbd-1429ceb643fe admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:19.022241 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30d871-9167-4b16-9931-310f7b46ecf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:19.022894 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30d871-9167-4b16-9931-310f7b46ecf8 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:19.023170 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30d871-9167-4b16-9931-310f7b46ecf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:19.023439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30d871-9167-4b16-9931-310f7b46ecf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:19.024153 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30d871-9167-4b16-9931-310f7b46ecf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:19.025864 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30d871-9167-4b16-9931-310f7b46ecf8 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:19.039064 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1401/2817] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 05:00:18 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 05:00:19.045400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd635051-97e4-4dee-80e7-9dc54c497d14 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:19.057329 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd635051-97e4-4dee-80e7-9dc54c497d14 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:19.062620 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39ab19-83e4-49c6-aa66-afe015c8d795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:19.063790 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39ab19-83e4-49c6-aa66-afe015c8d795 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:19.063790 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39ab19-83e4-49c6-aa66-afe015c8d795 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:19.064112 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39ab19-83e4-49c6-aa66-afe015c8d795 admin admin] PATH_INFO: `/v3/projects/cbc3a20d3ce24cbb8014ff00190299d4/users/8ff3ff9cf7184ea2b60f9eba41e9e043/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:19.066356 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39ab19-83e4-49c6-aa66-afe015c8d795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc3a20d3ce24cbb8014ff00190299d4, user_id=8ff3ff9cf7184ea2b60f9eba41e9e043, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:19.069313 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39ab19-83e4-49c6-aa66-afe015c8d795 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:19.082167 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1417/2818] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 05:00:19 2022] PUT /identity/v3/projects/cbc3a20d3ce24cbb8014ff00190299d4/users/8ff3ff9cf7184ea2b60f9eba41e9e043/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:19.095158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8f93c-121e-4046-baf2-0e66afee3f5d None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:19.095533 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8f93c-121e-4046-baf2-0e66afee3f5d None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:19.095765 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd8f93c-121e-4046-baf2-0e66afee3f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:19.137269 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-8dd8f93c-121e-4046-baf2-0e66afee3f5d None None] MFA Rules not processed for user `8ff3ff9cf7184ea2b60f9eba41e9e043`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:00:19.139330 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-8dd8f93c-121e-4046-baf2-0e66afee3f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:19.260701 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1402/2819] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:00:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 05:00:19.282911 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39ab19-83e4-49c6-aa66-afe015c8d795 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:19.294035 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-1e39ab19-83e4-49c6-aa66-afe015c8d795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:19.405223 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39ab19-83e4-49c6-aa66-afe015c8d795 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:19.410500 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63f9c5-10bd-401f-a933-1e93a4e3d62d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:19.411299 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63f9c5-10bd-401f-a933-1e93a4e3d62d service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:19.411671 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63f9c5-10bd-401f-a933-1e93a4e3d62d service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:19.412110 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63f9c5-10bd-401f-a933-1e93a4e3d62d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:19.427188 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63f9c5-10bd-401f-a933-1e93a4e3d62d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:19.429302 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63f9c5-10bd-401f-a933-1e93a4e3d62d service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:19.441796 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1418/2820] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 05:00:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 05:00:20.027047 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8f93c-121e-4046-baf2-0e66afee3f5d None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:20.029134 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-8dd8f93c-121e-4046-baf2-0e66afee3f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:20.050345 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:20.128564 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd8f93c-121e-4046-baf2-0e66afee3f5d None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:20.135689 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5220a3-d1ae-42f9-8ff2-dc6290cbe850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:20.136918 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5220a3-d1ae-42f9-8ff2-dc6290cbe850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:20.137263 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5220a3-d1ae-42f9-8ff2-dc6290cbe850 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:20.138055 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5220a3-d1ae-42f9-8ff2-dc6290cbe850 admin admin] PATH_INFO: `/v3/users/ca6f99a13aba40abbd993a7bf6429746` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:20.139803 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5220a3-d1ae-42f9-8ff2-dc6290cbe850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca6f99a13aba40abbd993a7bf6429746)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:20.142785 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5220a3-d1ae-42f9-8ff2-dc6290cbe850 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:20.202909 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63f9c5-10bd-401f-a933-1e93a4e3d62d service cinder] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:20.213836 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63f9c5-10bd-401f-a933-1e93a4e3d62d service cinder] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:20.217868 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c2b8f-5920-4164-a183-7c59e57dfd2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:20.218657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c2b8f-5920-4164-a183-7c59e57dfd2c service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:20.218928 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c2b8f-5920-4164-a183-7c59e57dfd2c service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:20.219194 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c2b8f-5920-4164-a183-7c59e57dfd2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:20.226396 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-cf5220a3-d1ae-42f9-8ff2-dc6290cbe850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca6f99a13aba40abbd993a7bf6429746'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:20.236929 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-cf5220a3-d1ae-42f9-8ff2-dc6290cbe850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca6f99a13aba40abbd993a7bf6429746'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:20.258054 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-cf5220a3-d1ae-42f9-8ff2-dc6290cbe850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca6f99a13aba40abbd993a7bf6429746'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:20.275793 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-cf5220a3-d1ae-42f9-8ff2-dc6290cbe850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca6f99a13aba40abbd993a7bf6429746'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:20.277004 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-cf5220a3-d1ae-42f9-8ff2-dc6290cbe850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca6f99a13aba40abbd993a7bf6429746'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:20.290297 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1403/2821] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 05:00:20 2022] DELETE /identity/v3/users/ca6f99a13aba40abbd993a7bf6429746 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:20.294303 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f7137-1507-4e2b-81a7-b84492b38ce4 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:20.294737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f7137-1507-4e2b-81a7-b84492b38ce4 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:20.295168 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f7137-1507-4e2b-81a7-b84492b38ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:20.308971 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c2b8f-5920-4164-a183-7c59e57dfd2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:20.313132 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952c2b8f-5920-4164-a183-7c59e57dfd2c service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:20.331022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1419/2822] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 05:00:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 05:00:20.335980 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-3a7f7137-1507-4e2b-81a7-b84492b38ce4 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:00:20.338118 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-3a7f7137-1507-4e2b-81a7-b84492b38ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:20.424753 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1404/2823] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:00:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:00:20.439757 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c2b8f-5920-4164-a183-7c59e57dfd2c service cinder] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:20.442119 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-952c2b8f-5920-4164-a183-7c59e57dfd2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:20.511487 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:20.526972 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c2b8f-5920-4164-a183-7c59e57dfd2c service cinder] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:20.607643 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f31e97-1877-4fb3-ab13-dd9b8e128436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:20.608589 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f31e97-1877-4fb3-ab13-dd9b8e128436 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:20.609063 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f31e97-1877-4fb3-ab13-dd9b8e128436 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:20.609507 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f31e97-1877-4fb3-ab13-dd9b8e128436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:20.623221 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f31e97-1877-4fb3-ab13-dd9b8e128436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:20.625310 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f31e97-1877-4fb3-ab13-dd9b8e128436 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:20.641708 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1420/2824] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 05:00:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 05:00:21.056954 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f7137-1507-4e2b-81a7-b84492b38ce4 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:21.059082 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-3a7f7137-1507-4e2b-81a7-b84492b38ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:21.094632 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f7137-1507-4e2b-81a7-b84492b38ce4 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:21.111412 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db43a37-bd52-4928-aa9d-974254acc075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:21.112495 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db43a37-bd52-4928-aa9d-974254acc075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:21.112871 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db43a37-bd52-4928-aa9d-974254acc075 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:21.113240 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db43a37-bd52-4928-aa9d-974254acc075 admin admin] PATH_INFO: `/v3/projects/45f9aea005c149f792103b660bc0e443` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:21.114897 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db43a37-bd52-4928-aa9d-974254acc075 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45f9aea005c149f792103b660bc0e443)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:21.117487 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db43a37-bd52-4928-aa9d-974254acc075 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:21.172913 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:21.212487 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-0db43a37-bd52-4928-aa9d-974254acc075 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45f9aea005c149f792103b660bc0e443', 'request_id': 'req-0db43a37-bd52-4928-aa9d-974254acc075'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:21.231073 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-0db43a37-bd52-4928-aa9d-974254acc075 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45f9aea005c149f792103b660bc0e443', 'request_id': 'req-0db43a37-bd52-4928-aa9d-974254acc075'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:21.239285 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-0db43a37-bd52-4928-aa9d-974254acc075 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45f9aea005c149f792103b660bc0e443', 'request_id': 'req-0db43a37-bd52-4928-aa9d-974254acc075'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:21.262013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-0db43a37-bd52-4928-aa9d-974254acc075 admin admin] The token cache is being invalidate because project 45f9aea005c149f792103b660bc0e443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 05:00:21.262363 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-0db43a37-bd52-4928-aa9d-974254acc075 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:21.263005 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-0db43a37-bd52-4928-aa9d-974254acc075 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:21.265333 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1405/2825] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 05:00:21 2022] DELETE /identity/v3/projects/45f9aea005c149f792103b660bc0e443 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:24.980650 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f31e97-1877-4fb3-ab13-dd9b8e128436 service neutron] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:24.983094 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-14f31e97-1877-4fb3-ab13-dd9b8e128436 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:25.105171 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f31e97-1877-4fb3-ab13-dd9b8e128436 service neutron] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:25.173481 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72188753-b909-4f0c-90e8-fd113dd759bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:25.174268 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72188753-b909-4f0c-90e8-fd113dd759bc service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:25.174555 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72188753-b909-4f0c-90e8-fd113dd759bc service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:25.174837 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72188753-b909-4f0c-90e8-fd113dd759bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:25.177135 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-72188753-b909-4f0c-90e8-fd113dd759bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:25.242806 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=100 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:25.298681 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72188753-b909-4f0c-90e8-fd113dd759bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:25.301451 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72188753-b909-4f0c-90e8-fd113dd759bc service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:25.319049 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1421/2826] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 05:00:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 05:00:27.750325 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44b788-4200-4a65-8265-123e806123bf None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:27.751210 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44b788-4200-4a65-8265-123e806123bf None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:27.751210 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44b788-4200-4a65-8265-123e806123bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:27.792973 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-bb44b788-4200-4a65-8265-123e806123bf None None] MFA Rules not processed for user `b613dee1148c4822af2e7847b28cf4aa`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:00:27.794305 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-bb44b788-4200-4a65-8265-123e806123bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:27.889109 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1406/2827] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Jul 26 05:00:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 05:00:27.951942 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72188753-b909-4f0c-90e8-fd113dd759bc service cinder] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:27.953834 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-72188753-b909-4f0c-90e8-fd113dd759bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:27.955717 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44b788-4200-4a65-8265-123e806123bf None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:27.957300 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-bb44b788-4200-4a65-8265-123e806123bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:28.059189 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44b788-4200-4a65-8265-123e806123bf None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:28.068166 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215398a-3a2b-4e52-8c69-b2ee4dba5f3d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e089e39e9de419b9e2fb1d7fc2d245a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:28.069263 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215398a-3a2b-4e52-8c69-b2ee4dba5f3d service swift] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:28.069766 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215398a-3a2b-4e52-8c69-b2ee4dba5f3d service swift] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:28.070313 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215398a-3a2b-4e52-8c69-b2ee4dba5f3d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:28.086358 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215398a-3a2b-4e52-8c69-b2ee4dba5f3d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:28.089505 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d215398a-3a2b-4e52-8c69-b2ee4dba5f3d service swift] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:28.106180 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1407/2828] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 05:00:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 26 05:00:28.107240 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72188753-b909-4f0c-90e8-fd113dd759bc service cinder] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:28.114325 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503539d-1b40-4cd0-a414-a0e41fb1eefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:28.115126 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503539d-1b40-4cd0-a414-a0e41fb1eefe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:28.115406 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503539d-1b40-4cd0-a414-a0e41fb1eefe admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:28.115678 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503539d-1b40-4cd0-a414-a0e41fb1eefe admin admin] PATH_INFO: `/v3/users/70b282ba6b1c48eab567431ab374d385` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:28.117199 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503539d-1b40-4cd0-a414-a0e41fb1eefe admin admin] RBAC: Authorizing `identity:delete_user(user_id=70b282ba6b1c48eab567431ab374d385)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:28.119316 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503539d-1b40-4cd0-a414-a0e41fb1eefe admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:28.242354 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-4503539d-1b40-4cd0-a414-a0e41fb1eefe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70b282ba6b1c48eab567431ab374d385'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:28.246759 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-4503539d-1b40-4cd0-a414-a0e41fb1eefe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70b282ba6b1c48eab567431ab374d385'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:28.269120 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-4503539d-1b40-4cd0-a414-a0e41fb1eefe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70b282ba6b1c48eab567431ab374d385'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:28.301215 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-4503539d-1b40-4cd0-a414-a0e41fb1eefe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70b282ba6b1c48eab567431ab374d385'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:28.318620 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-4503539d-1b40-4cd0-a414-a0e41fb1eefe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70b282ba6b1c48eab567431ab374d385'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:28.331523 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1422/2829] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 05:00:27 2022] DELETE /identity/v3/users/70b282ba6b1c48eab567431ab374d385 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:28.336192 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d9eb1-7506-49a4-9d69-0e2ad36d9617 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:28.336499 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d9eb1-7506-49a4-9d69-0e2ad36d9617 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:28.336887 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d9eb1-7506-49a4-9d69-0e2ad36d9617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:28.395584 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-811d9eb1-7506-49a4-9d69-0e2ad36d9617 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:00:28.397634 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-811d9eb1-7506-49a4-9d69-0e2ad36d9617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:28.424951 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:28.508999 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1408/2830] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:00:28.523608 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503539d-1b40-4cd0-a414-a0e41fb1eefe admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:28.526504 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-4503539d-1b40-4cd0-a414-a0e41fb1eefe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:28.572412 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:28.628237 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503539d-1b40-4cd0-a414-a0e41fb1eefe admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:28.634291 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf36df9-2113-4616-874d-a08fffd983eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:28.635006 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf36df9-2113-4616-874d-a08fffd983eb service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:28.635291 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf36df9-2113-4616-874d-a08fffd983eb service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:28.635568 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf36df9-2113-4616-874d-a08fffd983eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:28.649273 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf36df9-2113-4616-874d-a08fffd983eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:28.651182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf36df9-2113-4616-874d-a08fffd983eb service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:28.677196 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1423/2831] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 05:00:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 05:00:29.170084 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d9eb1-7506-49a4-9d69-0e2ad36d9617 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:29.172494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-811d9eb1-7506-49a4-9d69-0e2ad36d9617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:29.197899 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d9eb1-7506-49a4-9d69-0e2ad36d9617 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:29.208196 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a36127-a077-4f88-9b77-7c20ec19944f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:29.209320 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a36127-a077-4f88-9b77-7c20ec19944f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:29.210230 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a36127-a077-4f88-9b77-7c20ec19944f admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:29.210745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a36127-a077-4f88-9b77-7c20ec19944f admin admin] PATH_INFO: `/v3/projects/d748449049fd436991f942892e594e83` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:29.213128 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a36127-a077-4f88-9b77-7c20ec19944f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d748449049fd436991f942892e594e83)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:29.217866 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a36127-a077-4f88-9b77-7c20ec19944f admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:29.319751 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-00a36127-a077-4f88-9b77-7c20ec19944f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd748449049fd436991f942892e594e83', 'request_id': 'req-00a36127-a077-4f88-9b77-7c20ec19944f'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:29.332522 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-00a36127-a077-4f88-9b77-7c20ec19944f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd748449049fd436991f942892e594e83', 'request_id': 'req-00a36127-a077-4f88-9b77-7c20ec19944f'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:29.345107 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-00a36127-a077-4f88-9b77-7c20ec19944f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd748449049fd436991f942892e594e83', 'request_id': 'req-00a36127-a077-4f88-9b77-7c20ec19944f'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:29.364386 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-00a36127-a077-4f88-9b77-7c20ec19944f admin admin] The token cache is being invalidate because project d748449049fd436991f942892e594e83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 05:00:29.364961 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-00a36127-a077-4f88-9b77-7c20ec19944f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:29.365881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-00a36127-a077-4f88-9b77-7c20ec19944f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:29.368680 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1409/2832] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 05:00:29 2022] DELETE /identity/v3/projects/d748449049fd436991f942892e594e83 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:29.375641 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf36df9-2113-4616-874d-a08fffd983eb service neutron] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:29.398640 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf36df9-2113-4616-874d-a08fffd983eb service neutron] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:29.502938 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7c952-9aab-4bb4-bfa1-d2072e2681f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:29.504368 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7c952-9aab-4bb4-bfa1-d2072e2681f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:29.504892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7c952-9aab-4bb4-bfa1-d2072e2681f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:29.505193 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7c952-9aab-4bb4-bfa1-d2072e2681f9 admin admin] PATH_INFO: `/v3/users/7fc90e883bc84b53a557ecdaf4900624` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:29.508628 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7c952-9aab-4bb4-bfa1-d2072e2681f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fc90e883bc84b53a557ecdaf4900624)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:29.511612 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d7c952-9aab-4bb4-bfa1-d2072e2681f9 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:29.602887 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-e2d7c952-9aab-4bb4-bfa1-d2072e2681f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fc90e883bc84b53a557ecdaf4900624'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:29.603873 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-e2d7c952-9aab-4bb4-bfa1-d2072e2681f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fc90e883bc84b53a557ecdaf4900624'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:29.616353 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-e2d7c952-9aab-4bb4-bfa1-d2072e2681f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fc90e883bc84b53a557ecdaf4900624'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:29.638429 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-e2d7c952-9aab-4bb4-bfa1-d2072e2681f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fc90e883bc84b53a557ecdaf4900624'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:29.652332 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-e2d7c952-9aab-4bb4-bfa1-d2072e2681f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fc90e883bc84b53a557ecdaf4900624'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:29.662929 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1424/2833] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 05:00:29 2022] DELETE /identity/v3/users/7fc90e883bc84b53a557ecdaf4900624 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:30.120728 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a36127-a077-4f88-9b77-7c20ec19944f admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:30.122643 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-00a36127-a077-4f88-9b77-7c20ec19944f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:30.158795 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a36127-a077-4f88-9b77-7c20ec19944f admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:30.279194 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57453411-6095-4344-9ecf-b52a45bd6115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:30.280073 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57453411-6095-4344-9ecf-b52a45bd6115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:30.280391 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57453411-6095-4344-9ecf-b52a45bd6115 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:30.280672 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57453411-6095-4344-9ecf-b52a45bd6115 admin admin] PATH_INFO: `/v3/projects/b2962bba51b942bc9025c49deb48b92c` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:30.282933 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57453411-6095-4344-9ecf-b52a45bd6115 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2962bba51b942bc9025c49deb48b92c)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:30.285999 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57453411-6095-4344-9ecf-b52a45bd6115 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:30.381469 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:30.386846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-57453411-6095-4344-9ecf-b52a45bd6115 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2962bba51b942bc9025c49deb48b92c', 'request_id': 'req-57453411-6095-4344-9ecf-b52a45bd6115'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:30.407574 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-57453411-6095-4344-9ecf-b52a45bd6115 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2962bba51b942bc9025c49deb48b92c', 'request_id': 'req-57453411-6095-4344-9ecf-b52a45bd6115'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:30.420044 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-57453411-6095-4344-9ecf-b52a45bd6115 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2962bba51b942bc9025c49deb48b92c', 'request_id': 'req-57453411-6095-4344-9ecf-b52a45bd6115'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:30.443766 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-57453411-6095-4344-9ecf-b52a45bd6115 admin admin] The token cache is being invalidate because project b2962bba51b942bc9025c49deb48b92c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 05:00:30.443766 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-57453411-6095-4344-9ecf-b52a45bd6115 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:30.445085 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-57453411-6095-4344-9ecf-b52a45bd6115 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:30.454489 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1410/2834] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 05:00:30 2022] DELETE /identity/v3/projects/b2962bba51b942bc9025c49deb48b92c => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:30.456400 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7c952-9aab-4bb4-bfa1-d2072e2681f9 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:30.458554 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-e2d7c952-9aab-4bb4-bfa1-d2072e2681f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:30.478673 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7c952-9aab-4bb4-bfa1-d2072e2681f9 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:30.552002 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:30.581422 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f218c6-3694-4521-ad38-57b0398e5e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:30.582577 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f218c6-3694-4521-ad38-57b0398e5e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:30.583057 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f218c6-3694-4521-ad38-57b0398e5e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:30.583621 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f218c6-3694-4521-ad38-57b0398e5e24 admin admin] PATH_INFO: `/v3/users/8ff3ff9cf7184ea2b60f9eba41e9e043` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:30.585278 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f218c6-3694-4521-ad38-57b0398e5e24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff3ff9cf7184ea2b60f9eba41e9e043)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:30.589001 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f218c6-3694-4521-ad38-57b0398e5e24 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:30.688254 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-38f218c6-3694-4521-ad38-57b0398e5e24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff3ff9cf7184ea2b60f9eba41e9e043'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:30.689211 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-38f218c6-3694-4521-ad38-57b0398e5e24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff3ff9cf7184ea2b60f9eba41e9e043'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:30.706866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-38f218c6-3694-4521-ad38-57b0398e5e24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff3ff9cf7184ea2b60f9eba41e9e043'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:30.736677 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-38f218c6-3694-4521-ad38-57b0398e5e24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff3ff9cf7184ea2b60f9eba41e9e043'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:30.751399 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-38f218c6-3694-4521-ad38-57b0398e5e24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff3ff9cf7184ea2b60f9eba41e9e043'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:30.768713 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1425/2835] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 05:00:30 2022] DELETE /identity/v3/users/8ff3ff9cf7184ea2b60f9eba41e9e043 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:31.364372 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57453411-6095-4344-9ecf-b52a45bd6115 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:31.366731 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-57453411-6095-4344-9ecf-b52a45bd6115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:31.382908 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57453411-6095-4344-9ecf-b52a45bd6115 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:31.517202 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12581e70-8a73-45cf-9cd6-56e988de4c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:31.518309 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12581e70-8a73-45cf-9cd6-56e988de4c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:31.518802 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12581e70-8a73-45cf-9cd6-56e988de4c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:31.519151 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12581e70-8a73-45cf-9cd6-56e988de4c5a admin admin] PATH_INFO: `/v3/projects/cbc3a20d3ce24cbb8014ff00190299d4` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:31.521211 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12581e70-8a73-45cf-9cd6-56e988de4c5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbc3a20d3ce24cbb8014ff00190299d4)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:31.524388 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12581e70-8a73-45cf-9cd6-56e988de4c5a admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:31.622557 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-12581e70-8a73-45cf-9cd6-56e988de4c5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbc3a20d3ce24cbb8014ff00190299d4', 'request_id': 'req-12581e70-8a73-45cf-9cd6-56e988de4c5a'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:31.648088 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-12581e70-8a73-45cf-9cd6-56e988de4c5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbc3a20d3ce24cbb8014ff00190299d4', 'request_id': 'req-12581e70-8a73-45cf-9cd6-56e988de4c5a'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:31.662677 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-12581e70-8a73-45cf-9cd6-56e988de4c5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbc3a20d3ce24cbb8014ff00190299d4', 'request_id': 'req-12581e70-8a73-45cf-9cd6-56e988de4c5a'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:31.686846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-12581e70-8a73-45cf-9cd6-56e988de4c5a admin admin] The token cache is being invalidate because project cbc3a20d3ce24cbb8014ff00190299d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 05:00:31.687851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-12581e70-8a73-45cf-9cd6-56e988de4c5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:31.689203 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-12581e70-8a73-45cf-9cd6-56e988de4c5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:31.692547 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1411/2836] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 05:00:31 2022] DELETE /identity/v3/projects/cbc3a20d3ce24cbb8014ff00190299d4 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 05:00:31.702299 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02fc78-af45-4195-b320-1c39bc5a6567 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:31.703183 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02fc78-af45-4195-b320-1c39bc5a6567 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:31.703183 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02fc78-af45-4195-b320-1c39bc5a6567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:31.789096 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-cc02fc78-af45-4195-b320-1c39bc5a6567 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:00:31.790457 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-cc02fc78-af45-4195-b320-1c39bc5a6567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:31.885608 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1426/2837] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 05:00:31.915726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492e50c-11ea-45b3-8f5c-863008c2b243 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:31.915726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492e50c-11ea-45b3-8f5c-863008c2b243 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:31.915726 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8492e50c-11ea-45b3-8f5c-863008c2b243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:31.951011 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-8492e50c-11ea-45b3-8f5c-863008c2b243 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:00:31.953013 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-8492e50c-11ea-45b3-8f5c-863008c2b243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:31.967252 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1412/2838] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 05:00:31.974586 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02fc78-af45-4195-b320-1c39bc5a6567 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:31.989930 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02fc78-af45-4195-b320-1c39bc5a6567 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:31.996233 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14271c1-6184-4431-bea2-c9c207141fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:31.997148 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14271c1-6184-4431-bea2-c9c207141fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:31.997148 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14271c1-6184-4431-bea2-c9c207141fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:31.997826 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14271c1-6184-4431-bea2-c9c207141fe0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:31.998159 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14271c1-6184-4431-bea2-c9c207141fe0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 05:00:31.998462 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14271c1-6184-4431-bea2-c9c207141fe0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:32.000156 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14271c1-6184-4431-bea2-c9c207141fe0 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:32.016736 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1427/2839] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 05:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 05:00:32.022701 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492e50c-11ea-45b3-8f5c-863008c2b243 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:32.051764 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8492e50c-11ea-45b3-8f5c-863008c2b243 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:32.068007 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525829f-0d0b-4aee-9ce2-d4677872a714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:32.069497 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525829f-0d0b-4aee-9ce2-d4677872a714 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:32.070187 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525829f-0d0b-4aee-9ce2-d4677872a714 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:32.070786 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525829f-0d0b-4aee-9ce2-d4677872a714 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:32.072131 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525829f-0d0b-4aee-9ce2-d4677872a714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:32.077550 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525829f-0d0b-4aee-9ce2-d4677872a714 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:32.138043 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1413/2840] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 05:00:32 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 05:00:32.141792 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14271c1-6184-4431-bea2-c9c207141fe0 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:32.164872 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14271c1-6184-4431-bea2-c9c207141fe0 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:32.225487 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:32.324971 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43e94a-51fc-4b09-be41-ac3c04a23abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:32.325901 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43e94a-51fc-4b09-be41-ac3c04a23abb admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:32.326411 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43e94a-51fc-4b09-be41-ac3c04a23abb admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:32.326828 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43e94a-51fc-4b09-be41-ac3c04a23abb admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:32.327709 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43e94a-51fc-4b09-be41-ac3c04a23abb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:32.330554 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43e94a-51fc-4b09-be41-ac3c04a23abb admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:32.374069 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1428/2841] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 05:00:32 2022] POST /identity/v3/users => generated 292 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 05:00:32.379427 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525829f-0d0b-4aee-9ce2-d4677872a714 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:32.400307 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525829f-0d0b-4aee-9ce2-d4677872a714 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:32.410604 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945e9ea-c295-4ed0-ba6d-147b18850fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:32.411645 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945e9ea-c295-4ed0-ba6d-147b18850fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:32.412150 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945e9ea-c295-4ed0-ba6d-147b18850fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:32.412568 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945e9ea-c295-4ed0-ba6d-147b18850fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:32.414091 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945e9ea-c295-4ed0-ba6d-147b18850fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:32.417080 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945e9ea-c295-4ed0-ba6d-147b18850fe6 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:32.438864 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1414/2842] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 05:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 05:00:32.443688 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43e94a-51fc-4b09-be41-ac3c04a23abb admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:32.468112 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43e94a-51fc-4b09-be41-ac3c04a23abb admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:32.483774 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1e075-ee15-4dc3-97e1-864e111d2ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:32.485245 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1e075-ee15-4dc3-97e1-864e111d2ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:32.486009 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1e075-ee15-4dc3-97e1-864e111d2ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:32.497361 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1e075-ee15-4dc3-97e1-864e111d2ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:32.498528 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1e075-ee15-4dc3-97e1-864e111d2ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:32.502243 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1e075-ee15-4dc3-97e1-864e111d2ff2 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:32.532229 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1429/2843] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 05:00:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 05:00:32.537733 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945e9ea-c295-4ed0-ba6d-147b18850fe6 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:32.561527 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945e9ea-c295-4ed0-ba6d-147b18850fe6 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:32.572621 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec79fe-a5e8-46cd-8a0b-3cffe7151af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:32.574592 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec79fe-a5e8-46cd-8a0b-3cffe7151af6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:32.575413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec79fe-a5e8-46cd-8a0b-3cffe7151af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:32.576104 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec79fe-a5e8-46cd-8a0b-3cffe7151af6 admin admin] PATH_INFO: `/v3/projects/8f2655b4beeb4db4aecfebe1dfdecae2/users/ea02591e99a64637b0f25b53015611c4/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:32.619910 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec79fe-a5e8-46cd-8a0b-3cffe7151af6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f2655b4beeb4db4aecfebe1dfdecae2, user_id=ea02591e99a64637b0f25b53015611c4, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:32.627047 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec79fe-a5e8-46cd-8a0b-3cffe7151af6 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:32.649499 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:32.662672 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1415/2844] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 05:00:32 2022] PUT /identity/v3/projects/8f2655b4beeb4db4aecfebe1dfdecae2/users/ea02591e99a64637b0f25b53015611c4/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:32.692970 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5b06b-f111-434b-b829-61a587ab8f5a None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:32.693714 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5b06b-f111-434b-b829-61a587ab8f5a None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:32.694386 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5b06b-f111-434b-b829-61a587ab8f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:32.780208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-6cb5b06b-f111-434b-b829-61a587ab8f5a None None] MFA Rules not processed for user `ea02591e99a64637b0f25b53015611c4`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:00:32.788544 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-6cb5b06b-f111-434b-b829-61a587ab8f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:32.976029 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1430/2845] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:00:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 26 05:00:32.984051 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec79fe-a5e8-46cd-8a0b-3cffe7151af6 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:33.153617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec79fe-a5e8-46cd-8a0b-3cffe7151af6 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:33.162859 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade16b99-1bd7-4346-8e62-2a4092dbbc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:33.163995 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade16b99-1bd7-4346-8e62-2a4092dbbc9c admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:33.164522 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade16b99-1bd7-4346-8e62-2a4092dbbc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:33.165072 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade16b99-1bd7-4346-8e62-2a4092dbbc9c admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:33.166429 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade16b99-1bd7-4346-8e62-2a4092dbbc9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:33.170613 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade16b99-1bd7-4346-8e62-2a4092dbbc9c admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:33.224968 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1416/2846] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 05:00:32 2022] POST /identity/v3/projects => generated 383 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 05:00:33.231246 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5b06b-f111-434b-b829-61a587ab8f5a None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:33.253171 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5b06b-f111-434b-b829-61a587ab8f5a None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:33.385430 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94859ecc-4c8d-45d4-a65e-04c8ab6743be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:33.386610 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94859ecc-4c8d-45d4-a65e-04c8ab6743be admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:33.387106 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94859ecc-4c8d-45d4-a65e-04c8ab6743be admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:33.387595 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94859ecc-4c8d-45d4-a65e-04c8ab6743be admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:33.388895 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94859ecc-4c8d-45d4-a65e-04c8ab6743be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:33.392799 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94859ecc-4c8d-45d4-a65e-04c8ab6743be admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:33.441258 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade16b99-1bd7-4346-8e62-2a4092dbbc9c admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:33.442169 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1431/2847] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 05:00:33 2022] POST /identity/v3/users => generated 298 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 05:00:33.462460 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade16b99-1bd7-4346-8e62-2a4092dbbc9c admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:33.471052 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21a86b-ba6e-4dfd-b20f-096d91e9ba25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:33.472212 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21a86b-ba6e-4dfd-b20f-096d91e9ba25 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:33.472902 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21a86b-ba6e-4dfd-b20f-096d91e9ba25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:33.473396 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21a86b-ba6e-4dfd-b20f-096d91e9ba25 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:33.474911 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21a86b-ba6e-4dfd-b20f-096d91e9ba25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:33.478169 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21a86b-ba6e-4dfd-b20f-096d91e9ba25 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:33.502781 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1417/2848] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 05:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 05:00:33.510528 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94859ecc-4c8d-45d4-a65e-04c8ab6743be admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:33.531213 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94859ecc-4c8d-45d4-a65e-04c8ab6743be admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:33.541901 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c0c8a-5780-462d-bb93-01152a81e35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:33.543667 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c0c8a-5780-462d-bb93-01152a81e35f admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:33.544388 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c0c8a-5780-462d-bb93-01152a81e35f admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:33.544892 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c0c8a-5780-462d-bb93-01152a81e35f admin admin] PATH_INFO: `/v3/projects/a62cc0bca789403aaffe528dc3129a7a/users/2c43a318c161403eb1b65cd6b7c010d6/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:33.577335 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c0c8a-5780-462d-bb93-01152a81e35f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a62cc0bca789403aaffe528dc3129a7a, user_id=2c43a318c161403eb1b65cd6b7c010d6, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:33.582307 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c0c8a-5780-462d-bb93-01152a81e35f admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:33.603186 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:33.622239 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1432/2849] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 05:00:33 2022] PUT /identity/v3/projects/a62cc0bca789403aaffe528dc3129a7a/users/2c43a318c161403eb1b65cd6b7c010d6/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:33.624863 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21a86b-ba6e-4dfd-b20f-096d91e9ba25 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:33.647523 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21a86b-ba6e-4dfd-b20f-096d91e9ba25 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:33.816381 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b5167-55dc-4920-b0c0-cec481074920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:33.819452 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b5167-55dc-4920-b0c0-cec481074920 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:33.821163 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b5167-55dc-4920-b0c0-cec481074920 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:33.822682 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b5167-55dc-4920-b0c0-cec481074920 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:33.824464 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b5167-55dc-4920-b0c0-cec481074920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:33.828024 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b5167-55dc-4920-b0c0-cec481074920 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:33.852005 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1418/2850] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 05:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 05:00:33.858326 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c0c8a-5780-462d-bb93-01152a81e35f admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:33.872570 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c0c8a-5780-462d-bb93-01152a81e35f admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:33.878465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114902b6-2715-44e7-8f16-bc11c7d64502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:33.879339 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114902b6-2715-44e7-8f16-bc11c7d64502 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:33.879634 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114902b6-2715-44e7-8f16-bc11c7d64502 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:33.880059 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114902b6-2715-44e7-8f16-bc11c7d64502 admin admin] PATH_INFO: `/v3/projects/a62cc0bca789403aaffe528dc3129a7a/users/2c43a318c161403eb1b65cd6b7c010d6/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:33.882402 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114902b6-2715-44e7-8f16-bc11c7d64502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a62cc0bca789403aaffe528dc3129a7a, user_id=2c43a318c161403eb1b65cd6b7c010d6, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:33.885296 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114902b6-2715-44e7-8f16-bc11c7d64502 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:33.902050 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1433/2851] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 05:00:33 2022] PUT /identity/v3/projects/a62cc0bca789403aaffe528dc3129a7a/users/2c43a318c161403eb1b65cd6b7c010d6/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 05:00:33.914766 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a36ce-54be-4cd2-aa80-b5d983e0cd14 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:33.915745 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a36ce-54be-4cd2-aa80-b5d983e0cd14 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:33.917746 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a36ce-54be-4cd2-aa80-b5d983e0cd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:33.978505 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-584a36ce-54be-4cd2-aa80-b5d983e0cd14 None None] MFA Rules not processed for user `2c43a318c161403eb1b65cd6b7c010d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:00:33.980996 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-584a36ce-54be-4cd2-aa80-b5d983e0cd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:34.110116 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:34.144587 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1419/2852] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:00:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:00:34.167287 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114902b6-2715-44e7-8f16-bc11c7d64502 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:34.172961 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-114902b6-2715-44e7-8f16-bc11c7d64502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:34.296854 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114902b6-2715-44e7-8f16-bc11c7d64502 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:34.303133 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34a75c-226f-4a91-bcf3-76c49d28632f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:34.304284 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34a75c-226f-4a91-bcf3-76c49d28632f service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:34.305162 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34a75c-226f-4a91-bcf3-76c49d28632f service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:34.305763 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34a75c-226f-4a91-bcf3-76c49d28632f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:34.320927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34a75c-226f-4a91-bcf3-76c49d28632f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:34.322657 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34a75c-226f-4a91-bcf3-76c49d28632f service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:34.337232 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1434/2853] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 05:00:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 05:00:34.524815 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a36ce-54be-4cd2-aa80-b5d983e0cd14 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:34.543075 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a36ce-54be-4cd2-aa80-b5d983e0cd14 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:34.552639 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42d1a1-2736-4c5e-a853-3f7865bd8816 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:34.553559 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42d1a1-2736-4c5e-a853-3f7865bd8816 service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:34.553967 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42d1a1-2736-4c5e-a853-3f7865bd8816 service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:34.554467 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42d1a1-2736-4c5e-a853-3f7865bd8816 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:34.686810 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42d1a1-2736-4c5e-a853-3f7865bd8816 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:34.689366 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42d1a1-2736-4c5e-a853-3f7865bd8816 service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:34.717292 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1420/2854] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 05:00:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 05:00:37.939162 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34a75c-226f-4a91-bcf3-76c49d28632f service cinder] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:38.042098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34a75c-226f-4a91-bcf3-76c49d28632f service cinder] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:38.048045 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af9827-6100-4a74-a92c-cfd9e0f05080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:38.049167 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af9827-6100-4a74-a92c-cfd9e0f05080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:38.049545 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af9827-6100-4a74-a92c-cfd9e0f05080 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:38.049926 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af9827-6100-4a74-a92c-cfd9e0f05080 admin admin] PATH_INFO: `/v3/users/ea02591e99a64637b0f25b53015611c4` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:38.051466 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af9827-6100-4a74-a92c-cfd9e0f05080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea02591e99a64637b0f25b53015611c4)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:38.055024 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af9827-6100-4a74-a92c-cfd9e0f05080 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:38.150689 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-17af9827-6100-4a74-a92c-cfd9e0f05080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea02591e99a64637b0f25b53015611c4'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:38.151532 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-17af9827-6100-4a74-a92c-cfd9e0f05080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea02591e99a64637b0f25b53015611c4'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:38.157083 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42d1a1-2736-4c5e-a853-3f7865bd8816 service cinder] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:38.159857 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-1b42d1a1-2736-4c5e-a853-3f7865bd8816 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:38.166399 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-17af9827-6100-4a74-a92c-cfd9e0f05080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea02591e99a64637b0f25b53015611c4'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:38.184641 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-17af9827-6100-4a74-a92c-cfd9e0f05080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea02591e99a64637b0f25b53015611c4'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:38.193843 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-17af9827-6100-4a74-a92c-cfd9e0f05080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea02591e99a64637b0f25b53015611c4'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:38.202052 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1435/2855] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 05:00:37 2022] DELETE /identity/v3/users/ea02591e99a64637b0f25b53015611c4 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:38.209220 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f98091-b821-4a2c-b501-85d1099bca68 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:38.209596 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f98091-b821-4a2c-b501-85d1099bca68 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:38.210526 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f98091-b821-4a2c-b501-85d1099bca68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:38.235520 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-60f98091-b821-4a2c-b501-85d1099bca68 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:00:38.237751 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-60f98091-b821-4a2c-b501-85d1099bca68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:38.243734 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:38.351248 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42d1a1-2736-4c5e-a853-3f7865bd8816 service cinder] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:38.383271 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1436/2856] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:00:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:00:38.397328 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f98091-b821-4a2c-b501-85d1099bca68 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:38.400345 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-60f98091-b821-4a2c-b501-85d1099bca68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:38.469037 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80714b-b012-4647-930e-1026c83ae688 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21dfe7b4d6524ec2885224d77395b00b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:38.469922 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80714b-b012-4647-930e-1026c83ae688 service placement] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:38.470310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80714b-b012-4647-930e-1026c83ae688 service placement] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:38.470686 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80714b-b012-4647-930e-1026c83ae688 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:38.473516 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-fb80714b-b012-4647-930e-1026c83ae688 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:38.492909 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80714b-b012-4647-930e-1026c83ae688 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:38.495286 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80714b-b012-4647-930e-1026c83ae688 service placement] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:38.514028 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1421/2857] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 05:00:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 05:00:38.520242 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f98091-b821-4a2c-b501-85d1099bca68 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:38.527793 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45934ea-831f-4825-a964-8dd2af162e37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:38.529159 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45934ea-831f-4825-a964-8dd2af162e37 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:38.529712 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45934ea-831f-4825-a964-8dd2af162e37 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:38.530431 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45934ea-831f-4825-a964-8dd2af162e37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:38.551252 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45934ea-831f-4825-a964-8dd2af162e37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:38.554786 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45934ea-831f-4825-a964-8dd2af162e37 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:38.567823 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1437/2858] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 05:00:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 05:00:38.995942 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80714b-b012-4647-930e-1026c83ae688 service placement] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:38.997921 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-fb80714b-b012-4647-930e-1026c83ae688 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:39.035369 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80714b-b012-4647-930e-1026c83ae688 service placement] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:39.045367 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ac654-556c-47ba-a5ab-78ec6d9d7b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:39.046476 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ac654-556c-47ba-a5ab-78ec6d9d7b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:39.047174 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ac654-556c-47ba-a5ab-78ec6d9d7b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:39.047604 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ac654-556c-47ba-a5ab-78ec6d9d7b9c admin admin] PATH_INFO: `/v3/projects/8f2655b4beeb4db4aecfebe1dfdecae2` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:39.049857 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ac654-556c-47ba-a5ab-78ec6d9d7b9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f2655b4beeb4db4aecfebe1dfdecae2)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:39.053640 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ac654-556c-47ba-a5ab-78ec6d9d7b9c admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:39.056427 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=100 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:39.137549 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f91ac654-556c-47ba-a5ab-78ec6d9d7b9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f2655b4beeb4db4aecfebe1dfdecae2', 'request_id': 'req-f91ac654-556c-47ba-a5ab-78ec6d9d7b9c'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:39.150728 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f91ac654-556c-47ba-a5ab-78ec6d9d7b9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f2655b4beeb4db4aecfebe1dfdecae2', 'request_id': 'req-f91ac654-556c-47ba-a5ab-78ec6d9d7b9c'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:39.162609 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f91ac654-556c-47ba-a5ab-78ec6d9d7b9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f2655b4beeb4db4aecfebe1dfdecae2', 'request_id': 'req-f91ac654-556c-47ba-a5ab-78ec6d9d7b9c'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:39.190310 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f91ac654-556c-47ba-a5ab-78ec6d9d7b9c admin admin] The token cache is being invalidate because project 8f2655b4beeb4db4aecfebe1dfdecae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 05:00:39.190802 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f91ac654-556c-47ba-a5ab-78ec6d9d7b9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:39.191989 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f91ac654-556c-47ba-a5ab-78ec6d9d7b9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:39.194880 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1422/2859] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 05:00:38 2022] DELETE /identity/v3/projects/8f2655b4beeb4db4aecfebe1dfdecae2 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:39.200550 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45934ea-831f-4825-a964-8dd2af162e37 service neutron] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:39.212907 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45934ea-831f-4825-a964-8dd2af162e37 service neutron] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:39.338713 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17130507-bc03-4035-9e7d-ba598b06b243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:39.340428 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17130507-bc03-4035-9e7d-ba598b06b243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:39.341197 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17130507-bc03-4035-9e7d-ba598b06b243 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:39.341734 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17130507-bc03-4035-9e7d-ba598b06b243 admin admin] PATH_INFO: `/v3/users/2c43a318c161403eb1b65cd6b7c010d6` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:39.344341 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17130507-bc03-4035-9e7d-ba598b06b243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c43a318c161403eb1b65cd6b7c010d6)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:39.348398 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17130507-bc03-4035-9e7d-ba598b06b243 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:39.446912 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-17130507-bc03-4035-9e7d-ba598b06b243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c43a318c161403eb1b65cd6b7c010d6'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:39.447998 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-17130507-bc03-4035-9e7d-ba598b06b243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c43a318c161403eb1b65cd6b7c010d6'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:39.461966 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-17130507-bc03-4035-9e7d-ba598b06b243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c43a318c161403eb1b65cd6b7c010d6'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:39.464413 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:39.492802 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-17130507-bc03-4035-9e7d-ba598b06b243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c43a318c161403eb1b65cd6b7c010d6'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:39.506137 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-17130507-bc03-4035-9e7d-ba598b06b243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c43a318c161403eb1b65cd6b7c010d6'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:39.518022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1438/2860] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 05:00:39 2022] DELETE /identity/v3/users/2c43a318c161403eb1b65cd6b7c010d6 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 05:00:40.140260 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ac654-556c-47ba-a5ab-78ec6d9d7b9c admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:40.141331 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-f91ac654-556c-47ba-a5ab-78ec6d9d7b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:40.170984 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ac654-556c-47ba-a5ab-78ec6d9d7b9c admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:40.313439 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4185b2a-f322-4848-9ab3-285d6d6595c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:40.314915 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4185b2a-f322-4848-9ab3-285d6d6595c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:40.315291 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4185b2a-f322-4848-9ab3-285d6d6595c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:40.315576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4185b2a-f322-4848-9ab3-285d6d6595c1 admin admin] PATH_INFO: `/v3/projects/a62cc0bca789403aaffe528dc3129a7a` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:40.316959 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4185b2a-f322-4848-9ab3-285d6d6595c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a62cc0bca789403aaffe528dc3129a7a)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:40.319024 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4185b2a-f322-4848-9ab3-285d6d6595c1 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:40.413146 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f4185b2a-f322-4848-9ab3-285d6d6595c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a62cc0bca789403aaffe528dc3129a7a', 'request_id': 'req-f4185b2a-f322-4848-9ab3-285d6d6595c1'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:40.425458 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f4185b2a-f322-4848-9ab3-285d6d6595c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a62cc0bca789403aaffe528dc3129a7a', 'request_id': 'req-f4185b2a-f322-4848-9ab3-285d6d6595c1'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:40.434943 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f4185b2a-f322-4848-9ab3-285d6d6595c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a62cc0bca789403aaffe528dc3129a7a', 'request_id': 'req-f4185b2a-f322-4848-9ab3-285d6d6595c1'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:40.458744 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f4185b2a-f322-4848-9ab3-285d6d6595c1 admin admin] The token cache is being invalidate because project a62cc0bca789403aaffe528dc3129a7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 05:00:40.459232 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f4185b2a-f322-4848-9ab3-285d6d6595c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:40.460798 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-f4185b2a-f322-4848-9ab3-285d6d6595c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:40.463774 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1423/2861] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 05:00:40 2022] DELETE /identity/v3/projects/a62cc0bca789403aaffe528dc3129a7a => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 05:00:46.696129 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2aa6d-498b-4078-99a9-3046374b5c84 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:46.696770 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2aa6d-498b-4078-99a9-3046374b5c84 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:46.696770 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe2aa6d-498b-4078-99a9-3046374b5c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:46.718200 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-bbe2aa6d-498b-4078-99a9-3046374b5c84 None None] MFA Rules not processed for user `b613dee1148c4822af2e7847b28cf4aa`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:00:46.719521 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-bbe2aa6d-498b-4078-99a9-3046374b5c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:46.786961 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1439/2862] 10.222.0.39 () {58 vars in 967 bytes} [Tue Jul 26 05:00:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:00:46.800533 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4185b2a-f322-4848-9ab3-285d6d6595c1 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:46.802115 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-f4185b2a-f322-4848-9ab3-285d6d6595c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:46.829132 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:46.889976 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4185b2a-f322-4848-9ab3-285d6d6595c1 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:46.895641 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee567b-cda8-4992-991f-3ac308a7a72f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e089e39e9de419b9e2fb1d7fc2d245a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:46.896301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee567b-cda8-4992-991f-3ac308a7a72f service swift] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:46.896583 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee567b-cda8-4992-991f-3ac308a7a72f service swift] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:46.896855 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee567b-cda8-4992-991f-3ac308a7a72f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:46.906790 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee567b-cda8-4992-991f-3ac308a7a72f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:46.908506 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee567b-cda8-4992-991f-3ac308a7a72f service swift] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:46.918972 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1424/2863] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 05:00:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 05:00:49.016987 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2aa6d-498b-4078-99a9-3046374b5c84 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:49.018988 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-bbe2aa6d-498b-4078-99a9-3046374b5c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:49.119439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe2aa6d-498b-4078-99a9-3046374b5c84 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:49.127231 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762c85d-afa6-48ca-93d1-bc93641fd301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:49.128374 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762c85d-afa6-48ca-93d1-bc93641fd301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:49.128720 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762c85d-afa6-48ca-93d1-bc93641fd301 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:49.129140 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762c85d-afa6-48ca-93d1-bc93641fd301 admin admin] PATH_INFO: `/v3/users/4128804de02b42bc81bb2950cb698b3c` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:49.131478 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762c85d-afa6-48ca-93d1-bc93641fd301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4128804de02b42bc81bb2950cb698b3c)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:49.135474 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762c85d-afa6-48ca-93d1-bc93641fd301 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:49.210012 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-e762c85d-afa6-48ca-93d1-bc93641fd301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4128804de02b42bc81bb2950cb698b3c'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:49.210725 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-e762c85d-afa6-48ca-93d1-bc93641fd301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4128804de02b42bc81bb2950cb698b3c'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:49.221054 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-e762c85d-afa6-48ca-93d1-bc93641fd301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4128804de02b42bc81bb2950cb698b3c'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:49.236552 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-e762c85d-afa6-48ca-93d1-bc93641fd301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4128804de02b42bc81bb2950cb698b3c'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:49.243723 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:49.247847 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-e762c85d-afa6-48ca-93d1-bc93641fd301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4128804de02b42bc81bb2950cb698b3c'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:49.258113 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1440/2864] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 05:00:49 2022] DELETE /identity/v3/users/4128804de02b42bc81bb2950cb698b3c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:49.465515 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee567b-cda8-4992-991f-3ac308a7a72f service swift] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:49.485574 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee567b-cda8-4992-991f-3ac308a7a72f service swift] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:49.575903 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6cb6bd-d4e3-4c0d-8ef3-a40e376f1dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:49.576563 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cb6bd-d4e3-4c0d-8ef3-a40e376f1dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:49.576851 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cb6bd-d4e3-4c0d-8ef3-a40e376f1dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:49.577108 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cb6bd-d4e3-4c0d-8ef3-a40e376f1dc6 admin admin] PATH_INFO: `/v3/projects/db3f71767d7143ca90a07ee7fbd2d524` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:49.578492 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6cb6bd-d4e3-4c0d-8ef3-a40e376f1dc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db3f71767d7143ca90a07ee7fbd2d524)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:49.580434 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6cb6bd-d4e3-4c0d-8ef3-a40e376f1dc6 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:49.640147 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8c6cb6bd-d4e3-4c0d-8ef3-a40e376f1dc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db3f71767d7143ca90a07ee7fbd2d524', 'request_id': 'req-8c6cb6bd-d4e3-4c0d-8ef3-a40e376f1dc6'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:49.650447 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8c6cb6bd-d4e3-4c0d-8ef3-a40e376f1dc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db3f71767d7143ca90a07ee7fbd2d524', 'request_id': 'req-8c6cb6bd-d4e3-4c0d-8ef3-a40e376f1dc6'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:49.657955 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8c6cb6bd-d4e3-4c0d-8ef3-a40e376f1dc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db3f71767d7143ca90a07ee7fbd2d524', 'request_id': 'req-8c6cb6bd-d4e3-4c0d-8ef3-a40e376f1dc6'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:49.672097 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8c6cb6bd-d4e3-4c0d-8ef3-a40e376f1dc6 admin admin] The token cache is being invalidate because project db3f71767d7143ca90a07ee7fbd2d524 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 05:00:49.672466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8c6cb6bd-d4e3-4c0d-8ef3-a40e376f1dc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:49.673279 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-8c6cb6bd-d4e3-4c0d-8ef3-a40e376f1dc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:00:49.675314 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1425/2865] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 05:00:49 2022] DELETE /identity/v3/projects/db3f71767d7143ca90a07ee7fbd2d524 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:49.681349 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620bd65-aed7-4052-8099-4985092b7d78 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:49.681797 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620bd65-aed7-4052-8099-4985092b7d78 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:49.682187 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620bd65-aed7-4052-8099-4985092b7d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:49.707089 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-d620bd65-aed7-4052-8099-4985092b7d78 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:00:49.708347 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-d620bd65-aed7-4052-8099-4985092b7d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:49.781673 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1441/2866] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:00:49.853061 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54804eda-e3ce-4a9e-9d6b-da6026d8f17f None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:49.853414 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54804eda-e3ce-4a9e-9d6b-da6026d8f17f None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:49.853761 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54804eda-e3ce-4a9e-9d6b-da6026d8f17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:49.876762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-54804eda-e3ce-4a9e-9d6b-da6026d8f17f None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:00:49.878160 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-54804eda-e3ce-4a9e-9d6b-da6026d8f17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:49.887762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1426/2867] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:00:49.892740 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620bd65-aed7-4052-8099-4985092b7d78 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:49.903583 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620bd65-aed7-4052-8099-4985092b7d78 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:49.909361 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af16ba7-93ba-4a04-ad4c-2c526dc40db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:49.910667 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af16ba7-93ba-4a04-ad4c-2c526dc40db7 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:49.911102 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af16ba7-93ba-4a04-ad4c-2c526dc40db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:49.911499 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af16ba7-93ba-4a04-ad4c-2c526dc40db7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:49.912341 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af16ba7-93ba-4a04-ad4c-2c526dc40db7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 05:00:49.912737 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af16ba7-93ba-4a04-ad4c-2c526dc40db7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:49.914599 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af16ba7-93ba-4a04-ad4c-2c526dc40db7 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:49.928833 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1442/2868] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 05:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 26 05:00:49.935513 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54804eda-e3ce-4a9e-9d6b-da6026d8f17f None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:49.945864 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54804eda-e3ce-4a9e-9d6b-da6026d8f17f None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:49.951049 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a654bf-1619-407e-bf97-21d64930a706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:49.951706 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a654bf-1619-407e-bf97-21d64930a706 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:49.952010 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a654bf-1619-407e-bf97-21d64930a706 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:49.952277 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a654bf-1619-407e-bf97-21d64930a706 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:49.952989 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a654bf-1619-407e-bf97-21d64930a706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:49.955012 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a654bf-1619-407e-bf97-21d64930a706 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:49.996513 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1427/2869] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 05:00:49 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 05:00:50.001832 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af16ba7-93ba-4a04-ad4c-2c526dc40db7 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:50.020927 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af16ba7-93ba-4a04-ad4c-2c526dc40db7 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:50.094438 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c18d0b-e64b-4e20-9614-f6de565c4385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:50.095139 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c18d0b-e64b-4e20-9614-f6de565c4385 admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:50.095447 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c18d0b-e64b-4e20-9614-f6de565c4385 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:50.095781 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c18d0b-e64b-4e20-9614-f6de565c4385 admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:50.096694 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c18d0b-e64b-4e20-9614-f6de565c4385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:50.098838 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c18d0b-e64b-4e20-9614-f6de565c4385 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:50.123464 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1443/2870] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 05:00:49 2022] POST /identity/v3/users => generated 287 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 05:00:50.128615 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a654bf-1619-407e-bf97-21d64930a706 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:50.140926 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a654bf-1619-407e-bf97-21d64930a706 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:50.146799 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8df72-72f9-4365-97b7-254413b50574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:50.147643 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8df72-72f9-4365-97b7-254413b50574 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:50.147926 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8df72-72f9-4365-97b7-254413b50574 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:50.148198 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8df72-72f9-4365-97b7-254413b50574 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:50.148939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8df72-72f9-4365-97b7-254413b50574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:50.150765 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8df72-72f9-4365-97b7-254413b50574 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:50.157891 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:50.165043 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1428/2871] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 05:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 05:00:50.169040 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c18d0b-e64b-4e20-9614-f6de565c4385 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:50.183745 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c18d0b-e64b-4e20-9614-f6de565c4385 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:50.190054 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8523bd-2281-416c-9c15-1c5307b3cf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:50.190839 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8523bd-2281-416c-9c15-1c5307b3cf88 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:50.191226 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8523bd-2281-416c-9c15-1c5307b3cf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:50.191856 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8523bd-2281-416c-9c15-1c5307b3cf88 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:50.192788 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8523bd-2281-416c-9c15-1c5307b3cf88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:50.194668 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8523bd-2281-416c-9c15-1c5307b3cf88 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:50.208465 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1444/2872] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 05:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 05:00:50.213158 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8df72-72f9-4365-97b7-254413b50574 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:50.225704 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8df72-72f9-4365-97b7-254413b50574 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:50.231772 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6bd8b-4d1d-48ae-a535-e24b4a88f29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:50.232489 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6bd8b-4d1d-48ae-a535-e24b4a88f29b admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:50.232768 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6bd8b-4d1d-48ae-a535-e24b4a88f29b admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:50.233040 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6bd8b-4d1d-48ae-a535-e24b4a88f29b admin admin] PATH_INFO: `/v3/projects/71427627ce1043fbbd1e58282e549f6c/users/db426336187644dc8c4d9c1870bbe711/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:50.264232 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc6bd8b-4d1d-48ae-a535-e24b4a88f29b admin admin] RBAC: Authorizing `identity:create_grant(project_id=71427627ce1043fbbd1e58282e549f6c, user_id=db426336187644dc8c4d9c1870bbe711, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:50.267700 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc6bd8b-4d1d-48ae-a535-e24b4a88f29b admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:50.292425 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1429/2873] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 05:00:50 2022] PUT /identity/v3/projects/71427627ce1043fbbd1e58282e549f6c/users/db426336187644dc8c4d9c1870bbe711/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:00:50.310616 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739fc84-f034-4cc2-98fe-92c6b0449297 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:50.311094 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739fc84-f034-4cc2-98fe-92c6b0449297 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:50.311567 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739fc84-f034-4cc2-98fe-92c6b0449297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:50.355325 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-d739fc84-f034-4cc2-98fe-92c6b0449297 None None] MFA Rules not processed for user `db426336187644dc8c4d9c1870bbe711`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:00:50.357609 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-d739fc84-f034-4cc2-98fe-92c6b0449297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:50.414415 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:00:50.435884 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1445/2874] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:00:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:00:50.448423 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6bd8b-4d1d-48ae-a535-e24b4a88f29b admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:00:50.451324 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-6fc6bd8b-4d1d-48ae-a535-e24b4a88f29b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:00:50.568250 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6bd8b-4d1d-48ae-a535-e24b4a88f29b admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:00:50.572373 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23dee4d-345c-471a-8489-1c92b0583368 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:00:50.573111 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dee4d-345c-471a-8489-1c92b0583368 service cinder] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:00:50.573431 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dee4d-345c-471a-8489-1c92b0583368 service cinder] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:00:50.573861 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23dee4d-345c-471a-8489-1c92b0583368 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:00:50.585653 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23dee4d-345c-471a-8489-1c92b0583368 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:00:50.587376 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23dee4d-345c-471a-8489-1c92b0583368 service cinder] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:00:50.598490 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1430/2875] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 05:00:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 05:01:00.432787 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=4 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:00.593921 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=45,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:01.055352 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739fc84-f034-4cc2-98fe-92c6b0449297 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:01:01.118954 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739fc84-f034-4cc2-98fe-92c6b0449297 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:01:01.123478 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e15dc4-ae91-4e56-9bd6-19e4c43f011c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:01:01.124125 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e15dc4-ae91-4e56-9bd6-19e4c43f011c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:01:01.124405 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e15dc4-ae91-4e56-9bd6-19e4c43f011c admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:01:01.124673 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e15dc4-ae91-4e56-9bd6-19e4c43f011c admin admin] PATH_INFO: `/v3/users/db426336187644dc8c4d9c1870bbe711` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:01:01.125875 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e15dc4-ae91-4e56-9bd6-19e4c43f011c admin admin] RBAC: Authorizing `identity:delete_user(user_id=db426336187644dc8c4d9c1870bbe711)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:01:01.127881 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e15dc4-ae91-4e56-9bd6-19e4c43f011c admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:01:01.180436 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-00e15dc4-ae91-4e56-9bd6-19e4c43f011c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db426336187644dc8c4d9c1870bbe711'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:01:01.181191 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-00e15dc4-ae91-4e56-9bd6-19e4c43f011c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db426336187644dc8c4d9c1870bbe711'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:01:01.190628 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-00e15dc4-ae91-4e56-9bd6-19e4c43f011c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db426336187644dc8c4d9c1870bbe711'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:01:01.204535 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-00e15dc4-ae91-4e56-9bd6-19e4c43f011c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db426336187644dc8c4d9c1870bbe711'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:01:01.212102 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-00e15dc4-ae91-4e56-9bd6-19e4c43f011c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db426336187644dc8c4d9c1870bbe711'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:01:01.218401 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1446/2876] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 05:01:01 2022] DELETE /identity/v3/users/db426336187644dc8c4d9c1870bbe711 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:01:01.223778 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f958b6c-32c2-4a83-a2b3-9a6943df3314 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:01:01.224092 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f958b6c-32c2-4a83-a2b3-9a6943df3314 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:01:01.224389 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f958b6c-32c2-4a83-a2b3-9a6943df3314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:01:01.252881 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-3f958b6c-32c2-4a83-a2b3-9a6943df3314 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:01:01.254155 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-3f958b6c-32c2-4a83-a2b3-9a6943df3314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:01:01.321035 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1431/2877] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:01:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:01:01.331181 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e15dc4-ae91-4e56-9bd6-19e4c43f011c admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:01:01.333003 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-00e15dc4-ae91-4e56-9bd6-19e4c43f011c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:01:01.426187 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e15dc4-ae91-4e56-9bd6-19e4c43f011c admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:01:01.429922 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531a833-7035-42d5-9111-cd96b3ebf7f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:01:01.430581 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531a833-7035-42d5-9111-cd96b3ebf7f0 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:01:01.430867 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531a833-7035-42d5-9111-cd96b3ebf7f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:01:01.431138 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531a833-7035-42d5-9111-cd96b3ebf7f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:01:01.441732 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531a833-7035-42d5-9111-cd96b3ebf7f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:01:01.443235 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531a833-7035-42d5-9111-cd96b3ebf7f0 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:01:01.453871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1447/2878] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 05:01:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 05:01:01.759906 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f958b6c-32c2-4a83-a2b3-9a6943df3314 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:01:01.761377 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-3f958b6c-32c2-4a83-a2b3-9a6943df3314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:01:01.775200 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f958b6c-32c2-4a83-a2b3-9a6943df3314 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:01:01.780144 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9b883-4741-4520-9109-761a29ca78e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:01:01.780789 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9b883-4741-4520-9109-761a29ca78e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:01:01.781090 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9b883-4741-4520-9109-761a29ca78e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:01:01.781466 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9b883-4741-4520-9109-761a29ca78e2 admin admin] PATH_INFO: `/v3/projects/71427627ce1043fbbd1e58282e549f6c` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:01:01.782755 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9b883-4741-4520-9109-761a29ca78e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71427627ce1043fbbd1e58282e549f6c)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:01:01.784876 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9b883-4741-4520-9109-761a29ca78e2 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:01:01.843099 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-54f9b883-4741-4520-9109-761a29ca78e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71427627ce1043fbbd1e58282e549f6c', 'request_id': 'req-54f9b883-4741-4520-9109-761a29ca78e2'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:01:01.852536 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-54f9b883-4741-4520-9109-761a29ca78e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71427627ce1043fbbd1e58282e549f6c', 'request_id': 'req-54f9b883-4741-4520-9109-761a29ca78e2'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:01:01.859731 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-54f9b883-4741-4520-9109-761a29ca78e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71427627ce1043fbbd1e58282e549f6c', 'request_id': 'req-54f9b883-4741-4520-9109-761a29ca78e2'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:01:01.872169 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-54f9b883-4741-4520-9109-761a29ca78e2 admin admin] The token cache is being invalidate because project 71427627ce1043fbbd1e58282e549f6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86745) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 05:01:01.872430 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-54f9b883-4741-4520-9109-761a29ca78e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:01:01.873119 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-54f9b883-4741-4520-9109-761a29ca78e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:01:01.874722 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1432/2879] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 05:01:01 2022] DELETE /identity/v3/projects/71427627ce1043fbbd1e58282e549f6c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:01:01.880176 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c831dbc-c8eb-404d-94f9-84562a81a385 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:01:01.880457 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c831dbc-c8eb-404d-94f9-84562a81a385 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:01:01.880732 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c831dbc-c8eb-404d-94f9-84562a81a385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:01:01.889326 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:01.904125 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-6c831dbc-c8eb-404d-94f9-84562a81a385 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:01:01.906206 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-6c831dbc-c8eb-404d-94f9-84562a81a385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:01:01.982618 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1448/2880] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:01:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:01:01.997452 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffff7d-989f-4c58-a380-88490814b134 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:01:01.997791 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffff7d-989f-4c58-a380-88490814b134 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:01:01.998187 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffff7d-989f-4c58-a380-88490814b134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:01:02.019708 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-7dffff7d-989f-4c58-a380-88490814b134 None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:01:02.020997 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-7dffff7d-989f-4c58-a380-88490814b134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:01:02.029394 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1433/2881] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:01:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:01:02.034368 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c831dbc-c8eb-404d-94f9-84562a81a385 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:01:02.048939 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c831dbc-c8eb-404d-94f9-84562a81a385 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:01:02.056866 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456bb51-e000-4448-9bf9-006680550ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:01:02.057712 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456bb51-e000-4448-9bf9-006680550ac5 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:01:02.058071 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456bb51-e000-4448-9bf9-006680550ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:01:02.058342 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6456bb51-e000-4448-9bf9-006680550ac5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:01:02.059404 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6456bb51-e000-4448-9bf9-006680550ac5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86744) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 26 05:01:02.059891 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6456bb51-e000-4448-9bf9-006680550ac5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:01:02.062319 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6456bb51-e000-4448-9bf9-006680550ac5 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:01:02.075975 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1449/2882] 10.222.0.39 () {58 vars in 1153 bytes} [Tue Jul 26 05:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 26 05:01:02.080718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffff7d-989f-4c58-a380-88490814b134 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:01:02.091278 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffff7d-989f-4c58-a380-88490814b134 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:01:02.097698 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001fa72-e9e5-4e22-bbe5-e23e56a60b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:01:02.098301 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001fa72-e9e5-4e22-bbe5-e23e56a60b04 admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:01:02.098576 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001fa72-e9e5-4e22-bbe5-e23e56a60b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:01:02.098842 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d001fa72-e9e5-4e22-bbe5-e23e56a60b04 admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:01:02.099512 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001fa72-e9e5-4e22-bbe5-e23e56a60b04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:01:02.101416 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d001fa72-e9e5-4e22-bbe5-e23e56a60b04 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:01:02.131973 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1434/2883] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 05:01:02 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 05:01:02.137049 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456bb51-e000-4448-9bf9-006680550ac5 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:01:02.151603 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6456bb51-e000-4448-9bf9-006680550ac5 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:01:02.225700 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157c3b7-699d-476d-9dfb-1edd4afbb9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:01:02.226344 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157c3b7-699d-476d-9dfb-1edd4afbb9cd admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:01:02.226623 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157c3b7-699d-476d-9dfb-1edd4afbb9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:01:02.226890 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157c3b7-699d-476d-9dfb-1edd4afbb9cd admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:01:02.227573 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157c3b7-699d-476d-9dfb-1edd4afbb9cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:01:02.229561 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157c3b7-699d-476d-9dfb-1edd4afbb9cd admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:01:02.255000 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1450/2884] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 05:01:02 2022] POST /identity/v3/users => generated 292 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 05:01:02.259462 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001fa72-e9e5-4e22-bbe5-e23e56a60b04 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:01:02.270790 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d001fa72-e9e5-4e22-bbe5-e23e56a60b04 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:01:02.276118 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247352bc-e12a-4421-b3fc-a22bc054e71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:01:02.276750 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247352bc-e12a-4421-b3fc-a22bc054e71c admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:01:02.277028 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247352bc-e12a-4421-b3fc-a22bc054e71c admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:01:02.277295 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247352bc-e12a-4421-b3fc-a22bc054e71c admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:01:02.278024 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247352bc-e12a-4421-b3fc-a22bc054e71c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:01:02.279678 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247352bc-e12a-4421-b3fc-a22bc054e71c admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:01:02.293100 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1435/2885] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 05:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 05:01:02.298083 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157c3b7-699d-476d-9dfb-1edd4afbb9cd admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:01:02.308501 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157c3b7-699d-476d-9dfb-1edd4afbb9cd admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:01:02.313439 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0204c0-d6f0-42d0-8513-a1ad22ad95c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:01:02.314074 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0204c0-d6f0-42d0-8513-a1ad22ad95c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:01:02.314379 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0204c0-d6f0-42d0-8513-a1ad22ad95c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:01:02.314648 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0204c0-d6f0-42d0-8513-a1ad22ad95c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:01:02.315337 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0204c0-d6f0-42d0-8513-a1ad22ad95c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:01:02.316952 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0204c0-d6f0-42d0-8513-a1ad22ad95c0 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:01:02.328916 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1451/2886] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 05:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 05:01:02.333364 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247352bc-e12a-4421-b3fc-a22bc054e71c admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:01:02.344442 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247352bc-e12a-4421-b3fc-a22bc054e71c admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:01:02.350644 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7cc8b-7061-4e78-b583-29fcb664b066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:01:02.351231 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7cc8b-7061-4e78-b583-29fcb664b066 admin admin] REQUEST_METHOD: `PUT` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:01:02.351503 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7cc8b-7061-4e78-b583-29fcb664b066 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:01:02.351768 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7cc8b-7061-4e78-b583-29fcb664b066 admin admin] PATH_INFO: `/v3/projects/0d6c0e8a0c40496197d756476e7f3a17/users/77e1f668bb0d402bae0135842f2e96f5/roles/201d465b851546b1a19c322a3356d48d` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:01:02.368636 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7cc8b-7061-4e78-b583-29fcb664b066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d6c0e8a0c40496197d756476e7f3a17, user_id=77e1f668bb0d402bae0135842f2e96f5, role_id=201d465b851546b1a19c322a3356d48d)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:01:02.371341 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7cc8b-7061-4e78-b583-29fcb664b066 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:01:02.386501 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1436/2887] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 05:01:02 2022] PUT /identity/v3/projects/0d6c0e8a0c40496197d756476e7f3a17/users/77e1f668bb0d402bae0135842f2e96f5/roles/201d465b851546b1a19c322a3356d48d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:01:02.391760 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f8fb7-4ade-4a61-86f6-3473cffecd0c None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:01:02.392046 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f8fb7-4ade-4a61-86f6-3473cffecd0c None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:01:02.392313 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f8fb7-4ade-4a61-86f6-3473cffecd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:01:02.416679 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-359f8fb7-4ade-4a61-86f6-3473cffecd0c None None] MFA Rules not processed for user `fb4866594bcc4f3fa8cc9d8ea5e9f327`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:01:02.418208 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-359f8fb7-4ade-4a61-86f6-3473cffecd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:01:02.490986 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1452/2888] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:01:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:01:02.504064 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7cc8b-7061-4e78-b583-29fcb664b066 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:01:02.507098 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-1fb7cc8b-7061-4e78-b583-29fcb664b066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:01:02.535809 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:02.573613 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7cc8b-7061-4e78-b583-29fcb664b066 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:01:02.577672 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db24a5-974a-4827-8dc1-cf7d9b14a755 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:01:02.578328 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db24a5-974a-4827-8dc1-cf7d9b14a755 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:01:02.578606 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db24a5-974a-4827-8dc1-cf7d9b14a755 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:01:02.578880 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db24a5-974a-4827-8dc1-cf7d9b14a755 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:01:02.588458 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db24a5-974a-4827-8dc1-cf7d9b14a755 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:01:02.589896 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db24a5-974a-4827-8dc1-cf7d9b14a755 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:01:02.599521 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1437/2889] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 05:01:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 05:01:07.174713 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f606f-3161-41ec-bdca-a7140639fa01 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:01:07.175667 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f606f-3161-41ec-bdca-a7140639fa01 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:01:07.176480 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f606f-3161-41ec-bdca-a7140639fa01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:01:07.207170 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:07.220466 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-271f606f-3161-41ec-bdca-a7140639fa01 None None] MFA Rules not processed for user `77e1f668bb0d402bae0135842f2e96f5`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:01:07.221758 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-271f606f-3161-41ec-bdca-a7140639fa01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:01:07.318986 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1453/2890] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:01:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:01:07.324172 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db24a5-974a-4827-8dc1-cf7d9b14a755 service neutron] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:01:07.335973 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db24a5-974a-4827-8dc1-cf7d9b14a755 service neutron] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:01:07.341909 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b19715-7154-4627-9a98-f354a853b27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:01:07.342646 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b19715-7154-4627-9a98-f354a853b27e admin admin] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:01:07.343036 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b19715-7154-4627-9a98-f354a853b27e admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:01:07.343348 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b19715-7154-4627-9a98-f354a853b27e admin admin] PATH_INFO: `/v3/projects` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:01:07.344122 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b19715-7154-4627-9a98-f354a853b27e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:01:07.346411 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b19715-7154-4627-9a98-f354a853b27e admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:01:07.383888 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1438/2891] 10.222.0.39 () {60 vars in 1153 bytes} [Tue Jul 26 05:01:07 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 26 05:01:07.392071 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f606f-3161-41ec-bdca-a7140639fa01 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:01:07.415158 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f606f-3161-41ec-bdca-a7140639fa01 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:01:07.507254 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902a6f4-512e-47af-8266-4ca87597f51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:01:07.507985 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902a6f4-512e-47af-8266-4ca87597f51e admin admin] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:01:07.508340 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902a6f4-512e-47af-8266-4ca87597f51e admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:01:07.508676 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902a6f4-512e-47af-8266-4ca87597f51e admin admin] PATH_INFO: `/v3/users` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:01:07.509435 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902a6f4-512e-47af-8266-4ca87597f51e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:01:07.511893 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902a6f4-512e-47af-8266-4ca87597f51e admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:01:07.537546 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1454/2892] 10.222.0.39 () {60 vars in 1144 bytes} [Tue Jul 26 05:01:07 2022] POST /identity/v3/users => generated 299 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 26 05:01:07.542260 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b19715-7154-4627-9a98-f354a853b27e admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:01:07.553944 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b19715-7154-4627-9a98-f354a853b27e admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:01:07.559159 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe4058-bb0c-4538-8419-6c13c8044081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:01:07.559939 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe4058-bb0c-4538-8419-6c13c8044081 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:01:07.560289 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe4058-bb0c-4538-8419-6c13c8044081 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:01:07.560629 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe4058-bb0c-4538-8419-6c13c8044081 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:01:07.562481 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe4058-bb0c-4538-8419-6c13c8044081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:01:07.564335 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe4058-bb0c-4538-8419-6c13c8044081 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:01:07.578094 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1439/2893] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 05:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 26 05:01:07.583638 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902a6f4-512e-47af-8266-4ca87597f51e admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:01:07.598342 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902a6f4-512e-47af-8266-4ca87597f51e admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:01:07.604831 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdb15f-9939-4181-945e-87f366e31d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:01:07.605708 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdb15f-9939-4181-945e-87f366e31d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:01:07.606133 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdb15f-9939-4181-945e-87f366e31d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:01:07.606468 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdb15f-9939-4181-945e-87f366e31d31 admin admin] PATH_INFO: `/v3/projects/b886cf2320ef4be2be32eacdebe33e2e/users/4d8fff6959164aa7ad62d6fe6b2ea74b/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:01:07.627602 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdb15f-9939-4181-945e-87f366e31d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b886cf2320ef4be2be32eacdebe33e2e, user_id=4d8fff6959164aa7ad62d6fe6b2ea74b, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:01:07.630518 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbdb15f-9939-4181-945e-87f366e31d31 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:01:07.648707 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1455/2894] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 05:01:07 2022] PUT /identity/v3/projects/b886cf2320ef4be2be32eacdebe33e2e/users/4d8fff6959164aa7ad62d6fe6b2ea74b/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 05:01:07.654309 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe4058-bb0c-4538-8419-6c13c8044081 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:01:07.667245 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe4058-bb0c-4538-8419-6c13c8044081 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:01:07.739192 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e24e5b-b59a-4ef2-924f-4a6380622985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:01:07.739839 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e24e5b-b59a-4ef2-924f-4a6380622985 admin admin] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:01:07.740219 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e24e5b-b59a-4ef2-924f-4a6380622985 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:01:07.740492 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e24e5b-b59a-4ef2-924f-4a6380622985 admin admin] PATH_INFO: `/v3/roles` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:01:07.741236 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e24e5b-b59a-4ef2-924f-4a6380622985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:01:07.743406 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e24e5b-b59a-4ef2-924f-4a6380622985 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:01:07.755018 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1440/2895] 10.222.0.39 () {58 vars in 1122 bytes} [Tue Jul 26 05:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 26 05:01:07.759881 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdb15f-9939-4181-945e-87f366e31d31 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:01:07.771052 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdb15f-9939-4181-945e-87f366e31d31 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:01:07.776429 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c329c-38b5-43ea-bbee-0cafdd8719ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:01:07.777149 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c329c-38b5-43ea-bbee-0cafdd8719ae admin admin] REQUEST_METHOD: `PUT` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:01:07.777429 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c329c-38b5-43ea-bbee-0cafdd8719ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:01:07.777731 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c329c-38b5-43ea-bbee-0cafdd8719ae admin admin] PATH_INFO: `/v3/projects/b886cf2320ef4be2be32eacdebe33e2e/users/4d8fff6959164aa7ad62d6fe6b2ea74b/roles/2bfdd65b06554a6da967b3939da753c7` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:01:07.780128 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c329c-38b5-43ea-bbee-0cafdd8719ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=b886cf2320ef4be2be32eacdebe33e2e, user_id=4d8fff6959164aa7ad62d6fe6b2ea74b, role_id=2bfdd65b06554a6da967b3939da753c7)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:01:07.783186 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c329c-38b5-43ea-bbee-0cafdd8719ae admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:01:07.797649 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1456/2896] 10.222.0.39 () {60 vars in 1483 bytes} [Tue Jul 26 05:01:07 2022] PUT /identity/v3/projects/b886cf2320ef4be2be32eacdebe33e2e/users/4d8fff6959164aa7ad62d6fe6b2ea74b/roles/2bfdd65b06554a6da967b3939da753c7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 05:01:13.297167 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b014c-9f05-4142-82ec-421670b39864 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:01:13.297867 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b014c-9f05-4142-82ec-421670b39864 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:01:13.297867 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b014c-9f05-4142-82ec-421670b39864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:01:13.344261 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-1a2b014c-9f05-4142-82ec-421670b39864 None None] MFA Rules not processed for user `4d8fff6959164aa7ad62d6fe6b2ea74b`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:01:13.345548 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-1a2b014c-9f05-4142-82ec-421670b39864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:01:13.447752 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1441/2897] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:01:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:01:13.462760 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c329c-38b5-43ea-bbee-0cafdd8719ae admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:01:13.465667 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-567c329c-38b5-43ea-bbee-0cafdd8719ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:01:13.553900 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c329c-38b5-43ea-bbee-0cafdd8719ae admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:01:13.557836 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce7713-76d6-4b79-8d49-9e4429b76e2b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cfbf2c03eb740ed8b72c4825cffc341', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:01:13.558531 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce7713-76d6-4b79-8d49-9e4429b76e2b service glance] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:01:13.558830 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce7713-76d6-4b79-8d49-9e4429b76e2b service glance] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:01:13.559091 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce7713-76d6-4b79-8d49-9e4429b76e2b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:01:13.564018 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:13.631345 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce7713-76d6-4b79-8d49-9e4429b76e2b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:01:13.633016 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce7713-76d6-4b79-8d49-9e4429b76e2b service glance] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:01:13.643367 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1457/2898] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 05:01:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 05:01:13.784358 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a43fc-243c-479d-85fb-a19ccda43665 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:01:13.784644 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a43fc-243c-479d-85fb-a19ccda43665 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:01:13.784905 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7a43fc-243c-479d-85fb-a19ccda43665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:01:13.806290 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-4d7a43fc-243c-479d-85fb-a19ccda43665 None None] MFA Rules not processed for user `b613dee1148c4822af2e7847b28cf4aa`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:01:13.807846 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-4d7a43fc-243c-479d-85fb-a19ccda43665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:01:13.814181 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:13.872196 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1442/2899] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Jul 26 05:01:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:01:13.885285 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce7713-76d6-4b79-8d49-9e4429b76e2b service glance] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:01:13.886712 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-68ce7713-76d6-4b79-8d49-9e4429b76e2b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:01:13.959128 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce7713-76d6-4b79-8d49-9e4429b76e2b service glance] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:01:13.966013 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe9bff-f5fa-4f61-8670-e0c20cee4c09 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e089e39e9de419b9e2fb1d7fc2d245a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:01:13.966965 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe9bff-f5fa-4f61-8670-e0c20cee4c09 service swift] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:01:13.967285 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe9bff-f5fa-4f61-8670-e0c20cee4c09 service swift] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:01:13.967609 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe9bff-f5fa-4f61-8670-e0c20cee4c09 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:01:13.977643 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe9bff-f5fa-4f61-8670-e0c20cee4c09 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:01:13.979348 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe9bff-f5fa-4f61-8670-e0c20cee4c09 service swift] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:01:13.989066 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1458/2900] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 05:01:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 26 05:01:22.785842 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ec852-23fa-4698-b1bd-559e92fc462c None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:01:22.786413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ec852-23fa-4698-b1bd-559e92fc462c None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:01:22.786413 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ec852-23fa-4698-b1bd-559e92fc462c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:01:22.815588 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-3e7ec852-23fa-4698-b1bd-559e92fc462c None None] MFA Rules not processed for user `77e1f668bb0d402bae0135842f2e96f5`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:01:22.816821 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-3e7ec852-23fa-4698-b1bd-559e92fc462c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:01:22.824772 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1443/2901] 10.222.0.39 () {58 vars in 958 bytes} [Tue Jul 26 05:01:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:01:23.985668 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=57 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:24.968761 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def8467-18bd-4f42-aaa8-8f1d161290d6 None None] REQUEST_METHOD: `POST` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:01:24.969026 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def8467-18bd-4f42-aaa8-8f1d161290d6 None None] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:01:24.969320 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def8467-18bd-4f42-aaa8-8f1d161290d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:01:24.990986 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.auth.core [None req-1def8467-18bd-4f42-aaa8-8f1d161290d6 None None] MFA Rules not processed for user `b613dee1148c4822af2e7847b28cf4aa`. Rule list: `[]` (Enabled: `True`). {{(pid=86744) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:01:24.992575 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-1def8467-18bd-4f42-aaa8-8f1d161290d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:01:25.001041 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1459/2902] 10.222.0.39 () {58 vars in 1009 bytes} [Tue Jul 26 05:01:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:01:25.014322 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ec852-23fa-4698-b1bd-559e92fc462c None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:01:25.027598 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ec852-23fa-4698-b1bd-559e92fc462c None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:01:25.033762 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb93a9b-195d-4da9-b33e-8df660433c60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e089e39e9de419b9e2fb1d7fc2d245a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:01:25.034533 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb93a9b-195d-4da9-b33e-8df660433c60 service swift] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:01:25.034805 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb93a9b-195d-4da9-b33e-8df660433c60 service swift] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:01:25.035314 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb93a9b-195d-4da9-b33e-8df660433c60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:01:25.045272 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb93a9b-195d-4da9-b33e-8df660433c60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:01:25.047234 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb93a9b-195d-4da9-b33e-8df660433c60 service swift] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:01:25.056567 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1444/2903] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 05:01:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 26 05:01:34.984972 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=3 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:35.052828 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=29 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:01:47.000776 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def8467-18bd-4f42-aaa8-8f1d161290d6 None None] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:01:47.002777 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-1def8467-18bd-4f42-aaa8-8f1d161290d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:01:47.088399 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def8467-18bd-4f42-aaa8-8f1d161290d6 None None] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:01:47.095182 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba9a83-5954-4767-83f5-8e9a8b494c84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:01:47.096225 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba9a83-5954-4767-83f5-8e9a8b494c84 service neutron] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:01:47.096709 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba9a83-5954-4767-83f5-8e9a8b494c84 service neutron] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:01:47.097158 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba9a83-5954-4767-83f5-8e9a8b494c84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:01:47.113022 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba9a83-5954-4767-83f5-8e9a8b494c84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:01:47.119284 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba9a83-5954-4767-83f5-8e9a8b494c84 service neutron] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:01:47.137946 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1460/2904] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 05:01:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 05:01:57.129910 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=26 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:03:02.531239 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb93a9b-195d-4da9-b33e-8df660433c60 service swift] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:03:02.541827 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb93a9b-195d-4da9-b33e-8df660433c60 service swift] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:03:02.545658 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe404b6-9cb4-4c98-9318-51ef0e2cff61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74fee029d5214ce18b4b9ddc2df72a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:03:02.546337 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe404b6-9cb4-4c98-9318-51ef0e2cff61 service neutron] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:03:02.546617 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe404b6-9cb4-4c98-9318-51ef0e2cff61 service neutron] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:03:02.546890 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe404b6-9cb4-4c98-9318-51ef0e2cff61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:03:02.548898 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-ebe404b6-9cb4-4c98-9318-51ef0e2cff61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:03:02.656678 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe404b6-9cb4-4c98-9318-51ef0e2cff61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:03:02.659531 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe404b6-9cb4-4c98-9318-51ef0e2cff61 service neutron] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:03:02.701746 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1445/2905] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 05:03:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 26 05:03:06.191925 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba9a83-5954-4767-83f5-8e9a8b494c84 service neutron] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:03:06.193764 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-fcba9a83-5954-4767-83f5-8e9a8b494c84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:03:06.259620 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba9a83-5954-4767-83f5-8e9a8b494c84 service neutron] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:03:06.264114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6392b5-a020-4cda-ac8c-30c9cf21f8cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bb16e4960af4c03bc274dea6bea2e1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:03:06.264763 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6392b5-a020-4cda-ac8c-30c9cf21f8cc service cinder] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:03:06.265075 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6392b5-a020-4cda-ac8c-30c9cf21f8cc service cinder] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:03:06.265542 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6392b5-a020-4cda-ac8c-30c9cf21f8cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:03:06.267557 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-5d6392b5-a020-4cda-ac8c-30c9cf21f8cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:03:06.282724 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6392b5-a020-4cda-ac8c-30c9cf21f8cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:03:06.284366 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6392b5-a020-4cda-ac8c-30c9cf21f8cc service cinder] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:03:06.298128 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1461/2906] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 05:03:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 05:03:11.598524 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56459d8-7af4-454d-9284-dbda51adc940 None None] REQUEST_METHOD: `POST` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:03:11.599397 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56459d8-7af4-454d-9284-dbda51adc940 None None] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:03:11.599397 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56459d8-7af4-454d-9284-dbda51adc940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:03:11.659025 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.auth.core [None req-b56459d8-7af4-454d-9284-dbda51adc940 None None] MFA Rules not processed for user `b613dee1148c4822af2e7847b28cf4aa`. Rule list: `[]` (Enabled: `True`). {{(pid=86745) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 26 05:03:11.660493 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-b56459d8-7af4-454d-9284-dbda51adc940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:03:11.684008 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1446/2907] 10.222.0.39 () {58 vars in 967 bytes} [Tue Jul 26 05:03:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 26 05:03:11.736498 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6392b5-a020-4cda-ac8c-30c9cf21f8cc service cinder] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:03:11.762733 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6392b5-a020-4cda-ac8c-30c9cf21f8cc service cinder] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:03:11.768342 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab88ef-9351-4650-ac87-3e2a2da328bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0e089e39e9de419b9e2fb1d7fc2d245a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:03:11.769002 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab88ef-9351-4650-ac87-3e2a2da328bb service swift] REQUEST_METHOD: `GET` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:03:11.769282 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab88ef-9351-4650-ac87-3e2a2da328bb service swift] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:03:11.769555 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ab88ef-9351-4650-ac87-3e2a2da328bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:03:11.779616 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab88ef-9351-4650-ac87-3e2a2da328bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:03:11.781358 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ab88ef-9351-4650-ac87-3e2a2da328bb service swift] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:03:11.792315 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1462/2908] 10.222.0.39 () {60 vars in 1384 bytes} [Tue Jul 26 05:03:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 26 05:03:20.474966 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56459d8-7af4-454d-9284-dbda51adc940 None None] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:03:20.562073 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56459d8-7af4-454d-9284-dbda51adc940 None None] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:03:20.566702 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46998e9a-fccd-481a-9968-03b06938f2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:03:20.567405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46998e9a-fccd-481a-9968-03b06938f2c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:03:20.567680 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46998e9a-fccd-481a-9968-03b06938f2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:03:20.568055 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46998e9a-fccd-481a-9968-03b06938f2c7 admin admin] PATH_INFO: `/v3/users/77e1f668bb0d402bae0135842f2e96f5` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:03:20.569332 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46998e9a-fccd-481a-9968-03b06938f2c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77e1f668bb0d402bae0135842f2e96f5)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:03:20.571350 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46998e9a-fccd-481a-9968-03b06938f2c7 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:03:20.614322 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:03:20.630462 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-46998e9a-fccd-481a-9968-03b06938f2c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77e1f668bb0d402bae0135842f2e96f5'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:03:20.639284 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-46998e9a-fccd-481a-9968-03b06938f2c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77e1f668bb0d402bae0135842f2e96f5'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:03:20.653519 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-46998e9a-fccd-481a-9968-03b06938f2c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77e1f668bb0d402bae0135842f2e96f5'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:03:20.661605 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-46998e9a-fccd-481a-9968-03b06938f2c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77e1f668bb0d402bae0135842f2e96f5'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:03:20.662512 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-46998e9a-fccd-481a-9968-03b06938f2c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77e1f668bb0d402bae0135842f2e96f5'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:03:20.669776 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1447/2909] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 05:03:20 2022] DELETE /identity/v3/users/77e1f668bb0d402bae0135842f2e96f5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:03:20.901665 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab88ef-9351-4650-ac87-3e2a2da328bb service swift] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:03:20.921073 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ab88ef-9351-4650-ac87-3e2a2da328bb service swift] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:03:20.993195 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b07b68-36fa-4b81-aea3-b4b9b571f079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:03:20.993852 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b07b68-36fa-4b81-aea3-b4b9b571f079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:03:20.994154 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b07b68-36fa-4b81-aea3-b4b9b571f079 admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:03:20.994425 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b07b68-36fa-4b81-aea3-b4b9b571f079 admin admin] PATH_INFO: `/v3/projects/0d6c0e8a0c40496197d756476e7f3a17` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:03:20.995619 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b07b68-36fa-4b81-aea3-b4b9b571f079 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d6c0e8a0c40496197d756476e7f3a17)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:03:20.997564 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b07b68-36fa-4b81-aea3-b4b9b571f079 admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:03:21.052026 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-60b07b68-36fa-4b81-aea3-b4b9b571f079 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d6c0e8a0c40496197d756476e7f3a17', 'request_id': 'req-60b07b68-36fa-4b81-aea3-b4b9b571f079'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:03:21.061871 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-60b07b68-36fa-4b81-aea3-b4b9b571f079 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d6c0e8a0c40496197d756476e7f3a17', 'request_id': 'req-60b07b68-36fa-4b81-aea3-b4b9b571f079'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:03:21.068355 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-60b07b68-36fa-4b81-aea3-b4b9b571f079 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d6c0e8a0c40496197d756476e7f3a17', 'request_id': 'req-60b07b68-36fa-4b81-aea3-b4b9b571f079'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:03:21.080547 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-60b07b68-36fa-4b81-aea3-b4b9b571f079 admin admin] The token cache is being invalidate because project 0d6c0e8a0c40496197d756476e7f3a17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 05:03:21.080864 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-60b07b68-36fa-4b81-aea3-b4b9b571f079 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:03:21.081609 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-60b07b68-36fa-4b81-aea3-b4b9b571f079 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:03:21.083251 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1463/2910] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 05:03:20 2022] DELETE /identity/v3/projects/0d6c0e8a0c40496197d756476e7f3a17 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:03:21.087737 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46998e9a-fccd-481a-9968-03b06938f2c7 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:03:21.089261 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-46998e9a-fccd-481a-9968-03b06938f2c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:03:21.105220 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46998e9a-fccd-481a-9968-03b06938f2c7 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:03:21.181603 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302d86b-3ffb-4f5f-b9c9-cb4ce438e1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:03:21.182291 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302d86b-3ffb-4f5f-b9c9-cb4ce438e1f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:03:21.182571 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302d86b-3ffb-4f5f-b9c9-cb4ce438e1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:03:21.182837 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302d86b-3ffb-4f5f-b9c9-cb4ce438e1f5 admin admin] PATH_INFO: `/v3/users/4d8fff6959164aa7ad62d6fe6b2ea74b` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:03:21.184143 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302d86b-3ffb-4f5f-b9c9-cb4ce438e1f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d8fff6959164aa7ad62d6fe6b2ea74b)` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:03:21.186104 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302d86b-3ffb-4f5f-b9c9-cb4ce438e1f5 admin admin] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:03:21.240718 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-5302d86b-3ffb-4f5f-b9c9-cb4ce438e1f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d8fff6959164aa7ad62d6fe6b2ea74b'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:03:21.258883 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-5302d86b-3ffb-4f5f-b9c9-cb4ce438e1f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d8fff6959164aa7ad62d6fe6b2ea74b'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:03:21.275284 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-5302d86b-3ffb-4f5f-b9c9-cb4ce438e1f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d8fff6959164aa7ad62d6fe6b2ea74b'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:03:21.283566 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-5302d86b-3ffb-4f5f-b9c9-cb4ce438e1f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d8fff6959164aa7ad62d6fe6b2ea74b'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:03:21.284487 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.notifications [None req-5302d86b-3ffb-4f5f-b9c9-cb4ce438e1f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d8fff6959164aa7ad62d6fe6b2ea74b'} {{(pid=86745) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:03:21.291371 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1448/2911] 10.222.0.39 () {58 vars in 1224 bytes} [Tue Jul 26 05:03:21 2022] DELETE /identity/v3/users/4d8fff6959164aa7ad62d6fe6b2ea74b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 26 05:03:21.486739 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b07b68-36fa-4b81-aea3-b4b9b571f079 admin admin] Authenticating user token {{(pid=86744) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:03:21.488652 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.fernet_utils [None req-60b07b68-36fa-4b81-aea3-b4b9b571f079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86744) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:03:21.507990 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b07b68-36fa-4b81-aea3-b4b9b571f079 admin admin] Validating token access rules against request {{(pid=86744) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:03:21.518098 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:03:21.591449 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb3674-9661-4a5e-b9c5-190fae939c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb4866594bcc4f3fa8cc9d8ea5e9f327', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01e6e551a86f4df9abc0b95c6772bf0e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86744) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:03:21.592114 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb3674-9661-4a5e-b9c5-190fae939c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:03:21.592392 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb3674-9661-4a5e-b9c5-190fae939c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:03:21.592660 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb3674-9661-4a5e-b9c5-190fae939c2a admin admin] PATH_INFO: `/v3/projects/b886cf2320ef4be2be32eacdebe33e2e` {{(pid=86744) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:03:21.593857 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cb3674-9661-4a5e-b9c5-190fae939c2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b886cf2320ef4be2be32eacdebe33e2e)` {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:03:21.595830 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cb3674-9661-4a5e-b9c5-190fae939c2a admin admin] RBAC: Authorization granted {{(pid=86744) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:03:21.650063 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-12cb3674-9661-4a5e-b9c5-190fae939c2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b886cf2320ef4be2be32eacdebe33e2e', 'request_id': 'req-12cb3674-9661-4a5e-b9c5-190fae939c2a'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:03:21.660034 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-12cb3674-9661-4a5e-b9c5-190fae939c2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b886cf2320ef4be2be32eacdebe33e2e', 'request_id': 'req-12cb3674-9661-4a5e-b9c5-190fae939c2a'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:03:21.666518 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-12cb3674-9661-4a5e-b9c5-190fae939c2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b886cf2320ef4be2be32eacdebe33e2e', 'request_id': 'req-12cb3674-9661-4a5e-b9c5-190fae939c2a'} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:03:21.680480 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-12cb3674-9661-4a5e-b9c5-190fae939c2a admin admin] The token cache is being invalidate because project b886cf2320ef4be2be32eacdebe33e2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86744) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 26 05:03:21.680772 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-12cb3674-9661-4a5e-b9c5-190fae939c2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:03:21.681537 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG keystone.notifications [None req-12cb3674-9661-4a5e-b9c5-190fae939c2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86744) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 26 05:03:21.683274 dv-cinder-850574-1-smb devstack@keystone.service[86744]: [pid: 86744|app: 0|req: 1464/2912] 10.222.0.39 () {58 vars in 1233 bytes} [Tue Jul 26 05:03:21 2022] DELETE /identity/v3/projects/b886cf2320ef4be2be32eacdebe33e2e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 26 05:03:31.287488 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=72,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:03:31.676038 dv-cinder-850574-1-smb devstack@keystone.service[86744]: DEBUG dbcounter [-] [86744] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86744) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 26 05:05:40.036412 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302d86b-3ffb-4f5f-b9c9-cb4ce438e1f5 admin admin] Authenticating user token {{(pid=86745) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 26 05:05:40.038165 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-5302d86b-3ffb-4f5f-b9c9-cb4ce438e1f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:05:40.114271 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302d86b-3ffb-4f5f-b9c9-cb4ce438e1f5 admin admin] Validating token access rules against request {{(pid=86745) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 26 05:05:40.186848 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef72c25-2af5-4828-b2f6-27636e04fb83 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21dfe7b4d6524ec2885224d77395b00b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4d7c29a2b144df6afa96fd6894254a4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86745) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 26 05:05:40.187494 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef72c25-2af5-4828-b2f6-27636e04fb83 service placement] REQUEST_METHOD: `GET` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 26 05:05:40.187776 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef72c25-2af5-4828-b2f6-27636e04fb83 service placement] SCRIPT_NAME: `/identity` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 26 05:05:40.188045 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef72c25-2af5-4828-b2f6-27636e04fb83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86745) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 26 05:05:40.189942 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.fernet_utils [None req-aef72c25-2af5-4828-b2f6-27636e04fb83 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86745) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 26 05:05:40.202779 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef72c25-2af5-4828-b2f6-27636e04fb83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 26 05:05:40.204405 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef72c25-2af5-4828-b2f6-27636e04fb83 service placement] RBAC: Authorization granted {{(pid=86745) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 26 05:05:40.215633 dv-cinder-850574-1-smb devstack@keystone.service[86745]: [pid: 86745|app: 0|req: 1449/2913] 10.222.0.39 () {60 vars in 1365 bytes} [Tue Jul 26 05:05:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 26 05:05:50.210868 dv-cinder-850574-1-smb devstack@keystone.service[86745]: DEBUG dbcounter [-] [86745] Writing DB stats keystone:SELECT=58 {{(pid=86745) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}